One of the tricks I sometimes use is that I convert displacement in blender as a blendshape. I make a displacement map as I previously shown. but instead of importing it as a displacement map, I just load it as a blendshape. Theres pros and cons for both methods. Notably seams.