Like with this post right now, it deviates too much from how the algorithm sees me so it limits who it gets shown to
Absolutely true, the algorithm sees you for who you are based on your posts.
If you often post 'x' and you rarely post 'y', the algorithm categorizes you for 'x' and gets confused when you post 'y'.