Mmm it's different for different people. Ideally, the worst years of your life are probably pre-midlife, around your late thirties/forties.
If shit's looking bad at 23, then it's probably just gonna get worse.
Some kids are homeless at 16 :( so sometimes it REALLY sucks...