Should the states then in turn "forfeit" the land they've seized from the indigenous people? People who thoughtfully, and with appropriate respect to the miracle of Earth, managed to live sustainably for 10k years? I mean, you seem inclined to the rights of the indigenous, no?
YIMBYs of all people might be surprised to learn how little land is needed to meet housing demand, particularly if they value density. That said, yes, the feds should forfeit the land they've seized from states.