On PC/macOS, you can enable safe mode by holding down shift when starting the game. On Android, hold the launch button instead.
A popup will be shown to confirm your intent, like the one shown below.
Once in safe mode, you can open the Geode menu and manage your mods as needed.
ALT screenshot showing the safe mode prompt on macOS. an arrow is pointing to the yes button to indicate that it should be pressed