The incompetence of tyranny hiding behind a veneer of brute force is literally (and I mean literally) the theme of this show. The character says this out loud:
Tyranny requires constant effort. It breaks, it leaks. Authority is brittle, and oppression is the mask of fear.
The reason Andor is aging poorly for me is because I realized the Empire is insanely incompetent in the show and it ruins the whole "actually evil serious threat" thing
In the prison Cassian was through in there were a total of like 30 guards in the entire complex, which was a vital slave labor source for the most important industrial project the Empire was undertaking
The Empire sent more soldiers to antagonize Ferrix during Aunt Petunia's funeral because they are mustache twirling saturday morning villains instead of a serious entity