That would be, as Stoic authors point out, a mistake. Prudence and the other virtues often bear upon externals and indifferents.
Epictetus is crystal clear on this. How we use, how we deal with (khresis) those things IS in our control, and we should therefore “give a shit”