If you’re working with any designer, they’ll still want you to provide direction. That’s just how it’s done.
We’re working on improvements here, and I’ve found that if you give it more direction, and work with it it’ll produce great design. Even if I’m working with a model that’s good at one shotting a design or “vibe designing,” I don’t love the output until I’ve put a bit of finesse into the direction. Same as when I’m designing without an llm… I tend to start simply, even with just a sketch or moodboard, then build. This is where your taste still matters.