I have a weird issue with the OpenAI realtime API.
I am trying to set instructions via my relay server rather than from the client side using updateSession. As a test I'm just trying to get it to respond in spanish.
It sort of works, but only after my first audio input.
The first response triggered by sendUserMessageContent is always in English.
Anyone got any ideas?