For almost two years, we ran our AI on OpenAI. Easy to start with, works out of the box. But as we grew, three things started bugging me.
The cost: Since February 1st we'd sent OpenAI nearly 29 million requests and over 15 billion tokens, with the curve only steepening.