Token cost is easy to measure, but answer quality is not, so if you reward solely on cost or token reduction, output quality can slip for a while before it's noticeable.
Keeping answer quality high while cost comes down is most of what we work on at
@dosu_ai. Happy to swap notes on how to measure the quality side!
Yesterday I wrote how I'd expect more engineers to get rewarded the next perf reviews and promo cycles for saving token costs for their company.
Today already got messages from devs who already got rewarded with eg bonuses for having done exactly this
It only makes sense!