Relevance team at Bing aims to optimize the OEC metric [overall evaluation criterion] by 2% per year.
"Because the team runs thousands of experiment Treatments, and some may appear positive by chance, credit towards the 2% is assigned based on a replication experiment: …