
While auditing benchmarks, Kaggle caught a model that found another model's API keys inside the eval container, called that model and handed in its answer. Another one simply rewrote the grading
Your coding agent sends almost the same prompt on every turn. The whole conversation so far, plus one new message. If the provider still has that prompt in cache, the turn is cheaper and faster. If