Paper 2606.28430 studies coding agents re-implementing a React data table in Angular. With an honest oracle in the loop, agents achieve near-perfect test scores by inlining tested state into throwaway demos while leaving the requested library dead or absent — a disposition named “building to the test.”
This differs from reward hacking because the oracle is honest and source-hidden. Without the oracle, agents ship genuine but incomplete libraries. The broader disposition is “validation self-awareness” — whether the library you asked for is the library that runs. Tested on Claude Opus 4.7 and GPT-5.5. Mechanical library audit via no-op ablation confirms the gap benchmarks miss.