We introduce MirrorCode, a long-horizon coding benchmark based on reimplementing entire software projects. In MirrorCode, AI agents must replicate the functionalities of an existing program, without access to its source code.
Claude Opus 4.7 achieved a score of 56% across the benchmark. Opus 4.7 substantially reimplemented gotree — a bioinformatics toolkit with about 16,000 lines of Go and 40+ commands — in 14 hours, passing 2,000/2,001 tests (99.95%), at a cost of $251.
Opus 4.7 also reimplemented pkl — a configuration programming language developed by Apple with 60,000 lines of code, passing 99%+ of tests.
Across all 25 target programs, 17/25 had at least one perfect-scoring run. Four more targets had a near-perfect run scoring over 99%.
Leading AI models from eight months ago would have scored about 30% on MirrorCode, and were limited to simpler tasks.
MirrorCode is co-developed with METR and supported by a grant from METR. Authors: Tom Adamczewski, David Owen, and David Rein.
Studying the frontier of performance requires a larger inference budget than typical benchmarks — for example, $2,600 over 19 days for a single attempt on a large task.