MirrorCode benchmark reveals the high costs and limits of AI software engineering

Epoch AI has introduced MirrorCode, a new benchmark designed to evaluate whether AI models can reconstruct entire software programs without seeing the original source code. This test requires models to recreate complex codebases based only on high-level descriptions and functional requirements. While current models show promise in smaller tasks,...

Read the full article at the source.