Skip to main content
Source-based case analysis

A closer look at research and real systems

We examine published research and documented systems, explaining what the evidence means for engineering decisions and where its limits lie.

Engineering

Coding agents and productivity: what the METR studies actually show

A technical analysis of METR's measurements of AI-assisted software development, their limitations and the implications for credible internal evaluations.

The studies do not provide a universal productivity number for coding agents. They show how closely outcomes depend on tool maturity, task selection and measurement design.

Sources reviewed: 2026-07-18

Read the analysis →

What would you like to assess or build?

Briefly describe the situation, your objective and the systems involved. We will respond with a technical assessment and a practical next step.

Discuss your project