Topic
Choosing what to measure when evaluating AI-assisted development, such as accepted changes and review cost versus generated lines of code.
The New Stack says AI-assisted teams have moved the bottleneck from writing code to verifying it, and the remedy it proposes is an afternoon spent sorting the last 100 review comments into rules, tests and judgment.
Reality
One engineer's quarter of data has median merge time going from 4 hours to 14 while median diff size climbed from 90 lines to 310, and the way both ends of the latency distribution moved points at PR size rather than reviewer saturation.
Reality
Nearly nine in ten Fortune 1,000 executives say AI makes their organisations faster, but only six percent can point to clear ROI. Median quarterly spend has meanwhile risen about thirty-fold.
Reality
Internal telemetry reported by Reuters shows code changes up 220% while user-facing changes rose 36%, and major incidents up 40%. The cuts of up to 60% did not happen.
Reality
Block, Stripe and Shopify run in-house coding agents too. What Ramp built is not a model but a credentialed development box, and that is the part procurement cannot order.
Reality
A shipping-games veteran argues assistants fail on mature Unity projects because versions, scene ownership and serialized references sit outside the code. Score accepted changes, not lines.
Reality