Will Cook

Zenith

An AI model that tests code was shown the bugs it had missed on practice problems. On 58 new problems, the share of hidden bug types it caught rose on average from 69.2% to 77.0%.

Limits: About half of the rise came from timeouts. The study tested one model on short programs, and rules the model wrote from its own mistakes did not clearly raise the score.

Read the study

I use AI to make AI-written maths and code easier to understand.

All fifteen projects