Artifacts

What each model built on each task, shown on the held-out cases it was graded on.

SQL replay

Each agent wrote replay.py, which turns a PostgreSQL change stream into the shortest SQL script that leaves the same rows after every transaction; every final replay.py is re-run here. Hidden test workloads are the ones the reward is computed on; agents could test on the public samples, so those are not graded.

View the task: SQL Change Replay →