Artifacts

What each model built on each task, shown on the held-out cases it was graded on.

Drawing to CAD

Each model wrote a program that turns undimensioned multi-view drawings of machined parts into CadQuery solids; each output is drawn against the true solid. Hidden test parts are the ones the reward is computed on (six shown, for each model's best and median attempt); public dev parts cover every attempt, but agents could test on them, so they are not graded.

View the task: Drawing to CAD →