Tasks
26 long-horizon tasks across four domains. Each has a human-written instruction, a real environment with real compute, and a deterministic verifier that scores held-out inputs.
Each scale runs from the task's baseline at 0% to its ceiling at 100%. The dot is the best model's score, the mean of its 8 attempts. Hours are the agent's limit per attempt. Select a task for its page.