SWE-bench Verified: our router returns to Sol on easy tasks, keeps Astra on hard ones
Easy
Mixed
Hard
Astra rollouts handed back to Sol
0%
20%
40%
60%
80%
100%
Task difficulty
Requests on Astra through the rollout
0%
20%
40%
60%
80%
100%
Position in the rollout
80%
Easy
75%
Mixed
20%
Hard
0%
20%
40%
60%
80%
100%