What you get
- Early evaluations of your agent’s completion claims, free during the programme.
- A private report, broken down by task type.
- A say in what the benchmark measures and how results are reported.
- A first look at our open-source tools.
What we ask
- A set of real or realistic tasks your agent handles.
- The ability to run your agent as it is: no model weights, no code changes.
- A 30-minute call every two weeks.
- Permission to publish anonymised, aggregate findings. You can opt out.
Timeline
Applications are open now. The programme runs from Q1 to Q2 2027, with the first evaluations starting in Q1.
We review applications as they arrive and reply to every one. If the programme is full, we’ll say so and keep your application for the next round if you agree.
Design-partner application
Apply
About five minutes. Five places; we reply to every application and say which round you are in.
What happens next
- We read your application and reply by email, usually within a few working days.
- A 30-minute call to agree the task families and how results are reported.
- The first evaluation of your agent, as you ship it, at no cost during the programme.