Evaluations
Evaluation queue
The products we have selected to evaluate, and the honest status of each. This is a queue, not a leaderboard.
All products in the queue
9 products, alphabetical.
Product list
- Anthropic · Coding & developmentPlannedNo evidence record publishedCriteria for Claude Code
- Anysphere · Coding & developmentPlannedNo evidence record publishedCriteria for Cursor
- ElevenLabs · Speech & audioPlannedNo evidence record publishedCriteria for ElevenLabs
- Google · Coding & developmentPlannedNo evidence record publishedCriteria for Gemini Code Assist
- GitHub · Coding & developmentPlannedNo evidence record publishedCriteria for GitHub Copilot
- Google · Research & knowledgePlannedNo evidence record publishedCriteria for NotebookLM
- Notion · Writing & productivityPlannedNo evidence record publishedCriteria for Notion AI
- OpenAI · Coding & developmentPlannedNo evidence record publishedCriteria for OpenAI Codex
- Runway · Image & videoPlannedNo evidence record publishedCriteria for Runway
What each status means
Status definitions
- Planned
- Planned
Selected for evaluation. No testing has started and no evidence is published.
- Research in progress
- Research in progress
Testing or evidence gathering has started. No conclusions are published.
- Published
- Published
A completed evaluation with its evidence and protocol is available.
- Needs review
- Needs review
A published evaluation that may be out of date or is under re-check.
- Archived
- Archived
Retained for the record. No longer maintained.
Rankings
A ranking is published for a category only when at least two published, fully evidenced evaluations exist under the same methodology version (0.1.0).
Ranking status by category
| Category | Ranking |
|---|---|
| Coding & development | Not published — insufficient evidence |
| Agents & automation | Not published — insufficient evidence |
| Research & knowledge | Not published — insufficient evidence |
| Writing & productivity | Not published — insufficient evidence |
| Image & video | Not published — insufficient evidence |
| Speech & audio | Not published — insufficient evidence |
| Data & analytics | Not published — insufficient evidence |