Devtool Arena Changelog
All notable changes to the Devtool Arena leaderboard are documented here.
April 5, 2026
Added 2 new categories to cover APIs that didn't fit existing buckets, along with Datadog and Agentmail.
New Categories
- Observability — Monitoring, metrics, and event tracking APIs
- Email — Programmatic email inbox and messaging APIs
New Companies
| Company | Category | Description | Score | Grade | Overall Rank | Category Rank |
|---|---|---|---|---|---|---|
| Datadog | Observability | Python SDK for submitting custom metrics and events | 83% | B | #3 of 72 | #1 of 1 |
| Agentmail | Programmatic email inboxes, send/receive, and AI agent email | 75% | B | #17 of 72 | #1 of 1 |
Top 10 Overall
| Rank | Company | Category | Score | Grade |
|---|---|---|---|---|
| 1 | Firecrawl | Search | 86% | B |
| 2 | Jina AI | Search | 84% | B |
| 3NEW | Datadog | Observability | 83% | B |
| 4▼1 | Auth0 | Auth | 82% | B |
| 4▼1 | Prefect | Durable Workflow | 82% | B |
| 4▼1 | Stripe | Payment | 82% | B |
| 7▼1 | Tavily | Search | 81% | B |
| 7▼1 | PayPal | Payment | 81% | B |
| 9▼1 | You.com | Search | 80% | B |
| 9▼1 | ElevenLabs | Voice | 80% | B |
March 2026
Launched the Devtool Arena leaderboard with 11 categories and 72 API companies scored.
Initial Launch
- Inference — Groq, TogetherAI, Perplexity, OpenRouter, Cerebras, Fireworks AI, DeepInfra, SambaNova
- Auth — Clerk, Auth0, Stytch, Scalekit, WorkOS, Descope
- Payment — Stripe, PayPal, Square, Adyen, Razorpay, Mollie, Paddle, Chargebee, LemonSqueezy, Airwallex
- Search — Exa, Tavily, You.com, Brave Search, Firecrawl, Jina AI
- Voice — ElevenLabs, LiveKit, Deepgram, AssemblyAI, OpenAI Whisper, Rime
- Sandboxes — Vercel, Cloudflare Workers, E2B, Daytona, Modal, Fly.io
- Vector Databases — Chroma, Pinecone, Weaviate, Qdrant, LanceDB, Zilliz Cloud
- Stablecoin — Stripe (Crypto), Coinbase Payments, Circle, Fireblocks, DFNS, Triple-A
- Meeting Bot — Recall.ai, Meeting BaaS, MeetGeek, Meetstream, CueMeet
- Durable Workflow — Temporal, Prefect, Cadence, Camunda, Netflix Conductor, AWS Step Functions, Akka
- Cloud Hosting — Vercel, Cloudflare, Netlify, Railway, Render, DigitalOcean
Join the mailing list
Get updates on leaderboard changes, new benchmark releases, and product announcements.