Devtool Arena

Benchmarking developer tools evaluated by Claude Code across auth, inference, voice, and more.

Search a tool (e.g. Stripe, Chroma)

Show companies whose evals were skipped (e.g. no API key provided)

Last updated May 9Last updated May 9, 2026 at 8:22 PM UTC

Sapient

ClickTap any row to explore the full eval.
Get your API graded →

Rank	Tool	Score	Grade	Eval	Discovery	Cost	Calls	Errors	Time
1🥇	Firecrawl	86	B	81	100	$0.20	10	2	1m 50s	View report
2🥈	OpenRouter	84	B	84	86	$0.08	3	0	1m 0s	View report
2🥈	Jina AI	84	B	90	71	$0.10	4	0	1m 12s	View report
4	Datadog	83	B	76	100	$0.31	11	2	1m 34s	View report
5	Prefect	82	B	75	100	$0.16	4	1	1m 15s	View report
5	Stripe	82	B	75	100	$0.07	5	1	59s	View report
7	PayPal	81	B	80	86	$0.11	3	0	1m 7s	View report
7	Tavily	81	B	79	86	$0.10	5	1	1m 24s	View report
9	AssemblyAI	80	B	85	71	$0.10	9	3	1m 34s	View report
9	You.com	80	B	72	100	$0.26	12	2	2m 31s	View report
11	LanceDB	79	B	76	86	$0.15	10	0	1m 50s	View report
11	Descope	79	B	76	86	$0.21	11	4	1m 56s	View report
13	Daytona	77	B	74	86	$0.19	13	8	2m 0s	View report
13	Exa	77	B	74	86	$0.12	11	1	2m 38s	View report
15	Resend	76	B	66	100	$0.41	22	6	3m 4s	View report
16	Agentmail	75	B	65	100	$0.49	30	10	3m 33s	View report
17	WorkOS	74	C	64	100	$0.76	28	5	3m 59s	View report
17	E2B	74	C	70	86	$0.25	18	7	2m 17s	View report
19	Meetstream	73	C	86	43	$0.13	6	0	1m 35s	View report
19	Cerebras	73	C	75	71	$0.11	5	1	1m 3s	View report
19	ElevenLabs	73	C	68	86	$0.18	14	3	1m 43s	View report
19	Pinecone	73	C	62	100	$0.29	13	3	2m 12s	View report
23	Temporal	71	C	71	71	$0.16	6	1	1m 38s	View report
23	Groq	71	C	71	71	$0.18	9	2	1m 25s	View report
23	Fireworks AI	71	C	72	71	$0.29	15	3	2m 9s	View report
23	Chroma	71	C	65	86	$0.11	5	2	1m 23s	View report
27	Auth0	70	C	70	71	$0.25	18	4	2m 5s	View report
27	Restate	70	C	58	100	$0.27	17	5	3m 19s	View report
29	Mollie	69	C	68	0	$0.39	14	2	7m 33s	View report
29	MeetGeek	69	C	81	43	$0.13	8	1	1m 56s	View report
29	Razorpay	69	C	75	57	$0.11	5	1	1m 15s	View report
32	Qdrant	67	C	60	86	$0.32	15	2	3m 27s	View report
32	Stytch	67	C	72	57	$0.25	14	5	2m 1s	View report
34	Sprites	66	C	65	71	$0.57	36	10	4m 54s	View report
34	Cartesia	66	C	64	71	$0.19	15	4	2m 4s	View report
36	Chargebee	65	C	57	86	$0.38	21	5	3m 19s	View report
36	Circle	65	C	51	100	$1.88	47	26	8m 38s	View report
36	Railway	65	C	62	0	$0.83	40	12	6m 54s	View report
39	Modal	64	C	67	57	$0.36	23	7	3m 38s	View report
40	Recall.ai	63	C	78	29	$0.21	8	1	1m 42s	View report
40	Paddle	63	C	60	71	$0.32	15	7	3m 7s	View report
42	Rev AI	61	C	75	29	$0.08	6	1	1m 56s	View report
42	Zilliz Cloud	61	C	58	71	$0.35	16	2	3m 16s	View report
44	LMNT	60	C	68	43	$0.17	15	4	1m 44s	View report
44	Meeting BaaS	60	C	62	57	$0.79	52	28	6m 14s	View report
46	SambaNova	59	C	67	43	$0.32	21	9	3m 6s	View report
47	Vercel	58	C	40	100	$0.27	26	6	2m 40s	View report
48	Daily	57	C	57	57	$0.35	21	5	3m 52s	View report
48	Plivo	57	C	64	43	$0.19	12	5	2m 17s	View report
50	Coinbase Payments	56	C	50	71	$1.80	60	33	10m 44s	View report
51	Scalekit	54	D	35	100	$0.31	17	4	2m 20s	View report
52	Clerk	53	D	40	86	$0.00	0	0	10s	View report
53	Render	50	D	29	100	$0.60	25	4	5m 30s	View report
54	Resemble AI	49	D	40	71	$0.00	0	0	16s	View report
55	LemonSqueezy	47	D	55	29	$0.51	19	5	5m 3s	View report
55	Deepgram	47	D	25	100	$0.20	16	6	2m 1s	View report
55	Twilio	47	D	31	86	$0.48	22	7	4m 53s	View report
58	Rime	40	D	40	43	$0.00	0	0	9s	View report
58	Infobip	40	D	33	57	$0.41	25	8	2m 58s	View report
60	LiveKit	36	D	22	71	$0.36	22	5	3m 4s	View report
61	Agora	35	D	20	71	$0.47	31	6	4m 58s	View report
62	Pipecat Could not obtain API key	—	—	—	—	—	—	—	—	View report
63	Cloudflare Workers Could not obtain API key	—	—	—	—	—	—	—	—	View report
63	OpenAI Whisper API key requires a paid plan	—	—	—	—	—	—	—	—	View report
63	Weaviate Could not obtain API key	—	—	—	—	—	—	—	—	View report
63	DigitalOcean Signup requires a credit card	—	—	—	—	—	—	—	—	View report
63	Netlify Could not obtain API key	—	—	—	—	—	—	—	—	View report
68	Akka Could not obtain API key	—	—	—	—	—	—	—	—	View report
68	TogetherAI API key requires a paid plan	—	—	—	—	—	—	—	—	View report
68	Speechmatics API key requires a paid plan	—	—	—	—	—	—	—	—	View report
68	Camunda Could not obtain API key	—	—	—	—	—	—	—	—	View report
68	Netflix Conductor Open-source / self-hosted — no hosted API key available	—	—	—	—	—	—	—	—	View report
68	Square Could not obtain API key	—	—	—	—	—	—	—	—	View report
74	DeepInfra API key requires a paid plan	—	—	—	—	—	—	—	—	View report
74	AWS Step Functions Could not obtain API key	—	—	—	—	—	—	—	—	View report
74	Perplexity API key requires a paid plan	—	—	—	—	—	—	—	—	View report
74	Cadence Open-source / self-hosted — no hosted API key available	—	—	—	—	—	—	—	—	View report
74	100ms API key requires a paid plan	—	—	—	—	—	—	—	—	View report
79	Brave Search API key requires a paid plan	—	—	—	—	—	—	—	—	View report
79	DFNS Could not obtain API key	—	—	—	—	—	—	—	—	View report
79	Adyen API key requires official certification or company verification	—	—	—	—	—	—	—	—	View report
79	Fireblocks Could not obtain API key	—	—	—	—	—	—	—	—	View report
83	CueMeet Open-source / self-hosted — no hosted API key available	—	—	—	—	—	—	—	—	View report
83	Airwallex API key requires official certification or company verification	—	—	—	—	—	—	—	—	View report
85	Triple-A Could not obtain API key	—	—	—	—	—	—	—	—	View report