Devtool Arena

Benchmarking the best developer tools for AI coding agents across auth, inference, voice, and more.

Search a tool (e.g. Stripe, Chroma)

Show companies whose evals were skipped (e.g. no API key provided)

Last updated Apr 17Last updated April 17, 2026 at 9:52 AM UTC

Sapient

ClickTap any row to explore the full eval.
Get your API graded →

Rank	Tool	Score	Grade	Eval	Discovery	Cost	Calls	Errors	Time
1🥇	Firecrawl	86	B	81	100	$0.20	10	2	1m 50s	View report
2🥈	Jina AI	84	B	90	71	$0.10	4	0	1m 12s	View report
3🥉	Datadog	83	B	76	100	$0.31	11	2	1m 34s	View report
4	Prefect	82	B	75	100	$0.16	4	1	1m 15s	View report
4	Auth0	82	B	81	86	$0.12	8	1	1m 57s	View report
4	Stripe	82	B	75	100	$0.07	5	1	59s	View report
7	Tavily	81	B	79	86	$0.10	5	1	1m 24s	View report
7	PayPal	81	B	80	86	$0.11	3	0	1m 7s	View report
9	ElevenLabs	80	B	72	100	$0.31	15	3	2m 15s	View report
9	You.com	80	B	72	100	$0.26	12	2	2m 31s	View report
11	Scalekit	79	B	70	100	$0.33	16	2	2m 28s	View report
11	LanceDB	79	B	76	86	$0.15	10	0	1m 50s	View report
11	Descope	79	B	76	86	$0.21	11	4	1m 56s	View report
14	Daytona	77	B	74	86	$0.19	13	8	2m 0s	View report
14	Exa	77	B	74	86	$0.12	11	1	2m 38s	View report
16	Resend	76	B	66	100	$0.41	22	6	3m 4s	View report
17	OpenRouter	75	B	84	57	$0.08	3	0	1m 0s	View report
17	Agentmail	75	B	65	100	$0.49	30	10	3m 33s	View report
19	WorkOS	74	C	64	100	$0.76	28	5	3m 59s	View report
19	Cartesia	74	C	76	71	$0.20	13	5	1m 59s	View report
19	E2B	74	C	70	86	$0.25	18	7	2m 17s	View report
22	Meetstream	73	C	86	43	$0.13	6	0	1m 35s	View report
22	Cerebras	73	C	75	71	$0.11	5	1	1m 3s	View report
22	Pinecone	73	C	62	100	$0.29	13	3	2m 12s	View report
25	LiveKit	72	C	67	86	$0.56	18	2	3m 38s	View report
26	Temporal	71	C	71	71	$0.16	6	1	1m 38s	View report
26	Groq	71	C	71	71	$0.18	9	2	1m 25s	View report
26	Fireworks AI	71	C	72	71	$0.29	15	3	2m 9s	View report
26	Chroma	71	C	65	86	$0.11	5	2	1m 23s	View report
30	Mollie	69	C	68	0	$0.39	14	2	7m 33s	View report
30	MeetGeek	69	C	81	43	$0.13	8	1	1m 56s	View report
30	Deepgram	69	C	69	71	$0.42	20	8	2m 39s	View report
30	Razorpay	69	C	75	57	$0.11	5	1	1m 15s	View report
34	Rime	68	C	86	29	$0.12	6	0	1m 11s	View report
35	Qdrant	67	C	60	86	$0.32	15	2	3m 27s	View report
36	AssemblyAI	66	C	65	71	$0.53	40	11	3m 27s	View report
36	Sprites	66	C	65	71	$0.57	36	10	4m 54s	View report
38	Chargebee	65	C	57	86	$0.38	21	5	3m 19s	View report
38	Circle	65	C	51	100	$1.88	47	26	8m 38s	View report
38	Railway	65	C	62	0	$0.83	40	12	6m 54s	View report
41	Modal	64	C	67	57	$0.36	23	7	3m 38s	View report
42	Recall.ai	63	C	78	29	$0.21	8	1	1m 42s	View report
42	Paddle	63	C	60	71	$0.32	15	7	3m 7s	View report
44	Clerk	61	C	63	57	$0.51	36	11	5m 52s	View report
44	Zilliz Cloud	61	C	58	71	$0.35	16	2	3m 16s	View report
46	Meeting BaaS	60	C	62	57	$0.79	52	28	6m 14s	View report
47	SambaNova	59	C	67	43	$0.32	21	9	3m 6s	View report
48	Vercel	58	C	40	100	$0.27	26	6	2m 40s	View report
49	Stytch	57	C	64	43	$0.18	11	3	2m 22s	View report
50	Coinbase Payments	56	C	50	71	$1.80	60	33	10m 44s	View report
51	Render	50	D	29	100	$0.60	25	4	5m 30s	View report
52	LemonSqueezy	47	D	55	29	$0.51	19	5	5m 3s	View report
53	Cloudflare Workers Could not obtain API key	—	—	—	—	—	—	—	—	View report
53	OpenAI Whisper API key requires a paid plan	—	—	—	—	—	—	—	—	View report
53	DigitalOcean Signup requires a credit card	—	—	—	—	—	—	—	—	View report
53	Netlify Could not obtain API key	—	—	—	—	—	—	—	—	View report
53	Weaviate Could not obtain API key	—	—	—	—	—	—	—	—	View report
58	Akka Could not obtain API key	—	—	—	—	—	—	—	—	View report
58	TogetherAI API key requires a paid plan	—	—	—	—	—	—	—	—	View report
58	Camunda Could not obtain API key	—	—	—	—	—	—	—	—	View report
58	Netflix Conductor Open-source / self-hosted — no hosted API key available	—	—	—	—	—	—	—	—	View report
58	Square Could not obtain API key	—	—	—	—	—	—	—	—	View report
63	DeepInfra API key requires a paid plan	—	—	—	—	—	—	—	—	View report
63	Cadence Open-source / self-hosted — no hosted API key available	—	—	—	—	—	—	—	—	View report
63	AWS Step Functions Could not obtain API key	—	—	—	—	—	—	—	—	View report
63	Perplexity API key requires a paid plan	—	—	—	—	—	—	—	—	View report
67	DFNS Could not obtain API key	—	—	—	—	—	—	—	—	View report
67	Adyen API key requires official certification or company verification	—	—	—	—	—	—	—	—	View report
67	Brave Search API key requires a paid plan	—	—	—	—	—	—	—	—	View report
67	Fireblocks Could not obtain API key	—	—	—	—	—	—	—	—	View report
71	CueMeet Open-source / self-hosted — no hosted API key available	—	—	—	—	—	—	—	—	View report
71	Airwallex API key requires official certification or company verification	—	—	—	—	—	—	—	—	View report
73	Triple-A Could not obtain API key	—	—	—	—	—	—	—	—	View report