Devtool Arena

Benchmarking developer tools evaluated by Codex across auth, inference, voice, and more.

Search a tool (e.g. Stripe, Chroma)

Show companies whose evals were skipped (e.g. no API key provided)

Last updated May 9Last updated May 9, 2026 at 8:44 PM UTC

Sapient

ClickTap any row to explore the full eval.
Get your API graded →

Rank	Tool	Score	Grade	Eval	Discovery	Cost	Calls	Errors	Time
1🥇	Firecrawl	92	A	96	86	$0.06	6	0	49s	View report
2🥈	Tavily	90	A	87	100	$0.10	8	1	58s	View report
3🥉	Datadog	88	B	84	100	$0.05	4	0	1m 5s	View report
4	Stripe	86	B	80	100	$0.06	6	0	1m 13s	View report
5	OpenRouter	84	B	84	86	$0.07	5	0	1m 8s	View report
5	ElevenLabs	84	B	78	100	$0.19	17	0	2m 55s	View report
7	Mollie	79	B	83	71	$0.18	13	0	1m 8s	View report
7	AssemblyAI	79	B	70	100	$0.26	12	3	3m 38s	View report
7	Daytona	79	B	70	100	$0.28	14	6	4m 53s	View report
10	Fireworks AI	78	B	75	86	$0.22	15	0	3m 14s	View report
11	E2B	77	B	68	100	$0.24	17	4	3m 4s	View report
12	Pinecone	76	B	67	100	$0.38	23	2	4m 50s	View report
13	SambaNova	75	B	83	57	$0.15	11	0	1m 25s	View report
13	Cerebras	75	B	78	71	$0.18	13	2	1m 57s	View report
13	You.com	75	B	71	86	$0.15	10	1	1m 57s	View report
13	Jina AI	75	B	71	86	$0.14	10	1	1m 30s	View report
17	Auth0	74	C	63	100	$0.57	37	4	5m 5s	View report
17	Prefect	74	C	70	86	$0.40	15	7	4m 12s	View report
17	LMNT	74	C	82	57	$0.19	16	0	1m 43s	View report
17	Deepgram	74	C	63	100	$0.15	6	1	5m 38s	View report
17	Resend	74	C	63	100	$0.67	37	10	7m 32s	View report
22	WorkOS	73	C	68	86	$0.32	27	4	2m 1s	View report
22	PayPal	73	C	75	71	$0.27	18	0	2m 6s	View report
24	Scalekit	72	C	61	100	$1.35	47	11	8m 32s	View report
24	Agentmail	72	C	61	100	$0.89	41	8	18m 13s	View report
24	Razorpay	72	C	73	71	$0.32	21	4	1m 43s	View report
27	Meeting BaaS	71	C	72	71	$0.22	15	3	2m 23s	View report
27	Cartesia	71	C	71	71	$0.40	24	0	6m 33s	View report
29	Temporal	70	C	76	57	$0.20	14	2	1m 44s	View report
29	Modal	70	C	70	71	$0.20	16	1	2m 21s	View report
31	Descope	69	C	63	86	$0.26	25	9	1m 41s	View report
31	Twilio	69	C	62	86	$0.61	41	8	10m 15s	View report
33	Recall.ai	68	C	68	71	$0.31	18	1	3m 15s	View report
34	Chroma	67	C	60	86	$0.30	15	3	4m 40s	View report
34	Zilliz Cloud	67	C	60	86	$1.12	62	4	12m 0s	View report
36	Groq	66	C	80	0	$0.09	9	0	1m 17s	View report
36	Clerk	66	C	65	71	$0.59	47	3	4m 23s	View report
36	Exa	66	C	64	71	$0.19	13	2	2m 13s	View report
39	Chargebee	64	C	62	71	$0.77	44	5	8m 11s	View report
39	Rime	64	C	79	29	$0.17	13	0	2m 26s	View report
41	Meetstream	63	C	66	57	$0.29	26	4	4m 16s	View report
42	Stytch	59	C	60	57	$1.12	50	11	20m 54s	View report
43	Railway	56	C	50	71	$1.15	51	3	17m 41s	View report
44	Plivo	55	C	61	43	$0.92	49	13	18m 0s	View report
45	MeetGeek	54	D	60	43	$2.04	91	2	32m 48s	View report
46	LemonSqueezy	52	D	62	29	$0.91	47	4	9m 55s	View report
47	Rev AI	49	D	58	29	$0.27	12	5	5m 46s	View report
48	Vercel	47	D	25	100	$1.36	59	15	21m 2s	View report
49	Daily	44	D	33	71	$0.30	15	0	5m 0s	View report
49	Resemble AI	44	D	26	86	$0.63	25	2	4m 51s	View report
51	Render	43	D	25	86	$1.42	56	1	20m 21s	View report
51	Circle	43	D	25	86	$2.78	129	33	43m 21s	View report
51	Coinbase Payments	43	D	25	86	$1.40	55	14	17m 6s	View report
54	Paddle	38	D	30	57	$0.45	30	2	3m 43s	View report
55	LiveKit	37	D	23	71	$0.31	11	4	6m 29s	View report
56	Qdrant	36	D	22	71	$0.29	17	2	6m 9s	View report
56	LanceDB	36	D	22	71	$0.37	18	3	6m 42s	View report
58	Agora	24	D	11	57	$0.96	28	10	11m 56s	View report
59	TogetherAI API key requires a paid plan	—	—	—	—	—	—	—	—	View report
59	Telnyx Could not obtain API key	—	—	—	—	—	—	—	—	View report
59	Netlify Could not obtain API key	—	—	—	—	—	—	—	—	View report
62	Pipecat Could not obtain API key	—	—	—	—	—	—	—	—	View report
62	Camunda Could not obtain API key	—	—	—	—	—	—	—	—	View report
62	Weaviate Could not obtain API key	—	—	—	—	—	—	—	—	View report
62	Fireblocks Could not obtain API key	—	—	—	—	—	—	—	—	View report
62	Sinch Could not obtain API key	—	—	—	—	—	—	—	—	View report
62	Vonage Could not obtain API key	—	—	—	—	—	—	—	—	View report
68	DeepInfra API key requires a paid plan	—	—	—	—	—	—	—	—	View report
68	AWS Step Functions Could not obtain API key	—	—	—	—	—	—	—	—	View report
68	Akka Could not obtain API key	—	—	—	—	—	—	—	—	View report
68	Cloudflare Workers Could not obtain API key	—	—	—	—	—	—	—	—	View report
68	OpenAI Whisper API key requires a paid plan	—	—	—	—	—	—	—	—	View report
68	Adyen API key requires official certification or company verification	—	—	—	—	—	—	—	—	View report
68	Bandwidth Could not obtain API key	—	—	—	—	—	—	—	—	View report
68	Speechmatics API key requires a paid plan	—	—	—	—	—	—	—	—	View report
68	Netflix Conductor Open-source / self-hosted — no hosted API key available	—	—	—	—	—	—	—	—	View report
68	DigitalOcean Signup requires a credit card	—	—	—	—	—	—	—	—	View report
68	Square Could not obtain API key	—	—	—	—	—	—	—	—	View report
79	DFNS Could not obtain API key	—	—	—	—	—	—	—	—	View report
79	Sprites Could not obtain API key	—	—	—	—	—	—	—	—	View report
79	100ms API key requires a paid plan	—	—	—	—	—	—	—	—	View report
79	Airwallex API key requires official certification or company verification	—	—	—	—	—	—	—	—	View report
83	Brave Search API key requires a paid plan	—	—	—	—	—	—	—	—	View report
83	Cadence Open-source / self-hosted — no hosted API key available	—	—	—	—	—	—	—	—	View report
83	Infobip Could not obtain API key	—	—	—	—	—	—	—	—	View report
86	Perplexity API key requires a paid plan	—	—	—	—	—	—	—	—	View report
87	Triple-A Could not obtain API key	—	—	—	—	—	—	—	—	View report
87	CueMeet Open-source / self-hosted — no hosted API key available	—	—	—	—	—	—	—	—	View report