Best LLMs for Hard Prompts (Text) - ranked by Elo & price

Find your model. Switch when a better one ships.

LMArena rankings joined with live provider pricing. Pick a subset and category, or click any model for the full deep-dive.

Last refresh: 6/3/2026, 4:07:20 AM (11,177 rows)

Available only

All models (148) · Text · Hard Prompts

Rank = arena overall rank. Muted rows aren't hosted on OpenRouter or a partner. Gaps in the rank sequence are closed-source or unreleased models we don't track.

Rank	Model	Elo	Value	In / 1M	Output	Votes	Open in
#1	Anthropic: Claude Opus 4.6 (thinking) claude-opus-4-6-thinking #1·Elo 1533·In $5.00·Out $25.00	1533	1438	$5.00	$25.00	20,448	O
#2	Anthropic: Claude Opus 4.6 claude-opus-4-6 #2·Elo 1529·In $5.00·Out $25.00	1529	1433	$5.00	$25.00	22,297	O
#3	Anthropic: Claude Opus 4.7 (thinking) claude-opus-4-7-thinking #3·Elo 1524·In $5.00·Out $25.00	1524	1429	$5.00	$25.00	12,966	O
#4	Anthropic: Claude Opus 4.7 claude-opus-4-7 #4·Elo 1517·In $5.00·Out $25.00	1517	1422	$5.00	$25.00	13,563	O
#5	Google: Gemini 3.1 Pro Preview gemini-3.1-pro-preview #5·Elo 1509·In $2.00·Out $12.00	1509	1449	$2.00	$12.00	26,732	O
#8	OpenAI: GPT-5.4 (high) gpt-5.4-high #8·Elo 1503·In $2.50·Out $15.00	1503	1433	$2.50	$15.00	17,428	O
#9	Anthropic: Claude Sonnet 4.6 claude-sonnet-4-6 #9·Elo 1501·In $3.00·Out $15.00	1501	1428	$3.00	$15.00	16,911	O
#10	OpenAI: GPT-5.5 (high) gpt-5.5-high #10·Elo 1500·In $5.00·Out $30.00	1500	1400	$5.00	$30.00	10,459	O
#11	Anthropic: Claude Opus 4.5 (thinking-32k) claude-opus-4-5-20251101-thinking-32k #11·Elo 1499·In $5.00·Out $25.00	1499	1404	$5.00	$25.00	19,787	O
#12	Z.ai: GLM 5.1 glm-5.1 #12·Elo 1499·In $0.980·Out $3.08	1499	1484	$0.980	$3.08	8,788	O
#13	Anthropic: Claude Opus 4.5 claude-opus-4-5-20251101 #13·Elo 1498·In $5.00·Out $25.00	1498	1402	$5.00	$25.00	37,926	O
#14	OpenAI: GPT-5.2 Chat gpt-5.2-chat-latest-20260210 #14·Elo 1497·In $1.75·Out $14.00	1497	1435	$1.75	$14.00	19,903	O
#15	Qwen: Qwen3.7 Max qwen3.7-max-preview #15·Elo 1495·In $1.25·Out $3.75	1495	1471	$1.25	$3.75	2,558	O
#16	Xiaomi: MiMo-V2.5-Pro mimo-v2.5-pro #16·Elo 1495·In $0.435·Out $0.870	1495	1523	$0.435	$0.870	10,143	O
#17	OpenAI: GPT-5.5 gpt-5.5 #17·Elo 1494·In $5.00·Out $30.00	1494	1394	$5.00	$30.00	10,924	O
#18	Google: Gemini 3.5 Flash gemini-3.5-flash #18·Elo 1494·In $1.50·Out $9.00	1494	1446	$1.50	$9.00	5,907	O
#20	Google: Gemini 3 Flash Preview gemini-3-flash #20·Elo 1492·In $0.500·Out $3.00	1492	1492	$0.500	$3.00	16,571	O
#21	OpenAI: GPT-5.4 gpt-5.4 #21·Elo 1492·In $2.50·Out $15.00	1492	1422	$2.50	$15.00	18,711	O
#26	MoonshotAI: Kimi K2.6 kimi-k2.6 #26·Elo 1488·In $0.684·Out $3.42	1488	1479	$0.684	$3.42	10,015	O
#26	MoonshotAI: Kimi K2.6 (free) kimi-k2.6 #26·Elo 1488·Out -	1488	-	-	-	10,015	O
#27	Anthropic: Claude Sonnet 4.5 (thinking-32k) claude-sonnet-4-5-20250929-thinking-32k #27·Elo 1486·In $3.00·Out $15.00	1486	1413	$3.00	$15.00	43,559	O
#29	Anthropic: Claude Sonnet 4.5 claude-sonnet-4-5-20250929 #29·Elo 1483·In $3.00·Out $15.00	1483	1410	$3.00	$15.00	43,125	O
#32	Qwen: Qwen3.6 Max Preview qwen3.6-max-preview #32·Elo 1479·In $1.04·Out $6.24	1479	1448	$1.04	$6.24	2,939	O
#33	DeepSeek: DeepSeek V4 Pro (thinking) deepseek-v4-pro-thinking #33·Elo 1478·In $0.435·Out $0.870	1478	1506	$0.435	$0.870	10,401	O
#34	Z.ai: GLM 5 glm-5 #34·Elo 1478·In $0.600·Out $2.08	1478	1483	$0.600	$2.08	13,017	O
#36	Google: Gemini 3 Flash Preview (thinking-minimal) gemini-3-flash (thinking-minimal) #36·Elo 1478·In $0.500·Out $3.00	1478	1478	$0.500	$3.00	31,426	O
#37	Anthropic: Claude Opus 4.1 claude-opus-4-1-20250805 #37·Elo 1477·In $15.00·Out $75.00	1477	1334	$15.00	$75.00	38,916	O
#39	DeepSeek: DeepSeek V4 Pro deepseek-v4-pro #39·Elo 1475·In $0.435·Out $0.870	1475	1503	$0.435	$0.870	10,940	O
#40	OpenAI: GPT-5.1 (high) gpt-5.1-high #40·Elo 1474·In $1.25·Out $10.00	1474	1427	$1.25	$10.00	21,751	O
#43	OpenAI: GPT-5.4 Mini (high) gpt-5.4-mini-high #43·Elo 1474·In $0.750·Out $4.50	1474	1456	$0.750	$4.50	16,739	O
#44	OpenAI: GPT-5.3 Chat gpt-5.3-chat-latest #44·Elo 1472·In $1.75·Out $14.00	1472	1409	$1.75	$14.00	18,848	O
#45	MoonshotAI: Kimi K2.5 (thinking) kimi-k2.5-thinking #45·Elo 1471·In $0.400·Out $1.90	1471	1487	$0.400	$1.90	22,044	O
#46	Qwen: Qwen3.6 Plus qwen3.6-plus #46·Elo 1466·In $0.325·Out $1.95	1466	1485	$0.325	$1.95	11,934	O
#48	Qwen: Qwen3.5 397B A17B qwen3.5-397b-a17b #48·Elo 1465·In $0.390·Out $2.34	1465	1476	$0.390	$2.34	19,679	O
#49	Xiaomi: MiMo-V2.5 mimo-v2.5 #49·Elo 1464·In $0.140·Out $0.280	1464	1541	$0.140	$0.280	10,546	O
#51	Z.ai: GLM 4.7 glm-4.7 #51·Elo 1463·In $0.400·Out $1.75	1463	1480	$0.400	$1.75	6,608	O
#54	OpenAI: GPT-5.2 (high) gpt-5.2-high #54·Elo 1461·In $1.75·Out $14.00	1461	1398	$1.75	$14.00	27,018	O
#55	OpenAI: GPT-5.2 gpt-5.2 #55·Elo 1460·In $1.75·Out $14.00	1460	1397	$1.75	$14.00	27,760	O
#58	xAI: Grok 4.3 grok-4.3 #58·Elo 1459·In $1.25·Out $2.50	1459	1441	$1.25	$2.50	10,268	O
#59	Google: Gemini 2.5 Pro gemini-2.5-pro #59·Elo 1458·In $1.25·Out $10.00	1458	1411	$1.25	$10.00	63,005	O
#59	Google: Gemini 2.5 Pro Preview 06-05 gemini-2.5-pro #59·Elo 1458·In $1.25·Out $10.00	1458	1411	$1.25	$10.00	63,005	O
#60	DeepSeek: DeepSeek V4 Flash (thinking) deepseek-v4-flash-thinking #60·Elo 1457·In $0.098·Out $0.197	1457	1550	$0.098	$0.197	10,742	O
#63	DeepSeek: DeepSeek V4 Flash deepseek-v4-flash #63·Elo 1456·In $0.098·Out $0.197	1456	1548	$0.098	$0.197	10,901	O
#64	OpenAI: GPT-5.1 gpt-5.1 #64·Elo 1455·In $1.25·Out $10.00	1455	1408	$1.25	$10.00	23,606	O
#67	OpenAI: GPT-5 Chat gpt-5-chat #67·Elo 1449·In $1.25·Out $10.00	1449	1401	$1.25	$10.00	15,220	O
#69	Qwen: Qwen3 Max qwen3-max-preview #69·Elo 1448·In $0.780·Out $3.90	1448	1433	$0.780	$3.90	4,871	O
#69	Qwen: Qwen3 Max Thinking qwen3-max-preview #69·Elo 1448·In $0.780·Out $3.90	1448	1433	$0.780	$3.90	4,871	O
#72	DeepSeek: DeepSeek V3.2 deepseek-v3.2 #72·Elo 1447·In $0.229·Out $0.343	1447	1507	$0.229	$0.343	25,294	O
#72	DeepSeek: DeepSeek V3.2 Exp deepseek-v3.2 #72·Elo 1447·In $0.270·Out $0.410	1447	1500	$0.270	$0.410	25,294	O
#74	OpenAI: GPT-5 (high) gpt-5-high #74·Elo 1446·In $1.25·Out $10.00	1446	1398	$1.25	$10.00	14,989	O
#75	DeepSeek: DeepSeek V3.1 Terminus (thinking) deepseek-v3.1-terminus-thinking #75·Elo 1446·In $0.270·Out $0.950	1446	1485	$0.270	$0.950	1,679	O
#76	DeepSeek: DeepSeek V3.2 (thinking) deepseek-v3.2-exp-thinking #76·Elo 1445·In $0.229·Out $0.343	1445	1505	$0.229	$0.343	21,680	O
#76	DeepSeek: DeepSeek V3.2 Exp (thinking) deepseek-v3.2-exp-thinking #76·Elo 1445·In $0.270·Out $0.410	1445	1498	$0.270	$0.410	21,680	O
#77	Google: Gemini 3.1 Flash Lite gemini-3.1-flash-lite-preview #77·Elo 1445·In $0.250·Out $1.50	1445	1475	$0.250	$1.50	21,672	O
#77	Google: Gemini 3.1 Flash Lite Preview gemini-3.1-flash-lite-preview #77·Elo 1445·In $0.250·Out $1.50	1445	1475	$0.250	$1.50	21,672	O
#78	Z.ai: GLM 4.6 glm-4.6 #78·Elo 1443·In $0.430·Out $1.74	1443	1459	$0.430	$1.74	19,087	O
#83	Qwen: Qwen3 VL 235B A22B Instruct qwen3-vl-235b-a22b-instruct #83·Elo 1440·In $0.200·Out $0.880	1440	1488	$0.200	$0.880	5,717	O
#84	OpenAI: o3 o3-2025-04-16 #84·Elo 1440·In $2.00·Out $8.00	1440	1389	$2.00	$8.00	25,759	O
#85	Anthropic: Claude Haiku 4.5 claude-haiku-4-5-20251001 #85·Elo 1439·In $1.00·Out $5.00	1439	1413	$1.00	$5.00	44,441	O
#86	MiniMax: MiniMax M2.7 minimax-m2.7 #86·Elo 1438·In $0.279·Out $1.20	1438	1472	$0.279	$1.20	14,569	O
#88	MoonshotAI: Kimi K2 0905 kimi-k2-0905-preview #88·Elo 1436·In $0.600·Out $2.50	1436	1437	$0.600	$2.50	5,584	O
#89	Anthropic: Claude Opus 4 claude-opus-4-20250514 #89·Elo 1435·In $15.00·Out $75.00	1435	1292	$15.00	$75.00	19,166	O
#90	DeepSeek: R1 0528 deepseek-r1-0528 #90·Elo 1434·In $0.500·Out $2.15	1434	1442	$0.500	$2.15	6,955	O
#93	Z.ai: GLM 4.5 glm-4.5 #93·Elo 1433·In $0.600·Out $2.20	1433	1437	$0.600	$2.20	11,205	O
#95	Qwen: Qwen3.5-122B-A10B qwen3.5-122b-a10b #95·Elo 1432·In $0.260·Out $2.08	1432	1452	$0.260	$2.08	16,289	O
#97	Anthropic: Claude Sonnet 4 (thinking-32k) claude-sonnet-4-20250514-thinking-32k #97·Elo 1431·In $3.00·Out $15.00	1431	1358	$3.00	$15.00	15,621	O
#98	OpenAI: GPT-4.1 gpt-4.1-2025-04-14 #98·Elo 1431·In $2.00·Out $8.00	1431	1380	$2.00	$8.00	22,173	O
#102	Qwen: Qwen3.5-27B qwen3.5-27b #102·Elo 1427·In $0.195·Out $1.56	1427	1459	$0.195	$1.56	15,752	O
#104	DeepSeek: DeepSeek V3.1 Terminus deepseek-v3.1-terminus #104·Elo 1424·In $0.270·Out $0.950	1424	1463	$0.270	$0.950	1,929	O
#105	OpenAI: GPT-5.4 Nano (high) gpt-5.4-nano-high #105·Elo 1422·In $0.200·Out $1.25	1422	1461	$0.200	$1.25	16,238	O
#107	Qwen: Qwen3 Next 80B A3B Instruct qwen3-next-80b-a3b-instruct #107·Elo 1421·In $0.090·Out $1.10	1421	1475	$0.090	$1.10	11,901	O
#107	Qwen: Qwen3 Next 80B A3B Instruct (free) qwen3-next-80b-a3b-instruct #107·Elo 1421·Out -	1421	-	-	-	11,901	O
#110	Google: Gemini 2.5 Flash gemini-2.5-flash #110·Elo 1420·In $0.300·Out $2.50	1420	1433	$0.300	$2.50	62,144	O
#112	Qwen: Qwen3 VL 235B A22B Thinking (thinking) qwen3-vl-235b-a22b-thinking #112·Elo 1419·In $0.260·Out $2.60	1419	1433	$0.260	$2.60	4,040	O
#113	DeepSeek: R1 deepseek-r1 #113·Elo 1418·In $0.700·Out $2.50	1418	1416	$0.700	$2.50	4,116	O
#114	Qwen: Qwen3 235B A22B Thinking 2507 qwen3-235b-a22b-thinking-2507 #114·Elo 1418·In $0.100·Out $0.100	1418	1518	$0.100	$0.100	3,845	O
#116	Anthropic: Claude Sonnet 4 claude-sonnet-4-20250514 #116·Elo 1418·In $3.00·Out $15.00	1418	1344	$3.00	$15.00	17,676	O
#119	MiniMax: MiniMax M2.5 minimax-m2.5 #119·Elo 1416·In $0.150·Out $1.15	1416	1462	$0.150	$1.15	22,075	O
#120	Qwen: Qwen3.5-35B-A3B qwen3.5-35b-a3b #120·Elo 1415·In $0.140·Out $1.00	1415	1466	$0.140	$1.00	16,801	O
#121	Xiaomi: MiMo-V2-Flash (thinking, non-thinking) mimo-v2-flash (non-thinking) #121·Elo 1414·In $0.100·Out $0.300	1414	1500	$0.100	$0.300	26,280	O
#125	Xiaomi: MiMo-V2-Flash (thinking) mimo-v2-flash (thinking) #125·Elo 1413·In $0.100·Out $0.300	1413	1498	$0.100	$0.300	6,001	O
#126	StepFun: Step 3.5 Flash step-3.5-flash #126·Elo 1412·In $0.090·Out $0.300	1412	1500	$0.090	$0.300	20,403	O
#128	MiniMax: MiniMax M2.1 minimax-m2.1-preview #128·Elo 1408·In $0.290·Out $0.950	1408	1445	$0.290	$0.950	9,070	O
#129	Qwen: Qwen3 30B A3B Instruct 2507 qwen3-30b-a3b-instruct-2507 #129·Elo 1408·In $0.043·Out $0.172	1408	1524	$0.043	$0.172	11,072	O
#130	OpenAI: o4 Mini o4-mini-2025-04-16 #130·Elo 1405·In $1.10·Out $4.40	1405	1381	$1.10	$4.40	19,535	O
#130	OpenAI: o4 Mini High o4-mini-2025-04-16 #130·Elo 1405·In $1.10·Out $4.40	1405	1381	$1.10	$4.40	19,535	O
#131	OpenAI: GPT-5 Mini (high) gpt-5-mini-high #131·Elo 1403·In $0.250·Out $2.00	1403	1425	$0.250	$2.00	12,811	O
#132	Arcee AI: Trinity Large Thinking trinity-large-preview #132·Elo 1403·In $0.220·Out $0.850	1403	1449	$0.220	$0.850	17,116	O
#133	OpenAI: GPT-4.1 Mini gpt-4.1-mini-2025-04-14 #133·Elo 1402·In $0.400·Out $1.60	1402	1422	$0.400	$1.60	16,247	O
#134	OpenAI: o3 Mini (high) o3-mini-high #134·Elo 1401·In $1.10·Out $4.40	1401	1377	$1.10	$4.40	4,386	O
#134	OpenAI: o3 Mini High (high) o3-mini-high #134·Elo 1401·In $1.10·Out $4.40	1401	1377	$1.10	$4.40	4,386	O
#139	OpenAI: o1 o1-2024-12-17 #139·Elo 1396·In $15.00·Out $60.00	1396	1258	$15.00	$60.00	8,496	O
#141	Qwen: Qwen3 235B A22B qwen3-235b-a22b #141·Elo 1392·In $0.455·Out $1.82	1392	1405	$0.455	$1.82	10,494	O
#143	Z.ai: GLM 4.5 Air glm-4.5-air #143·Elo 1391·In $0.125·Out $0.850	1391	1448	$0.125	$0.850	14,883	O
#143	Z.ai: GLM 4.5 Air (free) glm-4.5-air #143·Elo 1391·Out -	1391	-	-	-	14,883	O
#145	Arcee AI: Trinity Large Thinking (thinking) trinity-large-thinking #145·Elo 1388·In $0.220·Out $0.850	1388	1434	$0.220	$0.850	15,320	O
#146	Z.ai: GLM 4.7 Flash glm-4.7-flash #146·Elo 1387·In $0.060·Out $0.400	1387	1476	$0.060	$0.400	6,518	O
#148	Qwen: Qwen3 Next 80B A3B Thinking (thinking) qwen3-next-80b-a3b-thinking #148·Elo 1385·In $0.098·Out $0.780	1385	1448	$0.098	$0.780	6,693	O
#149	Z.ai: GLM 4.6V glm-4.6v #149·Elo 1384·In $0.300·Out $0.900	1384	1421	$0.300	$0.900	1,499	O
#151	MiniMax: MiniMax M1 minimax-m1 #151·Elo 1381·In $0.400·Out $2.20	1381	1393	$0.400	$2.20	15,829	O
#155	Z.ai: GLM 4.5V glm-4.5v #155·Elo 1376·In $0.600·Out $1.80	1376	1383	$0.600	$1.80	2,391	O
#158	Prime Intellect: INTELLECT-3 intellect-3 #158·Elo 1373·In $0.200·Out $1.10	1373	1415	$0.200	$1.10	2,741	O
#160	OpenAI: o3 Mini o3-mini #160·Elo 1370·In $1.10·Out $4.40	1370	1345	$1.10	$4.40	20,111	O
#160	OpenAI: o3 Mini High o3-mini #160·Elo 1370·In $1.10·Out $4.40	1370	1345	$1.10	$4.40	20,111	O
#162	MiniMax: MiniMax M2 minimax-m2 #162·Elo 1369·In $0.255·Out $1.00	1369	1408	$0.255	$1.00	3,698	O
#165	Qwen: Qwen3 32B qwen3-32b #165·Elo 1368·In $0.080·Out $0.280	1368	1460	$0.080	$0.280	1,207	O
#167	Google: Gemma 3 27B gemma-3-27b-it #167·Elo 1365·In $0.080·Out $0.160	1365	1467	$0.080	$0.160	17,867	O
#168	OpenAI: gpt-oss-120b gpt-oss-120b #168·Elo 1362·In $0.039·Out $0.180	1362	1480	$0.039	$0.180	14,759	O
#168	OpenAI: gpt-oss-120b (free) gpt-oss-120b #168·Elo 1362·Out -	1362	-	-	-	14,759	O
#175	Inception: Mercury 2 mercury-2 #175·Elo 1359·In $0.250·Out $0.750	1359	1404	$0.250	$0.750	1,759	O
#178	OpenAI: GPT-5 Nano (high) gpt-5-nano-high #178·Elo 1354·In $0.050·Out $0.400	1354	1446	$0.050	$0.400	3,813	O
#186	Qwen: Qwen3 30B A3B qwen3-30b-a3b #186·Elo 1345·In $0.090·Out $0.450	1345	1424	$0.090	$0.450	10,694	O
#187	Anthropic: Claude 3.5 Haiku claude-3-5-haiku-20241022 #187·Elo 1344·In $0.800·Out $4.00	1344	1328	$0.800	$4.00	23,779	O
#197	OpenAI: GPT-4.1 Nano gpt-4.1-nano-2025-04-14 #197·Elo 1333·In $0.100·Out $0.400	1333	1412	$0.100	$0.400	1,669	O
#199	Google: Gemma 3 12B gemma-3-12b-it #199·Elo 1332·In $0.040·Out $0.130	1332	1455	$0.040	$0.130	977	O
#200	IBM: Granite 4.1 8B granite-4.1-8b #200·Elo 1331·In $0.050·Out $0.100	1331	1454	$0.050	$0.100	2,300	O
#206	AllenAI: Olmo 3 32B Think olmo-3-32b-think #206·Elo 1328·In $0.150·Out $0.500	1328	1393	$0.150	$0.500	3,024	O
#208	OpenAI: GPT-4o gpt-4o-2024-05-13 #208·Elo 1327·In $2.50·Out $10.00	1327	1266	$2.50	$10.00	12,655	O
#208	OpenAI: GPT-4o (2024-05-13) gpt-4o-2024-05-13 #208·Elo 1327·In $5.00·Out $15.00	1327	1242	$5.00	$15.00	12,655	O
#208	OpenAI: GPT-4o (2024-08-06) gpt-4o-2024-05-13 #208·Elo 1327·In $2.50·Out $10.00	1327	1266	$2.50	$10.00	12,655	O
#208	OpenAI: GPT-4o (2024-11-20) gpt-4o-2024-05-13 #208·Elo 1327·In $2.50·Out $10.00	1327	1266	$2.50	$10.00	12,655	O
#213	OpenAI: gpt-oss-20b gpt-oss-20b #213·Elo 1323·In $0.029·Out $0.140	1323	1452	$0.029	$0.140	4,797	O
#213	OpenAI: gpt-oss-20b (free) gpt-oss-20b #213·Elo 1323·Out -	1323	-	-	-	4,797	O
#215	Meta: Llama 3.3 70B Instruct llama-3.3-70b-instruct #215·Elo 1320·In $0.100·Out $0.320	1320	1405	$0.100	$0.320	17,022	O
#215	Meta: Llama 3.3 70B Instruct (free) llama-3.3-70b-instruct #215·Elo 1320·Out -	1320	-	-	-	17,022	O
#217	Mistral Large 2407 mistral-large-2407 #217·Elo 1319·In $2.00·Out $6.00	1319	1275	$2.00	$6.00	12,682	O
#222	OpenAI: GPT-4 Turbo gpt-4-turbo-2024-04-09 #222·Elo 1316·In $10.00·Out $30.00	1316	1201	$10.00	$30.00	28,310	O
#222	OpenAI: GPT-4 Turbo Preview gpt-4-turbo-2024-04-09 #222·Elo 1316·In $10.00·Out $30.00	1316	1201	$10.00	$30.00	28,310	O
#224	Google: Gemma 3n 4B gemma-3n-e4b-it #224·Elo 1313·In $0.060·Out $0.120	1313	1427	$0.060	$0.120	8,559	O
#226	OpenAI: GPT-4 Turbo (older v1106) gpt-4-1106-preview #226·Elo 1311·In $10.00·Out $30.00	1311	1197	$10.00	$30.00	26,242	O
#227	OpenAI: GPT-4o-mini gpt-4o-mini-2024-07-18 #227·Elo 1311·In $0.150·Out $0.600	1311	1373	$0.150	$0.600	18,259	O
#227	OpenAI: GPT-4o-mini (2024-07-18) gpt-4o-mini-2024-07-18 #227·Elo 1311·In $0.150·Out $0.600	1311	1373	$0.150	$0.600	18,259	O
#232	OpenAI: GPT-4 (older v0314) gpt-4-0314 #232·Elo 1304·In $30.00·Out $60.00	1304	1149	$30.00	$60.00	13,935	O
#239	Meta: Llama 3.1 70B Instruct llama-3.1-70b-instruct #239·Elo 1298·In $0.400·Out $0.400	1298	1338	$0.400	$0.400	14,981	O
#243	Mistral: Mistral Small 3 mistral-small-24b-instruct-2501 #243·Elo 1285·In $0.050·Out $0.080	1285	1410	$0.050	$0.080	3,569	O
#244	Google: Gemma 3 4B gemma-3-4b-it #244·Elo 1284·In $0.040·Out $0.080	1284	1416	$0.040	$0.080	1,092	O
#246	Google: Gemma 2 27B gemma-2-27b-it #246·Elo 1281·In $0.650·Out $0.650	1281	1300	$0.650	$0.650	20,494	O
#251	Meta: Llama 3 70B Instruct llama-3-70b-instruct #251·Elo 1278·In $0.510·Out $0.740	1278	1304	$0.510	$0.740	45,956	O
#252	Microsoft: Phi 4 phi-4 #252·Elo 1277·In $0.065·Out $0.140	1277	1387	$0.065	$0.140	5,747	O
#261	Anthropic: Claude 3 Haiku claude-3-haiku-20240307 #261·Elo 1264·In $0.250·Out $1.25	1264	1299	$0.250	$1.25	33,698	O
#264	Cohere: Command R+ (08-2024) command-r-plus-08-2024 #264·Elo 1260·In $2.50·Out $10.00	1260	1200	$2.50	$10.00	2,822	O
#267	Cohere: Command R (08-2024) command-r-08-2024 #267·Elo 1255·In $0.150·Out $0.600	1255	1317	$0.150	$0.600	2,976	O
#281	Google Gemini Pro Latest gemini-pro #281·Elo 1229·In $2.00·Out $12.00	1229	1168	$2.00	$12.00	1,407	O
#287	Meta: Llama 3.1 8B Instruct llama-3.1-8b-instruct #287·Elo 1222·In $0.020·Out $0.050	1222	1381	$0.020	$0.050	13,535	O
#289	Meta: Llama 3 8B Instruct llama-3-8b-instruct #289·Elo 1218·In $0.040·Out $0.040	1218	1358	$0.040	$0.040	30,221	O
#313	Meta: Llama 3.2 3B Instruct llama-3.2-3b-instruct #313·Elo 1167·In $0.051·Out $0.335	1167	1264	$0.051	$0.335	2,216	O
#313	Meta: Llama 3.2 3B Instruct (free) llama-3.2-3b-instruct #313·Elo 1167·Out -	1167	-	-	-	2,216	O
#338	Meta: Llama 3.2 1B Instruct llama-3.2-1b-instruct #338·Elo 1113·In $0.027·Out $0.201	1113	1234	$0.027	$0.201	2,247	O