gpt·basedElo-ranked, value-sorted
Sign in

Stay updated

Get an email when a cheaper, stronger model than yours appears on the leaderboard. No spam.

gpt·based

The LLM leaderboard that tells you when to switch. Arena rankings joined with OpenRouter pricing, refreshed daily.

Use cases

  • Best for coding
  • Best for multilingual
  • Cheapest worth using
  • Compare two models

Browse

  • Text models
  • WebDev models
  • Vision models
  • Image generation
  • Image edit

Data sources

  • LMArena
  • Providers

Developers

  • API on RapidAPI
  • OpenAPI spec

Contact

  • Contact page
  • [email protected]
© 2026 gptbasedDaily refresh, never paid placement.
    gpt·basedElo-ranked, value-sorted
    Sign in

    Find your model. Switch when a better one ships.

    LMArena rankings joined with live provider pricing. Pick a subset and category, or click any model for the full deep-dive.

    Last refresh: 6/3/2026, 4:07:20 AM (11,177 rows)

    Category

    How cheap can you go?

    Set a minimum Elo below, then sort by Output to find the cheapest model at your quality bar.

    any128
    Top Pick
    Google: Gemini 3.1 Pro Preview

    Highest Elo in Text · Korean

    #1Elo 1474
    Input / 1M
    $2.00
    Output / 1M
    $12.00
    Blended (4:1 in:out): $4.00/1M
    Try it on:
    OOpenRouter
    Set alert
    Best Value
    Xiaomi: MiMo-V2.5-Pro

    Pareto knee · $0.522/1M blended

    #2Elo 1474
    Input / 1M
    $0.435
    Output / 1M
    $0.870
    Blended (4:1 in:out): $0.522/1M
    Try it on:
    OOpenRouter
    Set alert
    Recommended
    Qwen: Qwen3 235B A22B Thinking 2507

    Frontier middle pick · $0.100/1M blended

    #100Elo 1348
    Input / 1M
    $0.100
    Output / 1M
    $0.100
    Blended (4:1 in:out): $0.100/1M
    Try it on:
    OOpenRouter
    Set alert

    All models (128) · Text · Korean

    Rank = arena overall rank. Muted rows aren't hosted on OpenRouter or a partner. Gaps in the rank sequence are closed-source or unreleased models we don't track.

    RankModelTrendEloValueIn / 1MOutputVotesOpen in
    #1
    Google: Gemini 3.1 Pro Preview
    gemini-3.1-pro-preview
    #1·Elo 1474·In $2.00·Out $12.00
    14741414$2.00$12.00795
    O
    #2
    Xiaomi: MiMo-V2.5-Pro
    mimo-v2.5-pro
    #2·Elo 1474·In $0.435·Out $0.870
    14741503$0.435$0.870254
    O
    #4
    Google: Gemini 3.5 Flash
    gemini-3.5-flash
    #4·Elo 1467·In $1.50·Out $9.00
    14671419$1.50$9.00192
    O
    #5
    Anthropic: Claude Opus 4.7 (thinking)
    claude-opus-4-7-thinking
    #5·Elo 1465·In $5.00·Out $25.00
    14651370$5.00$25.00388
    O
    #6
    Anthropic: Claude Opus 4.7
    claude-opus-4-7
    #6·Elo 1463·In $5.00·Out $25.00
    14631367$5.00$25.00377
    O
    #7
    OpenAI: GPT-5.5 (high)
    gpt-5.5-high
    #7·Elo 1456·In $5.00·Out $30.00
    14561356$5.00$30.00219
    O
    #10
    Anthropic: Claude Opus 4.5
    claude-opus-4-5-20251101
    #10·Elo 1449·In $5.00·Out $25.00
    14491354$5.00$25.001,005
    O
    #11
    Anthropic: Claude Opus 4.6
    claude-opus-4-6
    #11·Elo 1449·In $5.00·Out $25.00
    14491354$5.00$25.00661
    O
    #12
    Google: Gemini 3 Flash Preview
    gemini-3-flash
    #12·Elo 1448·In $0.500·Out $3.00
    14481448$0.500$3.00533
    O
    #14
    Anthropic: Claude Sonnet 4.6
    claude-sonnet-4-6
    #14·Elo 1442·In $3.00·Out $15.00
    14421369$3.00$15.00425
    O
    #15
    Google: Gemini 3 Flash Preview (thinking-minimal)
    gemini-3-flash (thinking-minimal)
    #15·Elo 1442·In $0.500·Out $3.00
    14421442$0.500$3.00803
    O
    #21
    Anthropic: Claude Opus 4.6 (thinking)
    claude-opus-4-6-thinking
    #21·Elo 1431·In $5.00·Out $25.00
    14311335$5.00$25.00561
    O
    #22
    MoonshotAI: Kimi K2.6
    kimi-k2.6
    #22·Elo 1430·In $0.684·Out $3.42
    14301421$0.684$3.42312
    O
    #22
    MoonshotAI: Kimi K2.6 (free)
    kimi-k2.6
    #22·Elo 1430·Out -
    1430---312
    O
    #23
    OpenAI: GPT-5.4 (high)
    gpt-5.4-high
    #23·Elo 1428·In $2.50·Out $15.00
    14281359$2.50$15.00496
    O
    #24
    OpenAI: GPT-5.2 Chat
    gpt-5.2-chat-latest-20260210
    #24·Elo 1427·In $1.75·Out $14.00
    14271365$1.75$14.00483
    O
    #25
    DeepSeek: DeepSeek V4 Pro (thinking)
    deepseek-v4-pro-thinking
    #25·Elo 1426·In $0.435·Out $0.870
    14261455$0.435$0.870276
    O
    #26
    OpenAI: GPT-5.4
    gpt-5.4
    #26·Elo 1425·In $2.50·Out $15.00
    14251355$2.50$15.00530
    O
    #27
    Z.ai: GLM 5
    glm-5
    #27·Elo 1425·In $0.600·Out $2.08
    14251430$0.600$2.08416
    O
    #28
    OpenAI: GPT-5.3 Chat
    gpt-5.3-chat-latest
    #28·Elo 1422·In $1.75·Out $14.00
    14221360$1.75$14.00512
    O
    #31
    Z.ai: GLM 5.1
    glm-5.1
    #31·Elo 1418·In $0.980·Out $3.08
    14181404$0.980$3.08284
    O
    #32
    DeepSeek: DeepSeek V4 Pro
    deepseek-v4-pro
    #32·Elo 1417·In $0.435·Out $0.870
    14171445$0.435$0.870343
    O
    #33
    Google: Gemini 2.5 Pro
    gemini-2.5-pro
    #33·Elo 1417·In $1.25·Out $10.00
    14171369$1.25$10.002,368
    O
    #33
    Google: Gemini 2.5 Pro Preview 06-05
    gemini-2.5-pro
    #33·Elo 1417·In $1.25·Out $10.00
    14171369$1.25$10.002,368
    O
    #34
    Google: Gemini 3.1 Flash Lite
    gemini-3.1-flash-lite-preview
    #34·Elo 1416·In $0.250·Out $1.50
    14161446$0.250$1.50646
    O
    #34
    Google: Gemini 3.1 Flash Lite Preview
    gemini-3.1-flash-lite-preview
    #34·Elo 1416·In $0.250·Out $1.50
    14161446$0.250$1.50646
    O
    #36
    Anthropic: Claude Sonnet 4.5
    claude-sonnet-4-5-20250929
    #36·Elo 1414·In $3.00·Out $15.00
    14141341$3.00$15.001,172
    O
    #40
    Z.ai: GLM 4.7
    glm-4.7
    #40·Elo 1409·In $0.400·Out $1.75
    14091426$0.400$1.75159
    O
    #42
    OpenAI: GPT-5.5
    gpt-5.5
    #42·Elo 1407·In $5.00·Out $30.00
    14071307$5.00$30.00221
    O
    #43
    MoonshotAI: Kimi K2.5 (thinking)
    kimi-k2.5-thinking
    #43·Elo 1406·In $0.400·Out $1.90
    14061421$0.400$1.90627
    O
    #44
    xAI: Grok 4.3
    grok-4.3
    #44·Elo 1404·In $1.25·Out $2.50
    14041386$1.25$2.50203
    O
    #45
    Anthropic: Claude Opus 4.5 (thinking-32k)
    claude-opus-4-5-20251101-thinking-32k
    #45·Elo 1402·In $5.00·Out $25.00
    14021307$5.00$25.00550
    O
    #47
    Anthropic: Claude Opus 4.1
    claude-opus-4-1-20250805
    #47·Elo 1400·In $15.00·Out $75.00
    14001257$15.00$75.001,522
    O
    #48
    OpenAI: GPT-5 (high)
    gpt-5-high
    #48·Elo 1400·In $1.25·Out $10.00
    14001352$1.25$10.00806
    O
    #49
    OpenAI: GPT-5.1
    gpt-5.1
    #49·Elo 1396·In $1.25·Out $10.00
    13961348$1.25$10.00671
    O
    #50
    OpenAI: o3
    o3-2025-04-16
    #50·Elo 1395·In $2.00·Out $8.00
    13951344$2.00$8.001,144
    O
    #51
    Qwen: Qwen3.6 Plus
    qwen3.6-plus
    #51·Elo 1394·In $0.325·Out $1.95
    13941413$0.325$1.95334
    O
    #52
    Qwen: Qwen3.5 397B A17B
    qwen3.5-397b-a17b
    #52·Elo 1393·In $0.390·Out $2.34
    13931404$0.390$2.34484
    O
    #53
    OpenAI: GPT-5.1 (high)
    gpt-5.1-high
    #53·Elo 1392·In $1.25·Out $10.00
    13921345$1.25$10.00618
    O
    #54
    DeepSeek: DeepSeek V4 Flash (thinking)
    deepseek-v4-flash-thinking
    #54·Elo 1392·In $0.098·Out $0.197
    13921484$0.098$0.197324
    O
    #55
    OpenAI: GPT-5.4 Mini (high)
    gpt-5.4-mini-high
    #55·Elo 1390·In $0.750·Out $4.50
    13901373$0.750$4.50427
    O
    #56
    OpenAI: GPT-5.2
    gpt-5.2
    #56·Elo 1387·In $1.75·Out $14.00
    13871325$1.75$14.00724
    O
    #57
    Xiaomi: MiMo-V2.5
    mimo-v2.5
    #57·Elo 1386·In $0.140·Out $0.280
    13861464$0.140$0.280259
    O
    #58
    Anthropic: Claude Sonnet 4.5 (thinking-32k)
    claude-sonnet-4-5-20250929-thinking-32k
    #58·Elo 1386·In $3.00·Out $15.00
    13861313$3.00$15.001,211
    O
    #61
    DeepSeek: DeepSeek V4 Flash
    deepseek-v4-flash
    #61·Elo 1384·In $0.098·Out $0.197
    13841477$0.098$0.197265
    O
    #63
    OpenAI: GPT-5.2 (high)
    gpt-5.2-high
    #63·Elo 1383·In $1.75·Out $14.00
    13831320$1.75$14.00719
    O
    #64
    Qwen: Qwen3 VL 235B A22B Instruct
    qwen3-vl-235b-a22b-instruct
    #64·Elo 1382·In $0.200·Out $0.880
    13821429$0.200$0.880308
    O
    #67
    OpenAI: GPT-4.1
    gpt-4.1-2025-04-14
    #67·Elo 1380·In $2.00·Out $8.00
    13801330$2.00$8.001,004
    O
    #70
    Google: Gemini 2.5 Flash
    gemini-2.5-flash
    #70·Elo 1377·In $0.300·Out $2.50
    13771391$0.300$2.502,231
    O
    #72
    OpenAI: GPT-5 Chat
    gpt-5-chat
    #72·Elo 1375·In $1.25·Out $10.00
    13751327$1.25$10.00783
    O
    #75
    DeepSeek: DeepSeek V3.2
    deepseek-v3.2
    #75·Elo 1370·In $0.229·Out $0.343
    13701430$0.229$0.343192
    O
    #75
    DeepSeek: DeepSeek V3.2 Exp
    deepseek-v3.2
    #75·Elo 1370·In $0.270·Out $0.410
    13701423$0.270$0.410192
    O
    #76
    Z.ai: GLM 4.6
    glm-4.6
    #76·Elo 1368·In $0.430·Out $1.74
    13681384$0.430$1.74570
    O
    #77
    Qwen: Qwen3 Max
    qwen3-max-preview
    #77·Elo 1366·In $0.780·Out $3.90
    13661352$0.780$3.90250
    O
    #77
    Qwen: Qwen3 Max Thinking
    qwen3-max-preview
    #77·Elo 1366·In $0.780·Out $3.90
    13661352$0.780$3.90250
    O
    #80
    Qwen: Qwen3 VL 235B A22B Thinking (thinking)
    qwen3-vl-235b-a22b-thinking
    #80·Elo 1364·In $0.260·Out $2.60
    13641378$0.260$2.60212
    O
    #81
    Anthropic: Claude Opus 4
    claude-opus-4-20250514
    #81·Elo 1364·In $15.00·Out $75.00
    13641221$15.00$75.00963
    O
    #82
    OpenAI: o4 Mini
    o4-mini-2025-04-16
    #82·Elo 1362·In $1.10·Out $4.40
    13621338$1.10$4.40938
    O
    #82
    OpenAI: o4 Mini High
    o4-mini-2025-04-16
    #82·Elo 1362·In $1.10·Out $4.40
    13621338$1.10$4.40938
    O
    #86
    DeepSeek: R1
    deepseek-r1
    #86·Elo 1356·In $0.700·Out $2.50
    13561354$0.700$2.50215
    O
    #89
    MoonshotAI: Kimi K2 0905
    kimi-k2-0905-preview
    #89·Elo 1354·In $0.600·Out $2.50
    13541355$0.600$2.50292
    O
    #90
    Anthropic: Claude Sonnet 4
    claude-sonnet-4-20250514
    #90·Elo 1354·In $3.00·Out $15.00
    13541280$3.00$15.00895
    O
    #91
    Qwen: Qwen3.5-27B
    qwen3.5-27b
    #91·Elo 1353·In $0.195·Out $1.56
    13531386$0.195$1.56409
    O
    #92
    Anthropic: Claude Haiku 4.5
    claude-haiku-4-5-20251001
    #92·Elo 1352·In $1.00·Out $5.00
    13521327$1.00$5.001,146
    O
    #93
    Qwen: Qwen3.5-122B-A10B
    qwen3.5-122b-a10b
    #93·Elo 1349·In $0.260·Out $2.08
    13491370$0.260$2.08414
    O
    #94
    Qwen: Qwen3.5-35B-A3B
    qwen3.5-35b-a3b
    #94·Elo 1349·In $0.140·Out $1.00
    13491400$0.140$1.00449
    O
    #95
    DeepSeek: R1 0528
    deepseek-r1-0528
    #95·Elo 1349·In $0.500·Out $2.15
    13491357$0.500$2.15298
    O
    #98
    Z.ai: GLM 4.5
    glm-4.5
    #98·Elo 1348·In $0.600·Out $2.20
    13481352$0.600$2.20606
    O
    #100
    Qwen: Qwen3 235B A22B Thinking 2507
    qwen3-235b-a22b-thinking-2507
    #100·Elo 1348·In $0.100·Out $0.100
    13481448$0.100$0.100199
    O
    #102
    OpenAI: GPT-4.1 Mini
    gpt-4.1-mini-2025-04-14
    #102·Elo 1347·In $0.400·Out $1.60
    13471366$0.400$1.60781
    O
    #103
    OpenAI: o1
    o1-2024-12-17
    #103·Elo 1345·In $15.00·Out $60.00
    13451207$15.00$60.00493
    O
    #104
    DeepSeek: DeepSeek V3.2 (thinking)
    deepseek-v3.2-exp-thinking
    #104·Elo 1345·In $0.229·Out $0.343
    13451405$0.229$0.343195
    O
    #104
    DeepSeek: DeepSeek V3.2 Exp (thinking)
    deepseek-v3.2-exp-thinking
    #104·Elo 1345·In $0.270·Out $0.410
    13451397$0.270$0.410195
    O
    #111
    Anthropic: Claude Sonnet 4 (thinking-32k)
    claude-sonnet-4-20250514-thinking-32k
    #111·Elo 1336·In $3.00·Out $15.00
    13361262$3.00$15.00684
    O
    #112
    StepFun: Step 3.5 Flash
    step-3.5-flash
    #112·Elo 1333·In $0.090·Out $0.300
    13331421$0.090$0.300580
    O
    #114
    OpenAI: o3 Mini (high)
    o3-mini-high
    #114·Elo 1332·In $1.10·Out $4.40
    13321307$1.10$4.40241
    O
    #114
    OpenAI: o3 Mini High (high)
    o3-mini-high
    #114·Elo 1332·In $1.10·Out $4.40
    13321307$1.10$4.40241
    O
    #118
    Google: Gemma 3 27B
    gemma-3-27b-it
    #118·Elo 1326·In $0.080·Out $0.160
    13261428$0.080$0.160866
    O
    #122
    OpenAI: GPT-5 Mini (high)
    gpt-5-mini-high
    #122·Elo 1324·In $0.250·Out $2.00
    13241347$0.250$2.00639
    O
    #123
    Qwen: Qwen3 Next 80B A3B Instruct
    qwen3-next-80b-a3b-instruct
    #123·Elo 1324·In $0.090·Out $1.10
    13241377$0.090$1.10484
    O
    #123
    Qwen: Qwen3 Next 80B A3B Instruct (free)
    qwen3-next-80b-a3b-instruct
    #123·Elo 1324·Out -
    1324---484
    O
    #124
    Xiaomi: MiMo-V2-Flash (thinking, non-thinking)
    mimo-v2-flash (non-thinking)
    #124·Elo 1323·In $0.100·Out $0.300
    13231408$0.100$0.300691
    O
    #126
    Arcee AI: Trinity Large Thinking (thinking)
    trinity-large-thinking
    #126·Elo 1322·In $0.220·Out $0.850
    13221368$0.220$0.850441
    O
    #127
    MiniMax: MiniMax M2.7
    minimax-m2.7
    #127·Elo 1322·In $0.279·Out $1.20
    13221355$0.279$1.20399
    O
    #128
    Qwen: Qwen3 Next 80B A3B Thinking (thinking)
    qwen3-next-80b-a3b-thinking
    #128·Elo 1319·In $0.098·Out $0.780
    13191382$0.098$0.780332
    O
    #129
    Qwen: Qwen3 235B A22B
    qwen3-235b-a22b
    #129·Elo 1318·In $0.455·Out $1.82
    13181332$0.455$1.82472
    O
    #130
    Arcee AI: Trinity Large Thinking
    trinity-large-preview
    #130·Elo 1318·In $0.220·Out $0.850
    13181364$0.220$0.850431
    O
    #133
    Qwen: Qwen3 30B A3B Instruct 2507
    qwen3-30b-a3b-instruct-2507
    #133·Elo 1314·In $0.043·Out $0.172
    13141430$0.043$0.172566
    O
    #134
    OpenAI: GPT-5.4 Nano (high)
    gpt-5.4-nano-high
    #134·Elo 1313·In $0.200·Out $1.25
    13131352$0.200$1.25411
    O
    #138
    Z.ai: GLM 4.7 Flash
    glm-4.7-flash
    #138·Elo 1298·In $0.060·Out $0.400
    12981387$0.060$0.400216
    O
    #140
    OpenAI: o3 Mini
    o3-mini
    #140·Elo 1292·In $1.10·Out $4.40
    12921268$1.10$4.401,072
    O
    #140
    OpenAI: o3 Mini High
    o3-mini
    #140·Elo 1292·In $1.10·Out $4.40
    12921268$1.10$4.401,072
    O
    #141
    OpenAI: gpt-oss-20b
    gpt-oss-20b
    #141·Elo 1292·In $0.029·Out $0.140
    12921421$0.029$0.140218
    O
    #141
    OpenAI: gpt-oss-20b (free)
    gpt-oss-20b
    #141·Elo 1292·Out -
    1292---218
    O
    #145
    OpenAI: GPT-4o
    gpt-4o-2024-05-13
    #145·Elo 1288·In $2.50·Out $10.00
    12881228$2.50$10.00712
    O
    #145
    OpenAI: GPT-4o (2024-05-13)
    gpt-4o-2024-05-13
    #145·Elo 1288·In $5.00·Out $15.00
    12881204$5.00$15.00712
    O
    #145
    OpenAI: GPT-4o (2024-08-06)
    gpt-4o-2024-05-13
    #145·Elo 1288·In $2.50·Out $10.00
    12881228$2.50$10.00712
    O
    #145
    OpenAI: GPT-4o (2024-11-20)
    gpt-4o-2024-05-13
    #145·Elo 1288·In $2.50·Out $10.00
    12881228$2.50$10.00712
    O
    #148
    Z.ai: GLM 4.5 Air
    glm-4.5-air
    #148·Elo 1283·In $0.125·Out $0.850
    12831340$0.125$0.850636
    O
    #148
    Z.ai: GLM 4.5 Air (free)
    glm-4.5-air
    #148·Elo 1283·Out -
    1283---636
    O
    #151
    MiniMax: MiniMax M2.1
    minimax-m2.1-preview
    #151·Elo 1279·In $0.290·Out $0.950
    12791316$0.290$0.950268
    O
    #154
    Google: Gemma 3n 4B
    gemma-3n-e4b-it
    #154·Elo 1274·In $0.060·Out $0.120
    12741389$0.060$0.120489
    O
    #155
    OpenAI: GPT-5 Nano (high)
    gpt-5-nano-high
    #155·Elo 1274·In $0.050·Out $0.400
    12741366$0.050$0.400216
    O
    #158
    MiniMax: MiniMax M2.5
    minimax-m2.5
    #158·Elo 1273·In $0.150·Out $1.15
    12731319$0.150$1.15604
    O
    #159
    MiniMax: MiniMax M1
    minimax-m1
    #159·Elo 1272·In $0.400·Out $2.20
    12721284$0.400$2.20635
    O
    #161
    Xiaomi: MiMo-V2-Flash (thinking)
    mimo-v2-flash (thinking)
    #161·Elo 1268·In $0.100·Out $0.300
    12681353$0.100$0.300154
    O
    #162
    Anthropic: Claude 3.5 Haiku
    claude-3-5-haiku-20241022
    #162·Elo 1268·In $0.800·Out $4.00
    12681252$0.800$4.001,186
    O
    #163
    Qwen: Qwen3 30B A3B
    qwen3-30b-a3b
    #163·Elo 1267·In $0.090·Out $0.450
    12671346$0.090$0.450440
    O
    #164
    OpenAI: gpt-oss-120b
    gpt-oss-120b
    #164·Elo 1263·In $0.039·Out $0.180
    12631380$0.039$0.180658
    O
    #164
    OpenAI: gpt-oss-120b (free)
    gpt-oss-120b
    #164·Elo 1263·Out -
    1263---658
    O
    #166
    OpenAI: GPT-4 Turbo
    gpt-4-turbo-2024-04-09
    #166·Elo 1263·In $10.00·Out $30.00
    12631149$10.00$30.002,668
    O
    #166
    OpenAI: GPT-4 Turbo Preview
    gpt-4-turbo-2024-04-09
    #166·Elo 1263·In $10.00·Out $30.00
    12631149$10.00$30.002,668
    O
    #170
    OpenAI: GPT-4 Turbo (older v1106)
    gpt-4-1106-preview
    #170·Elo 1254·In $10.00·Out $30.00
    12541139$10.00$30.001,292
    O
    #179
    Cohere: Command R (08-2024)
    command-r-08-2024
    #179·Elo 1242·In $0.150·Out $0.600
    12421304$0.150$0.600152
    O
    #181
    Mistral: Mistral Small 3
    mistral-small-24b-instruct-2501
    #181·Elo 1239·In $0.050·Out $0.080
    12391364$0.050$0.080231
    O
    #182
    OpenAI: GPT-4o-mini
    gpt-4o-mini-2024-07-18
    #182·Elo 1237·In $0.150·Out $0.600
    12371299$0.150$0.6001,087
    O
    #182
    OpenAI: GPT-4o-mini (2024-07-18)
    gpt-4o-mini-2024-07-18
    #182·Elo 1237·In $0.150·Out $0.600
    12371299$0.150$0.6001,087
    O
    #183
    Google: Gemma 2 27B
    gemma-2-27b-it
    #183·Elo 1236·In $0.650·Out $0.650
    12361255$0.650$0.6501,440
    O
    #189
    Mistral Large 2407
    mistral-large-2407
    #189·Elo 1227·In $2.00·Out $6.00
    12271182$2.00$6.00751
    O
    #195
    Meta: Llama 3.3 70B Instruct
    llama-3.3-70b-instruct
    #195·Elo 1213·In $0.100·Out $0.320
    12131297$0.100$0.320846
    O
    #195
    Meta: Llama 3.3 70B Instruct (free)
    llama-3.3-70b-instruct
    #195·Elo 1213·Out -
    1213---846
    O
    #197
    Anthropic: Claude 3 Haiku
    claude-3-haiku-20240307
    #197·Elo 1209·In $0.250·Out $1.25
    12091243$0.250$1.252,364
    O
    #201
    Microsoft: Phi 4
    phi-4
    #201·Elo 1196·In $0.065·Out $0.140
    11961306$0.065$0.140319
    O
    #204
    OpenAI: GPT-4 (older v0314)
    gpt-4-0314
    #204·Elo 1188·In $30.00·Out $60.00
    11881032$30.00$60.00429
    O
    #206
    Meta: Llama 3.1 70B Instruct
    llama-3.1-70b-instruct
    #206·Elo 1187·In $0.400·Out $0.400
    11871227$0.400$0.400873
    O
    #220
    Meta: Llama 3 70B Instruct
    llama-3-70b-instruct
    #220·Elo 1110·In $0.510·Out $0.740
    11101136$0.510$0.7405,410
    O
    #224
    Meta: Llama 3 8B Instruct
    llama-3-8b-instruct
    #224·Elo 1096·In $0.040·Out $0.040
    10961236$0.040$0.0402,422
    O
    #228
    Meta: Llama 3.1 8B Instruct
    llama-3.1-8b-instruct
    #228·Elo 1086·In $0.020·Out $0.050
    10861244$0.020$0.050802
    O