gpt·basedElo-ranked, value-sorted
Sign in

Stay updated

Get an email when a cheaper, stronger model than yours appears on the leaderboard. No spam.

gpt·based

The LLM leaderboard that tells you when to switch. Arena rankings joined with OpenRouter pricing, refreshed daily.

Use cases

  • Best for coding
  • Best for multilingual
  • Cheapest worth using
  • Compare two models

Browse

  • Text models
  • WebDev models
  • Vision models
  • Image generation
  • Image edit

Data sources

  • LMArena
  • Providers

Developers

  • API on RapidAPI
  • OpenAPI spec

Contact

  • Contact page
  • [email protected]
© 2026 gptbasedDaily refresh, never paid placement.
    gpt·basedElo-ranked, value-sorted
    Sign in

    Find your model. Switch when a better one ships.

    LMArena rankings joined with live provider pricing. Pick a subset and category, or click any model for the full deep-dive.

    Last refresh: 6/3/2026, 4:07:20 AM (11,177 rows)

    Category

    How cheap can you go?

    Set a minimum Elo below, then sort by Output to find the cheapest model at your quality bar.

    any129
    Top Pick
    Anthropic: Claude Opus 4.6 (thinking)

    Highest Elo in Text · Spanish

    #1Elo 1500
    Input / 1M
    $5.00
    Output / 1M
    $25.00
    Blended (4:1 in:out): $9.00/1M
    variant: thinking
    Try it on:
    OOpenRouter
    Set alert
    Best Value
    Xiaomi: MiMo-V2.5-Pro

    Pareto knee · $0.522/1M blended

    #22Elo 1465
    Input / 1M
    $0.435
    Output / 1M
    $0.870
    Blended (4:1 in:out): $0.522/1M
    Try it on:
    OOpenRouter
    Set alert
    Recommended
    Google: Gemini 3.1 Flash Lite

    Frontier middle pick · $0.500/1M blended

    #44Elo 1446
    Input / 1M
    $0.250
    Output / 1M
    $1.50
    Blended (4:1 in:out): $0.500/1M
    Try it on:
    OOpenRouter
    Set alert

    All models (129) · Text · Spanish

    Rank = arena overall rank. Muted rows aren't hosted on OpenRouter or a partner. Gaps in the rank sequence are closed-source or unreleased models we don't track.

    RankModelTrendEloValueIn / 1MOutputVotesOpen in
    #1
    Anthropic: Claude Opus 4.6 (thinking)
    claude-opus-4-6-thinking
    #1·Elo 1500·In $5.00·Out $25.00
    15001405$5.00$25.001,148
    O
    #2
    Anthropic: Claude Opus 4.6
    claude-opus-4-6
    #2·Elo 1497·In $5.00·Out $25.00
    14971402$5.00$25.001,211
    O
    #3
    Google: Gemini 3.1 Pro Preview
    gemini-3.1-pro-preview
    #3·Elo 1488·In $2.00·Out $12.00
    14881428$2.00$12.001,463
    O
    #4
    Anthropic: Claude Opus 4.7 (thinking)
    claude-opus-4-7-thinking
    #4·Elo 1486·In $5.00·Out $25.00
    14861390$5.00$25.00681
    O
    #6
    OpenAI: GPT-5.5 (high)
    gpt-5.5-high
    #6·Elo 1476·In $5.00·Out $30.00
    14761376$5.00$30.00456
    O
    #8
    OpenAI: GPT-5.2 Chat
    gpt-5.2-chat-latest-20260210
    #8·Elo 1474·In $1.75·Out $14.00
    14741412$1.75$14.00954
    O
    #12
    Anthropic: Claude Opus 4.5 (thinking-32k)
    claude-opus-4-5-20251101-thinking-32k
    #12·Elo 1471·In $5.00·Out $25.00
    14711376$5.00$25.00984
    O
    #14
    Anthropic: Claude Sonnet 4.6
    claude-sonnet-4-6
    #14·Elo 1469·In $3.00·Out $15.00
    14691396$3.00$15.00861
    O
    #15
    Anthropic: Claude Opus 4.7
    claude-opus-4-7
    #15·Elo 1468·In $5.00·Out $25.00
    14681373$5.00$25.00732
    O
    #16
    Google: Gemini 3 Flash Preview
    gemini-3-flash
    #16·Elo 1468·In $0.500·Out $3.00
    14681468$0.500$3.00834
    O
    #17
    OpenAI: GPT-5.4
    gpt-5.4
    #17·Elo 1468·In $2.50·Out $15.00
    14681398$2.50$15.00843
    O
    #19
    Anthropic: Claude Sonnet 4.5
    claude-sonnet-4-5-20250929
    #19·Elo 1467·In $3.00·Out $15.00
    14671394$3.00$15.001,996
    O
    #21
    OpenAI: GPT-5.5
    gpt-5.5
    #21·Elo 1465·In $5.00·Out $30.00
    14651365$5.00$30.00526
    O
    #22
    Xiaomi: MiMo-V2.5-Pro
    mimo-v2.5-pro
    #22·Elo 1465·In $0.435·Out $0.870
    14651494$0.435$0.870511
    O
    #25
    Anthropic: Claude Opus 4.5
    claude-opus-4-5-20251101
    #25·Elo 1463·In $5.00·Out $25.00
    14631368$5.00$25.001,750
    O
    #26
    Z.ai: GLM 5.1
    glm-5.1
    #26·Elo 1463·In $0.980·Out $3.08
    14631448$0.980$3.08464
    O
    #27
    Anthropic: Claude Opus 4.1
    claude-opus-4-1-20250805
    #27·Elo 1463·In $15.00·Out $75.00
    14631320$15.00$75.001,993
    O
    #28
    MoonshotAI: Kimi K2.5 (thinking)
    kimi-k2.5-thinking
    #28·Elo 1462·In $0.400·Out $1.90
    14621478$0.400$1.901,196
    O
    #29
    Google: Gemini 3.5 Flash
    gemini-3.5-flash
    #29·Elo 1461·In $1.50·Out $9.00
    14611414$1.50$9.00333
    O
    #30
    OpenAI: GPT-5.4 (high)
    gpt-5.4-high
    #30·Elo 1461·In $2.50·Out $15.00
    14611391$2.50$15.00929
    O
    #33
    Qwen: Qwen3.5 397B A17B
    qwen3.5-397b-a17b
    #33·Elo 1453·In $0.390·Out $2.34
    14531464$0.390$2.341,012
    O
    #34
    Qwen: Qwen3.6 Max Preview
    qwen3.6-max-preview
    #34·Elo 1453·In $1.04·Out $6.24
    14531421$1.04$6.24224
    O
    #35
    Anthropic: Claude Sonnet 4.5 (thinking-32k)
    claude-sonnet-4-5-20250929-thinking-32k
    #35·Elo 1453·In $3.00·Out $15.00
    14531380$3.00$15.002,120
    O
    #39
    Google: Gemini 2.5 Pro
    gemini-2.5-pro
    #39·Elo 1450·In $1.25·Out $10.00
    14501403$1.25$10.002,864
    O
    #39
    Google: Gemini 2.5 Pro Preview 06-05
    gemini-2.5-pro
    #39·Elo 1450·In $1.25·Out $10.00
    14501403$1.25$10.002,864
    O
    #40
    MoonshotAI: Kimi K2.6
    kimi-k2.6
    #40·Elo 1448·In $0.684·Out $3.42
    14481439$0.684$3.42569
    O
    #40
    MoonshotAI: Kimi K2.6 (free)
    kimi-k2.6
    #40·Elo 1448·Out -
    1448---569
    O
    #41
    OpenAI: GPT-5.1 (high)
    gpt-5.1-high
    #41·Elo 1447·In $1.25·Out $10.00
    14471399$1.25$10.00965
    O
    #43
    DeepSeek: DeepSeek V4 Pro
    deepseek-v4-pro
    #43·Elo 1446·In $0.435·Out $0.870
    14461474$0.435$0.870504
    O
    #44
    Google: Gemini 3.1 Flash Lite
    gemini-3.1-flash-lite-preview
    #44·Elo 1446·In $0.250·Out $1.50
    14461476$0.250$1.501,060
    O
    #44
    Google: Gemini 3.1 Flash Lite Preview
    gemini-3.1-flash-lite-preview
    #44·Elo 1446·In $0.250·Out $1.50
    14461476$0.250$1.501,060
    O
    #48
    Z.ai: GLM 5
    glm-5
    #48·Elo 1440·In $0.600·Out $2.08
    14401444$0.600$2.08781
    O
    #49
    Google: Gemini 3 Flash Preview (thinking-minimal)
    gemini-3-flash (thinking-minimal)
    #49·Elo 1440·In $0.500·Out $3.00
    14401440$0.500$3.001,479
    O
    #50
    DeepSeek: DeepSeek V4 Flash (thinking)
    deepseek-v4-flash-thinking
    #50·Elo 1439·In $0.098·Out $0.197
    14391532$0.098$0.197453
    O
    #51
    OpenAI: GPT-5.4 Mini (high)
    gpt-5.4-mini-high
    #51·Elo 1439·In $0.750·Out $4.50
    14391422$0.750$4.50736
    O
    #52
    Qwen: Qwen3.6 Plus
    qwen3.6-plus
    #52·Elo 1439·In $0.325·Out $1.95
    14391458$0.325$1.95637
    O
    #53
    DeepSeek: DeepSeek V4 Pro (thinking)
    deepseek-v4-pro-thinking
    #53·Elo 1438·In $0.435·Out $0.870
    14381466$0.435$0.870480
    O
    #54
    OpenAI: GPT-5.1
    gpt-5.1
    #54·Elo 1438·In $1.25·Out $10.00
    14381390$1.25$10.001,054
    O
    #56
    xAI: Grok 4.3
    grok-4.3
    #56·Elo 1434·In $1.25·Out $2.50
    14341417$1.25$2.50435
    O
    #57
    OpenAI: GPT-5.3 Chat
    gpt-5.3-chat-latest
    #57·Elo 1434·In $1.75·Out $14.00
    14341372$1.75$14.001,076
    O
    #58
    DeepSeek: DeepSeek V4 Flash
    deepseek-v4-flash
    #58·Elo 1434·In $0.098·Out $0.197
    14341527$0.098$0.197482
    O
    #59
    OpenAI: GPT-5.2 (high)
    gpt-5.2-high
    #59·Elo 1430·In $1.75·Out $14.00
    14301367$1.75$14.001,249
    O
    #61
    Anthropic: Claude Haiku 4.5
    claude-haiku-4-5-20251001
    #61·Elo 1428·In $1.00·Out $5.00
    14281402$1.00$5.001,976
    O
    #62
    Z.ai: GLM 4.5
    glm-4.5
    #62·Elo 1427·In $0.600·Out $2.20
    14271431$0.600$2.20623
    O
    #65
    Z.ai: GLM 4.7
    glm-4.7
    #65·Elo 1424·In $0.400·Out $1.75
    14241442$0.400$1.75315
    O
    #66
    MiniMax: MiniMax M2.7
    minimax-m2.7
    #66·Elo 1423·In $0.279·Out $1.20
    14231456$0.279$1.20737
    O
    #67
    Qwen: Qwen3 Next 80B A3B Instruct
    qwen3-next-80b-a3b-instruct
    #67·Elo 1422·In $0.090·Out $1.10
    14221476$0.090$1.10615
    O
    #67
    Qwen: Qwen3 Next 80B A3B Instruct (free)
    qwen3-next-80b-a3b-instruct
    #67·Elo 1422·Out -
    1422---615
    O
    #69
    Qwen: Qwen3.5-122B-A10B
    qwen3.5-122b-a10b
    #69·Elo 1421·In $0.260·Out $2.08
    14211441$0.260$2.08778
    O
    #70
    OpenAI: GPT-5.2
    gpt-5.2
    #70·Elo 1420·In $1.75·Out $14.00
    14201358$1.75$14.001,299
    O
    #72
    MoonshotAI: Kimi K2 0905
    kimi-k2-0905-preview
    #72·Elo 1419·In $0.600·Out $2.50
    14191420$0.600$2.50332
    O
    #75
    DeepSeek: DeepSeek V3.2
    deepseek-v3.2
    #75·Elo 1415·In $0.229·Out $0.343
    14151475$0.229$0.3431,212
    O
    #75
    DeepSeek: DeepSeek V3.2 Exp
    deepseek-v3.2
    #75·Elo 1415·In $0.270·Out $0.410
    14151467$0.270$0.4101,212
    O
    #76
    Z.ai: GLM 4.6
    glm-4.6
    #76·Elo 1415·In $0.430·Out $1.74
    14151431$0.430$1.74881
    O
    #77
    Xiaomi: MiMo-V2.5
    mimo-v2.5
    #77·Elo 1414·In $0.140·Out $0.280
    14141492$0.140$0.280492
    O
    #78
    OpenAI: GPT-5 Chat
    gpt-5-chat
    #78·Elo 1414·In $1.25·Out $10.00
    14141366$1.25$10.00770
    O
    #84
    Qwen: Qwen3 Max
    qwen3-max-preview
    #84·Elo 1407·In $0.780·Out $3.90
    14071393$0.780$3.90388
    O
    #84
    Qwen: Qwen3 Max Thinking
    qwen3-max-preview
    #84·Elo 1407·In $0.780·Out $3.90
    14071393$0.780$3.90388
    O
    #88
    OpenAI: GPT-5 (high)
    gpt-5-high
    #88·Elo 1405·In $1.25·Out $10.00
    14051357$1.25$10.00817
    O
    #89
    OpenAI: o3
    o3-2025-04-16
    #89·Elo 1404·In $2.00·Out $8.00
    14041354$2.00$8.001,070
    O
    #90
    StepFun: Step 3.5 Flash
    step-3.5-flash
    #90·Elo 1404·In $0.090·Out $0.300
    14041492$0.090$0.3001,095
    O
    #91
    Google: Gemini 2.5 Flash
    gemini-2.5-flash
    #91·Elo 1404·In $0.300·Out $2.50
    14041417$0.300$2.502,907
    O
    #92
    OpenAI: GPT-4.1
    gpt-4.1-2025-04-14
    #92·Elo 1403·In $2.00·Out $8.00
    14031352$2.00$8.00986
    O
    #93
    Qwen: Qwen3.5-27B
    qwen3.5-27b
    #93·Elo 1402·In $0.195·Out $1.56
    14021435$0.195$1.56776
    O
    #94
    Qwen: Qwen3 VL 235B A22B Instruct
    qwen3-vl-235b-a22b-instruct
    #94·Elo 1400·In $0.200·Out $0.880
    14001448$0.200$0.880406
    O
    #95
    Anthropic: Claude Sonnet 4
    claude-sonnet-4-20250514
    #95·Elo 1400·In $3.00·Out $15.00
    14001327$3.00$15.00782
    O
    #97
    Anthropic: Claude Sonnet 4 (thinking-32k)
    claude-sonnet-4-20250514-thinking-32k
    #97·Elo 1398·In $3.00·Out $15.00
    13981325$3.00$15.00737
    O
    #98
    Anthropic: Claude Opus 4
    claude-opus-4-20250514
    #98·Elo 1396·In $15.00·Out $75.00
    13961253$15.00$75.00872
    O
    #100
    DeepSeek: R1 0528
    deepseek-r1-0528
    #100·Elo 1396·In $0.500·Out $2.15
    13961404$0.500$2.15230
    O
    #101
    DeepSeek: R1
    deepseek-r1
    #101·Elo 1395·In $0.700·Out $2.50
    13951392$0.700$2.50114
    O
    #104
    Arcee AI: Trinity Large Thinking
    trinity-large-preview
    #104·Elo 1391·In $0.220·Out $0.850
    13911437$0.220$0.850839
    O
    #105
    Qwen: Qwen3.5-35B-A3B
    qwen3.5-35b-a3b
    #105·Elo 1388·In $0.140·Out $1.00
    13881439$0.140$1.00810
    O
    #108
    Qwen: Qwen3 30B A3B Instruct 2507
    qwen3-30b-a3b-instruct-2507
    #108·Elo 1387·In $0.043·Out $0.172
    13871503$0.043$0.172633
    O
    #109
    Xiaomi: MiMo-V2-Flash (thinking, non-thinking)
    mimo-v2-flash (non-thinking)
    #109·Elo 1387·In $0.100·Out $0.300
    13871472$0.100$0.3001,247
    O
    #111
    OpenAI: GPT-5.4 Nano (high)
    gpt-5.4-nano-high
    #111·Elo 1386·In $0.200·Out $1.25
    13861424$0.200$1.25754
    O
    #112
    Qwen: Qwen3 VL 235B A22B Thinking (thinking)
    qwen3-vl-235b-a22b-thinking
    #112·Elo 1384·In $0.260·Out $2.60
    13841398$0.260$2.60331
    O
    #113
    DeepSeek: DeepSeek V3.2 (thinking)
    deepseek-v3.2-exp-thinking
    #113·Elo 1384·In $0.229·Out $0.343
    13841444$0.229$0.343279
    O
    #113
    DeepSeek: DeepSeek V3.2 Exp (thinking)
    deepseek-v3.2-exp-thinking
    #113·Elo 1384·In $0.270·Out $0.410
    13841436$0.270$0.410279
    O
    #114
    OpenAI: o4 Mini
    o4-mini-2025-04-16
    #114·Elo 1383·In $1.10·Out $4.40
    13831358$1.10$4.40876
    O
    #114
    OpenAI: o4 Mini High
    o4-mini-2025-04-16
    #114·Elo 1383·In $1.10·Out $4.40
    13831358$1.10$4.40876
    O
    #116
    Qwen: Qwen3 235B A22B Thinking 2507
    qwen3-235b-a22b-thinking-2507
    #116·Elo 1382·In $0.100·Out $0.100
    13821482$0.100$0.100154
    O
    #117
    OpenAI: GPT-5 Nano (high)
    gpt-5-nano-high
    #117·Elo 1381·In $0.050·Out $0.400
    13811473$0.050$0.400206
    O
    #120
    MiniMax: MiniMax M2.1
    minimax-m2.1-preview
    #120·Elo 1379·In $0.290·Out $0.950
    13791416$0.290$0.950410
    O
    #127
    OpenAI: GPT-5 Mini (high)
    gpt-5-mini-high
    #127·Elo 1374·In $0.250·Out $2.00
    13741396$0.250$2.00741
    O
    #128
    MiniMax: MiniMax M2.5
    minimax-m2.5
    #128·Elo 1374·In $0.150·Out $1.15
    13741419$0.150$1.151,130
    O
    #130
    Xiaomi: MiMo-V2-Flash (thinking)
    mimo-v2-flash (thinking)
    #130·Elo 1371·In $0.100·Out $0.300
    13711457$0.100$0.300321
    O
    #132
    Z.ai: GLM 4.7 Flash
    glm-4.7-flash
    #132·Elo 1369·In $0.060·Out $0.400
    13691459$0.060$0.400337
    O
    #133
    Qwen: Qwen3 235B A22B
    qwen3-235b-a22b
    #133·Elo 1369·In $0.455·Out $1.82
    13691383$0.455$1.82421
    O
    #136
    OpenAI: gpt-oss-120b
    gpt-oss-120b
    #136·Elo 1365·In $0.039·Out $0.180
    13651482$0.039$0.180759
    O
    #136
    OpenAI: gpt-oss-120b (free)
    gpt-oss-120b
    #136·Elo 1365·Out -
    1365---759
    O
    #137
    Z.ai: GLM 4.5 Air
    glm-4.5-air
    #137·Elo 1363·In $0.125·Out $0.850
    13631420$0.125$0.850724
    O
    #137
    Z.ai: GLM 4.5 Air (free)
    glm-4.5-air
    #137·Elo 1363·Out -
    1363---724
    O
    #140
    Arcee AI: Trinity Large Thinking (thinking)
    trinity-large-thinking
    #140·Elo 1362·In $0.220·Out $0.850
    13621408$0.220$0.850724
    O
    #143
    OpenAI: GPT-4.1 Mini
    gpt-4.1-mini-2025-04-14
    #143·Elo 1356·In $0.400·Out $1.60
    13561376$0.400$1.60721
    O
    #144
    Z.ai: GLM 4.5V
    glm-4.5v
    #144·Elo 1355·In $0.600·Out $1.80
    13551363$0.600$1.80177
    O
    #147
    MiniMax: MiniMax M1
    minimax-m1
    #147·Elo 1354·In $0.400·Out $2.20
    13541365$0.400$2.20716
    O
    #149
    Qwen: Qwen3 Next 80B A3B Thinking (thinking)
    qwen3-next-80b-a3b-thinking
    #149·Elo 1350·In $0.098·Out $0.780
    13501414$0.098$0.780398
    O
    #150
    Google: Gemma 3 27B
    gemma-3-27b-it
    #150·Elo 1350·In $0.080·Out $0.160
    13501452$0.080$0.160775
    O
    #151
    OpenAI: o1
    o1-2024-12-17
    #151·Elo 1349·In $15.00·Out $60.00
    13491211$15.00$60.00347
    O
    #155
    OpenAI: o3 Mini (high)
    o3-mini-high
    #155·Elo 1343·In $1.10·Out $4.40
    13431318$1.10$4.40126
    O
    #155
    OpenAI: o3 Mini High (high)
    o3-mini-high
    #155·Elo 1343·In $1.10·Out $4.40
    13431318$1.10$4.40126
    O
    #163
    OpenAI: o3 Mini
    o3-mini
    #163·Elo 1327·In $1.10·Out $4.40
    13271302$1.10$4.40837
    O
    #163
    OpenAI: o3 Mini High
    o3-mini
    #163·Elo 1327·In $1.10·Out $4.40
    13271302$1.10$4.40837
    O
    #164
    OpenAI: GPT-4o
    gpt-4o-2024-05-13
    #164·Elo 1325·In $2.50·Out $10.00
    13251265$2.50$10.00546
    O
    #164
    OpenAI: GPT-4o (2024-05-13)
    gpt-4o-2024-05-13
    #164·Elo 1325·In $5.00·Out $15.00
    13251240$5.00$15.00546
    O
    #164
    OpenAI: GPT-4o (2024-08-06)
    gpt-4o-2024-05-13
    #164·Elo 1325·In $2.50·Out $10.00
    13251265$2.50$10.00546
    O
    #164
    OpenAI: GPT-4o (2024-11-20)
    gpt-4o-2024-05-13
    #164·Elo 1325·In $2.50·Out $10.00
    13251265$2.50$10.00546
    O
    #165
    Qwen: Qwen3 30B A3B
    qwen3-30b-a3b
    #165·Elo 1324·In $0.090·Out $0.450
    13241403$0.090$0.450410
    O
    #167
    Anthropic: Claude 3.5 Haiku
    claude-3-5-haiku-20241022
    #167·Elo 1322·In $0.800·Out $4.00
    13221306$0.800$4.00883
    O
    #170
    OpenAI: GPT-4 Turbo
    gpt-4-turbo-2024-04-09
    #170·Elo 1312·In $10.00·Out $30.00
    13121197$10.00$30.001,430
    O
    #170
    OpenAI: GPT-4 Turbo Preview
    gpt-4-turbo-2024-04-09
    #170·Elo 1312·In $10.00·Out $30.00
    13121197$10.00$30.001,430
    O
    #171
    MiniMax: MiniMax M2
    minimax-m2
    #171·Elo 1311·In $0.255·Out $1.00
    13111350$0.255$1.00173
    O
    #173
    OpenAI: GPT-4o-mini
    gpt-4o-mini-2024-07-18
    #173·Elo 1309·In $0.150·Out $0.600
    13091371$0.150$0.600740
    O
    #173
    OpenAI: GPT-4o-mini (2024-07-18)
    gpt-4o-mini-2024-07-18
    #173·Elo 1309·In $0.150·Out $0.600
    13091371$0.150$0.600740
    O
    #174
    OpenAI: GPT-4 Turbo (older v1106)
    gpt-4-1106-preview
    #174·Elo 1309·In $10.00·Out $30.00
    13091195$10.00$30.001,472
    O
    #180
    OpenAI: gpt-oss-20b
    gpt-oss-20b
    #180·Elo 1304·In $0.029·Out $0.140
    13041433$0.029$0.140253
    O
    #180
    OpenAI: gpt-oss-20b (free)
    gpt-oss-20b
    #180·Elo 1304·Out -
    1304---253
    O
    #186
    Google: Gemma 3n 4B
    gemma-3n-e4b-it
    #186·Elo 1302·In $0.060·Out $0.120
    13021416$0.060$0.120408
    O
    #188
    Meta: Llama 3.3 70B Instruct
    llama-3.3-70b-instruct
    #188·Elo 1300·In $0.100·Out $0.320
    13001384$0.100$0.320590
    O
    #188
    Meta: Llama 3.3 70B Instruct (free)
    llama-3.3-70b-instruct
    #188·Elo 1300·Out -
    1300---590
    O
    #193
    Google: Gemma 2 27B
    gemma-2-27b-it
    #193·Elo 1290·In $0.650·Out $0.650
    12901309$0.650$0.650845
    O
    #195
    Meta: Llama 3 70B Instruct
    llama-3-70b-instruct
    #195·Elo 1287·In $0.510·Out $0.740
    12871312$0.510$0.7402,705
    O
    #196
    Meta: Llama 3.1 70B Instruct
    llama-3.1-70b-instruct
    #196·Elo 1285·In $0.400·Out $0.400
    12851325$0.400$0.400606
    O
    #197
    Mistral Large 2407
    mistral-large-2407
    #197·Elo 1284·In $2.00·Out $6.00
    12841239$2.00$6.00584
    O
    #199
    OpenAI: GPT-4 (older v0314)
    gpt-4-0314
    #199·Elo 1278·In $30.00·Out $60.00
    12781122$30.00$60.00647
    O
    #203
    Microsoft: Phi 4
    phi-4
    #203·Elo 1265·In $0.065·Out $0.140
    12651375$0.065$0.140127
    O
    #214
    Anthropic: Claude 3 Haiku
    claude-3-haiku-20240307
    #214·Elo 1235·In $0.250·Out $1.25
    12351270$0.250$1.251,704
    O
    #219
    Meta: Llama 3 8B Instruct
    llama-3-8b-instruct
    #219·Elo 1222·In $0.040·Out $0.040
    12221361$0.040$0.0401,744
    O
    #229
    Meta: Llama 3.1 8B Instruct
    llama-3.1-8b-instruct
    #229·Elo 1187·In $0.020·Out $0.050
    11871345$0.020$0.050565
    O