gpt·basedElo-ranked, value-sorted
Sign in

Stay updated

Get an email when a cheaper, stronger model than yours appears on the leaderboard. No spam.

gpt·based

The LLM leaderboard that tells you when to switch. Arena rankings joined with OpenRouter pricing, refreshed daily.

Use cases

  • Best for coding
  • Best for multilingual
  • Cheapest worth using
  • Compare two models

Browse

  • Text models
  • WebDev models
  • Vision models
  • Image generation
  • Image edit

Data sources

  • LMArena
  • Providers

Developers

  • API on RapidAPI
  • OpenAPI spec

Contact

  • Contact page
  • [email protected]
© 2026 gptbasedDaily refresh, never paid placement.
    gpt·basedElo-ranked, value-sorted
    Sign in

    Find your model. Switch when a better one ships.

    LMArena rankings joined with live provider pricing. Pick a subset and category, or click any model for the full deep-dive.

    Last refresh: 7/18/2026, 4:07:34 AM (12,374 rows)

    Category

    How cheap can you go?

    Set a minimum Elo below, then sort by Output to find the cheapest model at your quality bar.

    any151
    Top Pick
    Anthropic: Claude Fable 5

    Highest Elo in Text · Overall

    #1Elo 1507
    Input / 1M
    $10.00
    Output / 1M
    $50.00
    Blended (4:1 in:out): $18.00/1M
    Try it on:
    OOpenRouter
    Set alert
    Best Value
    Meta: Muse Spark 1.1

    Pareto knee · $1.85/1M blended

    #6Elo 1493
    Input / 1M
    $1.25
    Output / 1M
    $4.25
    Blended (4:1 in:out): $1.85/1M
    Try it on:
    OOpenRouter
    Set alert
    Recommended
    Xiaomi: MiMo-V2.5-Pro

    Frontier middle pick · $0.522/1M blended

    #35Elo 1465
    Input / 1M
    $0.435
    Output / 1M
    $0.870
    Blended (4:1 in:out): $0.522/1M
    Try it on:
    OOpenRouter
    Set alert

    All models (151) · Text · Overall

    Rank = arena overall rank. Muted rows aren't hosted on OpenRouter or a partner. Gaps in the rank sequence are closed-source or unreleased models we don't track.

    RankModelTrendEloValueIn / 1MOutputVotesOpen in
    #1Anthropic: Claude Fable 5
    #1·Elo 1507·In $10.00·Out $50.00
    15071382$10.00$50.008,819
    O
    #2Anthropic: Claude Opus 4.6 (thinking)
    #2·Elo 1504·In $5.00·Out $25.00
    15041408$5.00$25.0061,003
    O
    #3Anthropic: Claude Opus 4.7 (thinking)
    #3·Elo 1503·In $5.00·Out $25.00
    15031407$5.00$25.0048,292
    O
    #4Anthropic: Claude Opus 4.6
    #4·Elo 1498·In $5.00·Out $25.00
    14981402$5.00$25.0064,747
    O
    #5Anthropic: Claude Opus 4.7
    #5·Elo 1494·In $5.00·Out $25.00
    14941398$5.00$25.0049,467
    O
    #6Meta: Muse Spark 1.1
    #6·Elo 1493·In $1.25·Out $4.25
    14931467$1.25$4.255,729
    O
    #9MoonshotAI: Kimi K3
    #9·Elo 1486·In $3.00·Out $15.00
    14861413$3.00$15.003,024
    O
    #11Google: Gemini 3.1 Pro Preview
    #11·Elo 1485·In $2.00·Out $12.00
    14851425$2.00$12.0081,473
    O
    #12Anthropic: Claude Opus 4.8 (thinking)
    #12·Elo 1483·In $5.00·Out $25.00
    14831387$5.00$25.0028,685
    O
    #13OpenAI: GPT-5.5 (high)
    #13·Elo 1482·In $5.00·Out $30.00
    14821382$5.00$30.0043,492
    O
    #14OpenAI: GPT-5.4 (high)
    #14·Elo 1478·In $2.50·Out $15.00
    14781408$2.50$15.0056,693
    O
    #15Google: Gemini 3.5 Flash (high)
    #15·Elo 1476·In $1.50·Out $9.00
    14761429$1.50$9.0010,104
    O
    #16OpenAI: GPT-5.2 Chat
    #16·Elo 1476·In $1.75·Out $14.00
    14761413$1.75$14.0034,450
    O
    #17Anthropic: Claude Opus 4.8
    #17·Elo 1476·In $5.00·Out $25.00
    14761380$5.00$25.0029,233
    O
    #18Qwen: Qwen3.7 Max
    #18·Elo 1475·In $1.48·Out $4.42
    14751444$1.48$4.423,717
    O
    #19OpenAI: GPT-5.5
    #19·Elo 1475·In $5.00·Out $30.00
    14751375$5.00$30.0044,872
    O
    #21Google: Gemini 3.5 Flash (medium)
    #21·Elo 1474·In $1.50·Out $9.00
    14741426$1.50$9.0011,660
    O
    #22Google: Gemini 3 Flash Preview
    #22·Elo 1473·In $0.500·Out $3.00
    14731473$0.500$3.0030,698
    O
    #25Anthropic: Claude Opus 4.5 (thinking-32k)
    #25·Elo 1473·In $5.00·Out $25.00
    14731377$5.00$25.0037,059
    O
    #26Anthropic: Claude Sonnet 4.6
    #26·Elo 1471·In $3.00·Out $15.00
    14711398$3.00$15.0054,975
    O
    #27Z.ai: GLM 5.1
    #27·Elo 1471·In $0.966·Out $3.04
    14711457$0.966$3.0428,606
    O
    #29Anthropic: Claude Opus 4.5
    #29·Elo 1469·In $5.00·Out $25.00
    14691374$5.00$25.0071,010
    O
    #30Z.ai: GLM 5.2 (max)
    #30·Elo 1468·In $0.413·Out $1.30
    14681491$0.413$1.3015,642
    O
    #32OpenAI: GPT-5.4
    #32·Elo 1466·In $2.50·Out $15.00
    14661396$2.50$15.0059,508
    O
    #34xAI: Grok 4.5
    #34·Elo 1465·In $2.00·Out $6.00
    14651421$2.00$6.005,493
    O
    #35Xiaomi: MiMo-V2.5-Pro
    #35·Elo 1465·In $0.435·Out $0.870
    14651493$0.435$0.87040,113
    O
    #37MoonshotAI: Kimi K2.6
    #37·Elo 1461·In $0.950·Out $4.00
    14611442$0.950$4.0037,507
    O
    #38Anthropic: Claude Sonnet 5 (high)
    #38·Elo 1461·In $2.00·Out $10.00
    14611405$2.00$10.0011,167
    O
    #39Qwen: Qwen3.7 Plus
    #39·Elo 1460·In $0.320·Out $1.28
    14601489$0.320$1.2820,223
    O
    #40Qwen: Qwen3.6 Max Preview
    #40·Elo 1460·In $1.04·Out $6.24
    14601428$1.04$6.245,206
    O
    #42Google: Gemini 3 Flash Preview (thinking-minimal)
    #42·Elo 1459·In $0.500·Out $3.00
    14591459$0.500$3.0082,077
    O
    #43DeepSeek: DeepSeek V4 Pro
    #43·Elo 1458·In $0.435·Out $0.870
    14581486$0.435$0.87043,082
    O
    #44Z.ai: GLM 5
    #44·Elo 1457·In $0.950·Out $3.15
    14571442$0.950$3.1527,814
    O
    #45DeepSeek: DeepSeek V4 Pro (thinking)
    #45·Elo 1456·In $0.435·Out $0.870
    14561484$0.435$0.87040,996
    O
    #46Anthropic: Claude Sonnet 4.5 (thinking-32k)
    #46·Elo 1456·In $3.00·Out $15.00
    14561382$3.00$15.0082,363
    O
    #48Anthropic: Claude Sonnet 4.5
    #48·Elo 1455·In $3.00·Out $15.00
    14551382$3.00$15.0080,758
    O
    #49OpenAI: GPT-5.1 (high)
    #49·Elo 1455·In $1.25·Out $10.00
    14551407$1.25$10.0040,789
    O
    #51OpenAI: GPT-5.4 Mini (high)
    #51·Elo 1450·In $0.750·Out $4.50
    14501432$0.750$4.5055,447
    O
    #52MoonshotAI: Kimi K2.5 (thinking)
    #52·Elo 1450·In $0.570·Out $2.85
    14501448$0.570$2.8560,841
    O
    #54OpenAI: GPT-5.3 Chat
    #54·Elo 1449·In $1.75·Out $14.00
    14491387$1.75$14.0033,023
    O
    #58Anthropic: Claude Opus 4.1
    #58·Elo 1447·In $15.00·Out $75.00
    14471304$15.00$75.0077,253
    O
    #59Google: Gemini 2.5 Pro
    #59·Elo 1446·In $1.25·Out $10.00
    14461398$1.25$10.00124,422
    O
    #59Google: Gemini 2.5 Pro Preview 06-05
    #59·Elo 1446·In $1.25·Out $10.00
    14461398$1.25$10.00124,422
    O
    #60MiniMax: MiniMax M3
    #60·Elo 1445·In $0.300·Out $1.20
    14451477$0.300$1.2025,824
    O
    #62Qwen: Qwen3.6 Plus
    #62·Elo 1443·In $0.325·Out $1.95
    14431462$0.325$1.9541,988
    O
    #64xAI: Grok 4.3
    #64·Elo 1442·In $1.25·Out $2.50
    14421425$1.25$2.5044,059
    O
    #65Z.ai: GLM 4.7
    #65·Elo 1442·In $0.400·Out $1.75
    14421460$0.400$1.7512,098
    O
    #66Qwen: Qwen3.5 397B A17B
    #66·Elo 1442·In $0.390·Out $2.34
    14421452$0.390$2.3456,154
    O
    #67Thinking Machines: Inkling
    #67·Elo 1441·In $1.00·Out $4.05
    14411421$1.00$4.051,543
    O
    #68Z.ai: GLM 5V Turbo
    #68·Elo 1439·In $1.20·Out $4.00
    14391415$1.20$4.005,356
    O
    #69OpenAI: GPT-5.1
    #69·Elo 1439·In $1.25·Out $10.00
    14391391$1.25$10.0043,410
    O
    #70DeepSeek: DeepSeek V4 Flash (thinking)
    #70·Elo 1438·In $0.098·Out $0.196
    14381531$0.098$0.19642,708
    O
    #72DeepSeek: DeepSeek V4 Flash
    #72·Elo 1438·In $0.098·Out $0.196
    14381531$0.098$0.19642,807
    O
    #73OpenAI: GPT-5.2 (high)
    #73·Elo 1437·In $1.75·Out $14.00
    14371375$1.75$14.0047,990
    O
    #75OpenAI: GPT-5.2
    #75·Elo 1435·In $1.75·Out $14.00
    14351373$1.75$14.0075,293
    O
    #77OpenAI: GPT-5 (high)
    #77·Elo 1434·In $1.25·Out $10.00
    14341386$1.25$10.0031,897
    O
    #78Xiaomi: MiMo-V2.5
    #78·Elo 1432·In $0.140·Out $0.280
    14321510$0.140$0.28041,017
    O
    #79Google: Gemini 3.1 Flash Lite
    #79·Elo 1432·In $0.250·Out $1.50
    14321462$0.250$1.5060,870
    O
    #79Google: Gemini 3.1 Flash Lite Preview
    #79·Elo 1432·In $0.250·Out $1.50
    14321462$0.250$1.5060,870
    O
    #82OpenAI: o3
    #82·Elo 1431·In $2.00·Out $8.00
    14311380$2.00$8.0059,702
    O
    #85Mistral: Mistral Medium 3.5
    #85·Elo 1427·In $1.50·Out $7.50
    14271384$1.50$7.5011,027
    O
    #87OpenAI: GPT-5 Chat
    #87·Elo 1427·In $1.25·Out $10.00
    14271379$1.25$10.0031,533
    O
    #88Z.ai: GLM 4.6
    #88·Elo 1425·In $0.500·Out $2.00
    14251435$0.500$2.0035,618
    O
    #92Qwen: Qwen3 Max
    #92·Elo 1424·In $0.780·Out $3.90
    14241409$0.780$3.909,149
    O
    #92Qwen: Qwen3 Max Thinking
    #92·Elo 1424·In $0.780·Out $3.90
    14241409$0.780$3.909,149
    O
    #95DeepSeek: DeepSeek V3.2 (thinking)
    #95·Elo 1423·In $0.269·Out $0.400
    14231476$0.269$0.40041,030
    O
    #95DeepSeek: DeepSeek V3.2 Exp (thinking)
    #95·Elo 1423·In $0.270·Out $0.410
    14231476$0.270$0.41041,030
    O
    #96DeepSeek: DeepSeek V3.2
    #96·Elo 1423·In $0.269·Out $0.400
    14231476$0.269$0.40011,915
    O
    #96DeepSeek: DeepSeek V3.2 Exp
    #96·Elo 1423·In $0.270·Out $0.410
    14231475$0.270$0.41011,915
    O
    #97DeepSeek: R1 0528
    #97·Elo 1422·In $0.500·Out $2.15
    14221430$0.500$2.1518,452
    O
    #100MoonshotAI: Kimi K2 0905
    #100·Elo 1418·In $0.600·Out $2.50
    14181419$0.600$2.5011,776
    O
    #101DeepSeek: DeepSeek V3.1 Terminus (thinking)
    #101·Elo 1418·In $0.270·Out $1.00
    14181456$0.270$1.003,458
    O
    #104Qwen: Qwen3.5-122B-A10B
    #104·Elo 1417·In $0.260·Out $2.08
    14171438$0.260$2.0828,523
    O
    #106MiniMax: MiniMax M2.7
    #106·Elo 1417·In $0.250·Out $1.00
    14171457$0.250$1.0047,935
    O
    #108Qwen: Qwen3 VL 235B A22B Instruct
    #108·Elo 1415·In $0.210·Out $1.90
    14151442$0.210$1.9011,499
    O
    #109DeepSeek: DeepSeek V3.1 Terminus
    #109·Elo 1415·In $0.270·Out $1.00
    14151453$0.270$1.003,692
    O
    #111OpenAI: GPT-4.1
    #111·Elo 1414·In $2.00·Out $8.00
    14141363$2.00$8.0050,939
    O
    #112Anthropic: Claude Opus 4
    #112·Elo 1412·In $15.00·Out $75.00
    14121269$15.00$75.0044,184
    O
    #114Anthropic: Claude Haiku 4.5
    #114·Elo 1412·In $1.00·Out $5.00
    14121387$1.00$5.00106,107
    O
    #116Z.ai: GLM 4.5
    #116·Elo 1411·In $0.600·Out $2.20
    14111415$0.600$2.2024,292
    O
    #117Google: Gemini 2.5 Flash
    #117·Elo 1410·In $0.300·Out $2.50
    14101423$0.300$2.50124,363
    O
    #120Qwen: Qwen3.5-27B
    #120·Elo 1409·In $0.260·Out $2.60
    14091422$0.260$2.6027,347
    O
    #123OpenAI: GPT-5.4 Nano (high)
    #123·Elo 1404·In $0.200·Out $1.25
    14041443$0.200$1.2554,399
    O
    #126Qwen: Qwen3 Next 80B A3B Instruct
    #126·Elo 1401·In $0.100·Out $1.10
    14011454$0.100$1.1022,855
    O
    #126Qwen: Qwen3 Next 80B A3B Instruct (free)
    #126·Elo 1401·Out -
    1401---22,855
    O
    #128Anthropic: Claude Sonnet 4 (thinking-32k)
    #128·Elo 1399·In $3.00·Out $15.00
    13991326$3.00$15.0035,080
    O
    #129Qwen: Qwen3 235B A22B Thinking 2507
    #129·Elo 1399·In $0.150·Out $1.50
    13991437$0.150$1.508,988
    O
    #130DeepSeek: R1
    #130·Elo 1398·In $0.700·Out $2.50
    13981396$0.700$2.5018,524
    O
    #133Qwen: Qwen3.5-35B-A3B
    #133·Elo 1396·In $0.140·Out $1.00
    13961446$0.140$1.0029,179
    O
    #134Qwen: Qwen3 VL 235B A22B Thinking (thinking)
    #134·Elo 1395·In $0.260·Out $2.60
    13951409$0.260$2.607,940
    O
    #136StepFun: Step 3.5 Flash
    #136·Elo 1395·In $0.100·Out $0.300
    13951480$0.100$0.30053,963
    O
    #139MiniMax: MiniMax M2.5
    #139·Elo 1391·In $0.150·Out $0.900
    13911443$0.150$0.90041,138
    O
    #140OpenAI: GPT-5 Mini (high)
    #140·Elo 1390·In $0.250·Out $2.00
    13901412$0.250$2.0027,007
    O
    #141OpenAI: o4 Mini
    #141·Elo 1390·In $1.10·Out $4.40
    13901365$1.10$4.4045,416
    O
    #141OpenAI: o4 Mini High
    #141·Elo 1390·In $1.10·Out $4.40
    13901365$1.10$4.4045,416
    O
    #142Anthropic: Claude Sonnet 4
    #142·Elo 1389·In $3.00·Out $15.00
    13891316$3.00$15.0040,290
    O
    #143OpenAI: o1
    #143·Elo 1388·In $15.00·Out $60.00
    13881250$15.00$60.0031,122
    O
    #149MiniMax: MiniMax M2.1
    #149·Elo 1384·In $0.300·Out $1.20
    13841416$0.300$1.2017,078
    O
    #150Qwen: Qwen3 30B A3B Instruct 2507
    #150·Elo 1383·In $0.100·Out $0.300
    13831469$0.100$0.30023,724
    O
    #151OpenAI: GPT-4.1 Mini
    #151·Elo 1383·In $0.400·Out $1.60
    13831402$0.400$1.6039,301
    O
    #154Arcee AI: Trinity Large Thinking
    #154·Elo 1379·In $0.250·Out $0.800
    13791423$0.250$0.80030,093
    O
    #155Z.ai: GLM 4.6V
    #155·Elo 1377·In $0.300·Out $0.900
    13771415$0.300$0.9002,803
    O
    #156Qwen: Qwen3 235B A22B
    #156·Elo 1375·In $0.455·Out $1.82
    13751389$0.455$1.8226,259
    O
    #159Z.ai: GLM 4.5 Air
    #159·Elo 1373·In $0.130·Out $0.850
    13731429$0.130$0.85031,063
    O
    #162Qwen: Qwen3 Next 80B A3B Thinking (thinking)
    #162·Elo 1370·In $0.098·Out $0.780
    13701433$0.098$0.78013,680
    O
    #163Arcee AI: Trinity Large Thinking (thinking)
    #163·Elo 1369·In $0.250·Out $0.800
    13691414$0.250$0.80029,175
    O
    #164Z.ai: GLM 4.7 Flash
    #164·Elo 1368·In $0.061·Out $0.400
    13681457$0.061$0.40011,713
    O
    #166Google: Gemma 3 27B
    #166·Elo 1366·In $0.100·Out $0.300
    13661451$0.100$0.30047,510
    O
    #167MiniMax: MiniMax M1
    #167·Elo 1364·In $0.550·Out $2.20
    13641369$0.550$2.2035,159
    O
    #168OpenAI: o3 Mini (high)
    #168·Elo 1363·In $1.10·Out $4.40
    13631339$1.10$4.4018,589
    O
    #168OpenAI: o3 Mini High (high)
    #168·Elo 1363·In $1.10·Out $4.40
    13631339$1.10$4.4018,589
    O
    #177Z.ai: GLM 4.5V
    #177·Elo 1354·In $0.600·Out $1.80
    13541361$0.600$1.804,956
    O
    #179OpenAI: gpt-oss-120b
    #179·Elo 1353·In $0.037·Out $0.170
    13531472$0.037$0.17030,629
    O
    #184OpenAI: o3 Mini
    #184·Elo 1348·In $1.10·Out $4.40
    13481323$1.10$4.4057,318
    O
    #184OpenAI: o3 Mini High
    #184·Elo 1348·In $1.10·Out $4.40
    13481323$1.10$4.4057,318
    O
    #187Qwen: Qwen3 32B
    #187·Elo 1347·In $0.080·Out $0.280
    13471439$0.080$0.2803,926
    O
    #188Inception: Mercury 2
    #188·Elo 1347·In $0.250·Out $0.750
    13471393$0.250$0.7503,119
    O
    #191MiniMax: MiniMax M2
    #191·Elo 1346·In $0.255·Out $1.02
    13461385$0.255$1.026,861
    O
    #196Google: Gemma 3 12B
    #196·Elo 1342·In $0.050·Out $0.150
    13421457$0.050$0.1503,829
    O
    #198OpenAI: GPT-5 Nano (high)
    #198·Elo 1337·In $0.050·Out $0.400
    13371429$0.050$0.4008,261
    O
    #204OpenAI: GPT-4o
    #204·Elo 1335·In $2.50·Out $10.00
    13351275$2.50$10.0045,499
    O
    #204OpenAI: GPT-4o (2024-05-13)
    #204·Elo 1335·In $5.00·Out $15.00
    13351251$5.00$15.0045,499
    O
    #204OpenAI: GPT-4o (2024-08-06)
    #204·Elo 1335·In $2.50·Out $10.00
    13351275$2.50$10.0045,499
    O
    #204OpenAI: GPT-4o (2024-11-20)
    #204·Elo 1335·In $2.50·Out $10.00
    13351275$2.50$10.0045,499
    O
    #212Qwen: Qwen3 30B A3B
    #212·Elo 1327·In $0.130·Out $0.520
    13271395$0.130$0.52026,472
    O
    #215OpenAI: GPT-4 Turbo
    #215·Elo 1324·In $10.00·Out $30.00
    13241209$10.00$30.0098,114
    O
    #215OpenAI: GPT-4 Turbo Preview
    #215·Elo 1324·In $10.00·Out $30.00
    13241209$10.00$30.0098,114
    O
    #220OpenAI: GPT-4.1 Nano
    #220·Elo 1322·In $0.100·Out $0.400
    13221402$0.100$0.4006,103
    O
    #225Meta: Llama 3.3 70B Instruct
    #225·Elo 1318·In $0.130·Out $0.400
    13181392$0.130$0.40054,723
    O
    #225Meta: Llama 3.3 70B Instruct (free)
    #225·Elo 1318·Out -
    1318---54,723
    O
    #226Google: Gemma 3n 4B
    #226·Elo 1318·In $0.060·Out $0.120
    13181432$0.060$0.12022,571
    O
    #228OpenAI: GPT-4o-mini
    #228·Elo 1318·In $0.150·Out $0.600
    13181380$0.150$0.60068,709
    O
    #228OpenAI: GPT-4o-mini (2024-07-18)
    #228·Elo 1318·In $0.150·Out $0.600
    13181380$0.150$0.60068,709
    O
    #229OpenAI: gpt-oss-20b
    #229·Elo 1317·In $0.030·Out $0.130
    13171447$0.030$0.13010,622
    O
    #229OpenAI: gpt-oss-20b (free)
    #229·Elo 1317·Out -
    1317---10,622
    O
    #233Mistral Large 2407
    #233·Elo 1314·In $2.00·Out $6.00
    13141269$2.00$6.0045,459
    O
    #240IBM: Granite 4.1 8B
    #240·Elo 1307·In $0.050·Out $0.100
    13071429$0.050$0.1004,060
    O
    #243AllenAI: Olmo 3 32B Think
    #243·Elo 1306·In $0.150·Out $0.500
    13061371$0.150$0.5005,939
    O
    #246Google: Gemma 3 4B
    #246·Elo 1303·In $0.050·Out $0.100
    13031426$0.050$0.1004,171
    O
    #251Meta: Llama 3.1 70B Instruct
    #251·Elo 1293·In $0.400·Out $0.400
    12931333$0.400$0.40055,240
    O
    #254Google: Gemma 2 27B
    #254·Elo 1289·In $0.650·Out $0.650
    12891308$0.650$0.65075,754
    O
    #266Cohere: Command R+ (08-2024)
    #266·Elo 1276·In $2.50·Out $10.00
    12761216$2.50$10.009,866
    O
    #268Mistral: Mistral Small 3
    #268·Elo 1274·In $0.050·Out $0.080
    12741399$0.050$0.08014,681
    O
    #277Anthropic: Claude 3 Haiku
    #277·Elo 1261·In $0.250·Out $1.25
    12611295$0.250$1.25117,701
    O
    #280Microsoft: Phi 4
    #280·Elo 1256·In $0.070·Out $0.140
    12561364$0.070$0.14024,126
    O
    #282Cohere: Command R (08-2024)
    #282·Elo 1250·In $0.150·Out $0.600
    12501312$0.150$0.60010,140
    O
    #298Google Gemini Pro Latest
    #298·Elo 1222·In $2.00·Out $12.00
    12221162$2.00$12.006,390
    O
    #303Meta: Llama 3.1 8B Instruct
    #303·Elo 1211·In $0.050·Out $0.080
    12111336$0.050$0.08049,605
    O
    #329Meta: Llama 3.2 3B Instruct
    #329·Elo 1166·In $0.051·Out $0.335
    11661263$0.051$0.3357,936
    O
    #329Meta: Llama 3.2 3B Instruct (free)
    #329·Elo 1166·Out -
    1166---7,936
    O
    #358Meta: Llama 3.2 1B Instruct
    #358·Elo 1111·In $0.027·Out $0.201
    11111231$0.027$0.2018,045
    O