The Meta Llama 3.3 multilingual large language model (LLM) is a pretrained and instruction tuned generative model in 70B (text in/text out). The Llama 3.3 instruction tuned text only model...
text->text| Provider | Region / Tag | Context | Input/M | Output/M | Uptime 1d | Latency | Quant | Cache |
|---|---|---|---|---|---|---|---|---|
| Groq | groq | 131K | $0.590 | $0.790 | 99.94% | - | - | - |
google-vertex/us-central1 | 128K | $0.720 | $0.720 | 99.09% | - | - | - | |
| Parasail | parasail/fp8 | 131K | $0.220 | $0.500 | 99.05% | - | fp8 | - |
| AkashML | akashml/fp8 | 131K | $0.130 | $0.400 | 98.90% | - | fp8 | - |
| SambaNova | sambanova-turbo | 16K | $0.450 | $0.900 | 98.39% | - | bf16 | - |
| DeepInfra | deepinfra/turbo | 131K | $0.100 | $0.320 | 97.84% | - | fp8 | - |
| Together | together/fp8 | 131K | $1.04 | $1.04 | 97.08% | - | fp8 | - |
| Novita | novita/bf16 | 6K | $0.135 | $0.400 | 97.08% | - | bf16 | - |
| WandB | wandb/fp16 | 128K | $0.710 | $0.710 | 95.86% | - | fp16 | - |
google-vertex | 128K | $0.720 | $0.720 | 94.95% | - | - | - | |
| Nebius | nebius/fp8 | 131K | $0.130 | $0.400 | 94.69% | - | fp8 | - |
| Cloudflare | cloudflare/fp8 | 24K | $0.293 | $2.25 | 92.10% | - | fp8 | - |
| Rank | Category | Variant | Trend | Elo | Votes |
|---|---|---|---|---|---|
| #165 | Polish | - | 1318 | 1,429 | |
| #186 | Japanese | - | 1213 | 1,121 | |
| #188 | French | - | 1327 | 536 | |
| #190 | German | - | 1291 | 1,182 | |
| #197 | Spanish | - | 1300 | 590 | |
| #198 | Industry Legal And Government | - | 1342 | 3,175 | |
| #199 | Korean | - | 1212 | 846 | |
| #203 | Industry Medicine And Healthcare | - | 1340 | 2,748 | |
| #207 | Industry Life And Physical And Social Science | - | 1340 | 9,376 | |
| #208 | English | - | 1344 | 30,156 | |
| #210 | Multi Turn | - | 1317 | 9,140 | |
| #212 | Industry Entertainment And Sports And Media | - | 1285 | 9,752 | |
| #214 | Creative Writing | - | 1286 | 8,067 | |
| #214 | Industry Mathematical | - | 1302 | 5,232 | |
| #215 | Math | - | 1296 | 5,777 | |
| #218 | Exclude Ties | - | 1262 | 36,921 | |
| #218 | Hard Prompts English | - | 1338 | 10,093 | |
| #218 | Overall | - | 1318 | 54,732 | |
| #220 | Expert | - | 1294 | 2,895 | |
| #224 | Hard Prompts | - | 1321 | 17,020 | |
| #224 | Industry Business And Management And Financial Operations | - | 1304 | 6,669 | |
| #227 | Industry Writing And Literature And Language | - | 1291 | 13,830 | |
| #227 | Russian | - | 1292 | 5,441 | |
| #229 | Instruction Following | - | 1292 | 18,787 | |
| #229 | Longer Query | - | 1312 | 8,305 | |
| #230 | Coding | - | 1345 | 8,748 | |
| #230 | Industry Software And It Services | - | 1339 | 14,966 | |
| #233 | Non English | - | 1283 | 24,574 | |
| #237 | Chinese | - | 1291 | 3,407 |