The Meta Llama 3.3 multilingual large language model (LLM) is a pretrained and instruction tuned generative model in 70B (text in/text out). The Llama 3.3 instruction tuned text only model...
text->text| Provider | Region / Tag | Context | Input/M | Output/M | Uptime 1d | Latency | Quant | Cache |
|---|---|---|---|---|---|---|---|---|
| WandB | wandb/fp16 | 128K | $0.710 | $0.710 | 99.96% | - | fp16 | - |
google-vertex | 128K | $0.720 | $0.720 | 99.95% | - | - | - | |
| Groq | groq | 131K | $0.590 | $0.790 | 99.86% | - | - | - |
google-vertex/us-central1 | 128K | $0.720 | $0.720 | 99.50% | - | - | - | |
| Together | together/fp8 | 131K | $1.04 | $1.04 | 98.37% | - | fp8 | - |
| Parasail | parasail/fp8 | 131K | $0.220 | $0.500 | 97.80% | - | fp8 | - |
| SambaNova | sambanova-turbo | 16K | $0.450 | $0.900 | 97.33% | - | bf16 | - |
| AkashML | akashml/fp8 | 131K | $0.130 | $0.400 | 97.06% | - | fp8 | - |
| Novita | novita/bf16 | 6K | $0.135 | $0.400 | 96.27% | - | bf16 | - |
| DeepInfra | deepinfra/turbo | 131K | $0.100 | $0.320 | 95.91% | - | fp8 | - |
| Nebius | nebius/fp8 | 131K | $0.130 | $0.400 | 94.19% | - | fp8 | - |
| Cloudflare | cloudflare/fp8 | 24K | $0.293 | $2.25 | 92.51% | - | fp8 | - |
| Rank | Category | Variant | Trend | Elo | Votes |
|---|---|---|---|---|---|
| #169 | Polish | - | 1318 | 1,430 | |
| #187 | Japanese | - | 1213 | 1,121 | |
| #193 | German | - | 1291 | 1,182 | |
| #194 | French | - | 1325 | 535 | |
| #201 | Spanish | - | 1301 | 590 | |
| #202 | Industry Legal And Government | - | 1342 | 3,175 | |
| #204 | Korean | - | 1212 | 846 | |
| #209 | Industry Medicine And Healthcare | - | 1340 | 2,747 | |
| #214 | Industry Life And Physical And Social Science | - | 1340 | 9,380 | |
| #215 | English | - | 1344 | 30,148 | |
| #217 | Multi Turn | - | 1317 | 9,141 | |
| #219 | Industry Entertainment And Sports And Media | - | 1285 | 9,749 | |
| #219 | Industry Mathematical | - | 1302 | 5,232 | |
| #220 | Math | - | 1296 | 5,776 | |
| #221 | Creative Writing | - | 1286 | 8,063 | |
| #225 | Exclude Ties | - | 1262 | 36,915 | |
| #225 | Hard Prompts English | - | 1338 | 10,089 | |
| #225 | Overall | - | 1318 | 54,723 | |
| #226 | Expert | - | 1295 | 2,894 | |
| #231 | Hard Prompts | - | 1321 | 17,018 | |
| #231 | Industry Business And Management And Financial Operations | - | 1304 | 6,669 | |
| #233 | Russian | - | 1292 | 5,440 | |
| #234 | Industry Writing And Literature And Language | - | 1292 | 13,826 | |
| #236 | Industry Software And It Services | - | 1339 | 14,963 | |
| #236 | Instruction Following | - | 1292 | 18,787 | |
| #236 | Longer Query | - | 1312 | 8,304 | |
| #237 | Coding | - | 1345 | 8,747 | |
| #241 | Non English | - | 1283 | 24,573 | |
| #243 | Chinese | - | 1291 | 3,408 |