Meta's latest class of model (Llama 3.1) launched with a variety of sizes & flavors. This 70B instruct-tuned version is optimized for high quality dialogue usecases. It has demonstrated strong...
text->text| Provider | Region / Tag | Context | Input/M | Output/M | Uptime 1d | Latency | Quant | Cache |
|---|---|---|---|---|---|---|---|---|
| WandB | wandb/bf16 | 128K | $0.800 | $0.800 | 99.99% | - | bf16 | - |
| Amazon Bedrock | amazon-bedrock | 131K | $0.720 | $0.720 | 99.75% | - | - | - |
| DeepInfra | deepinfra/base | 131K | $0.400 | $0.400 | 99.60% | - | bf16 | - |
| DeepInfra | deepinfra/turbo | 131K | $0.400 | $0.400 | 98.28% | - | fp8 | - |
| Rank | Category | Variant | Trend | Elo | Votes |
|---|---|---|---|---|---|
| #188 | French | - | 1302 | 501 | |
| #190 | Japanese | - | 1175 | 1,428 | |
| #196 | Spanish | - | 1285 | 606 | |
| #206 | Korean | - | 1187 | 873 | |
| #207 | German | - | 1256 | 1,353 | |
| #207 | Industry Legal And Government | - | 1329 | 3,177 | |
| #223 | Industry Medicine And Healthcare | - | 1312 | 2,821 | |
| #225 | Industry Mathematical | - | 1275 | 6,524 | |
| #227 | Expert | - | 1272 | 2,924 | |
| #227 | Industry Life And Physical And Social Science | - | 1318 | 9,381 | |
| #228 | Industry Entertainment And Sports And Media | - | 1264 | 8,719 | |
| #230 | Coding | - | 1333 | 9,389 | |
| #230 | Multi Turn | - | 1288 | 10,405 | |
| #231 | English | - | 1321 | 29,694 | |
| #232 | Industry Business And Management And Financial Operations | - | 1288 | 6,381 | |
| #233 | Math | - | 1269 | 7,677 | |
| #235 | Exclude Ties | - | 1222 | 34,840 | |
| #235 | Longer Query | - | 1293 | 7,622 | |
| #235 | Overall | - | 1293 | 55,240 | |
| #235 | Russian | - | 1269 | 7,285 | |
| #237 | Creative Writing | - | 1257 | 8,250 | |
| #237 | Hard Prompts English | - | 1314 | 9,133 | |
| #237 | Instruction Following | - | 1272 | 21,910 | |
| #239 | Chinese | - | 1276 | 4,846 | |
| #239 | Hard Prompts | - | 1298 | 14,981 | |
| #239 | Industry Software And It Services | - | 1319 | 14,811 | |
| #247 | Industry Writing And Literature And Language | - | 1263 | 14,962 |