Meta's latest class of model (Llama 3.1) launched with a variety of sizes & flavors. This 8B instruct-tuned version is fast and efficient. It has demonstrated strong performance compared to...
text->text| Provider | Region / Tag | Context | Input/M | Output/M | Uptime 1d | Latency | Quant | Cache |
|---|---|---|---|---|---|---|---|---|
| WandB | wandb/bf16 | 128K | $0.220 | $0.220 | 100.00% | - | bf16 | - |
| Groq | groq | 131K | $0.050 | $0.080 | 99.98% | - | - | - |
| DeepInfra | deepinfra/bf16 | 131K | $0.020 | $0.050 | 99.85% | - | bf16 | - |
| Novita | novita/fp8 | 16K | $0.020 | $0.050 | 97.61% | - | fp8 | - |
| Cloudflare | cloudflare/fp8 | 32K | $0.152 | $0.287 | 95.53% | - | fp8 | - |
| Rank | Category | Variant | Trend | Elo | Votes |
|---|---|---|---|---|---|
| #206 | Japanese | - | 1087 | 1,234 | |
| #223 | French | - | 1207 | 478 | |
| #228 | Korean | - | 1086 | 802 | |
| #229 | Spanish | - | 1187 | 565 | |
| #239 | German | - | 1167 | 1,295 | |
| #272 | Industry Medicine And Healthcare | - | 1229 | 2,564 | |
| #275 | Expert | - | 1195 | 2,589 | |
| #275 | Industry Legal And Government | - | 1246 | 2,882 | |
| #277 | Longer Query | - | 1223 | 6,736 | |
| #277 | Multi Turn | - | 1198 | 8,930 | |
| #278 | Chinese | - | 1203 | 4,400 | |
| #278 | Russian | - | 1189 | 6,589 | |
| #280 | Industry Software And It Services | - | 1245 | 13,139 | |
| #281 | Coding | - | 1259 | 8,582 | |
| #281 | Industry Business And Management And Financial Operations | - | 1210 | 5,722 | |
| #282 | Hard Prompts English | - | 1240 | 8,195 | |
| #282 | Industry Mathematical | - | 1194 | 5,985 | |
| #284 | English | - | 1237 | 26,610 | |
| #285 | Industry Entertainment And Sports And Media | - | 1174 | 7,706 | |
| #285 | Industry Life And Physical And Social Science | - | 1228 | 8,403 | |
| #286 | Creative Writing | - | 1177 | 7,346 | |
| #286 | Instruction Following | - | 1191 | 19,781 | |
| #287 | Exclude Ties | - | 1090 | 31,686 | |
| #287 | Hard Prompts | - | 1222 | 13,535 | |
| #287 | Overall | - | 1211 | 49,605 | |
| #288 | Industry Writing And Literature And Language | - | 1182 | 13,505 | |
| #289 | Math | - | 1189 | 7,135 |