Llama 3.1 8B
Llama 3.1 8B is a multilingual, instruction-tuned model with a context window of 131.1K tokens and tool-use capability. It suits cost-effective production deployments that need multilingual coverage and trained tool use.
Tool Use
index.ts
import { streamText } from 'ai'
const result = streamText({ model: 'meta/llama-3.1-8b', prompt: 'Why is the sky blue?'})More models by Meta
| Model |
|---|
| 131K | 0.2s | 47tps | $0.24/M | $0.97/M | — | — |   | 04/05/2025 | |||||
| 131K | 0.2s | 67tps | $0.17/M | $0.66/M | — | — |  | 04/05/2025 | |||||
| 128K | 0.1s | 191tps | $0.59/M | $0.72/M | — | — | | 12/06/2024 | |||||
| 128K | 0.3s | 63tps | $0.72/M | $0.72/M | — | — | | 09/25/2024 | |||||
| 128K | 0.3s | 53tps | $0.15/M | $0.15/M | — | — | | 09/18/2024 | |||||
| 128K | 0.2s | 87tps | $0.10/M | $0.10/M | — | — | | 09/18/2024 |
