Llama 3.1 8B
Llama 3.1 8B is a multilingual, instruction-tuned model with a context window of 131.1K tokens and tool-use capability. It suits cost-effective production deployments that need multilingual coverage and trained tool use.
Tool Use
index.ts
import { streamText } from 'ai'
const result = streamText({ model: 'meta/llama-3.1-8b', prompt: 'Why is the sky blue?'})Providers
Route requests across multiple providers. Copy a provider slug to set your preference. Visit the docs for more info. Using a provider means you agree to their terms, listed under Legal.
| Provider |
|---|
| 128K | 0.1s | $0.10/M | $0.10/M | Read:$0.1/M Write:— | — | — | 07/23/2024 | |||||
| 131K | 0.1s | $0.05/M | $0.08/M | Read:$0.03/M Write:— | — | — | 07/23/2024 | |||||
| 128K | 0.2s | $0.22/M | $0.22/M | — | — | 07/23/2024 | ||||||
| 131K | 0.2s | 55tps | $0.03/M | $0.05/M | — | — | 07/23/2024 | |||||
| 16K | 0.3s | 53tps | $0.02/M | $0.05/M | — | — | 07/23/2024 |
