Skip to content

Llama 3.1 8B

Llama 3.1 8B is a multilingual, instruction-tuned model with a context window of 131.1K tokens and tool-use capability. It suits cost-effective production deployments that need multilingual coverage and trained tool use.

Tool Use
index.ts
import { streamText } from 'ai'


const result = streamText({
  model: 'meta/llama-3.1-8b',
  prompt: 'Why is the sky blue?'
})
OverviewPlaygroundAboutProvidersThroughputLatencyUptimeStatusSimilarFAQ
Throughput

P50 throughput on live AI Gateway traffic, in tokens per second (TPS). Visit the docs for more info.