Skip to content

Llama 3.2 3B Instruct

Llama 3.2 3B Instruct offers capability gains over the 1B, outperforming comparable small models on summarization, instruction following, and tool use.

index.ts
import { streamText } from 'ai'


const result = streamText({
  model: 'meta/llama-3.2-3b',
  prompt: 'Why is the sky blue?'
})
OverviewAboutProvidersThroughputLatencyUptimeStatusSimilarFAQ
Throughput

P50 throughput on live AI Gateway traffic, in tokens per second (TPS). Visit the docs for more info.