Skip to content

Llama 3.2 3B Instruct

Llama 3.2 3B Instruct offers capability gains over the 1B, outperforming comparable small models on summarization, instruction following, and tool use.

index.ts
import { streamText } from 'ai'
const result = streamText({
model: 'meta/llama-3.2-3b',
prompt: 'Why is the sky blue?'
})

Providers

Route requests across multiple providers. Copy a provider slug to set your preference. Visit the docs for more info. Using a provider means you agree to their terms, listed under Legal.

Provider
Context
Latency
Throughput
Input
Output
Cache
Web Search
Per Query
Capabilities
ZDR
No Training
Release Date
Amazon Bedrock
128K
0.2s
53tps
$0.15/M$0.15/M
09/18/2024