Skip to content

Llama 3.2 3B Instruct

Llama 3.2 3B Instruct offers capability gains over the 1B, outperforming comparable small models on summarization, instruction following, and tool use.

index.ts
import { streamText } from 'ai'
const result = streamText({
model: 'meta/llama-3.2-3b',
prompt: 'Why is the sky blue?'
})

More models by Meta

Model
Context
Latency
Throughput
Input
Output
Cache
Web Search
Per Query
Capabilities
Providers
ZDR
No Training
Release Date
131K
0.2s
27tps
$0.24/M$0.97/M
bedrock logo
deepinfra logo
04/05/2025
131K
0.2s
197tps
$0.17/M$0.66/M
bedrock logo
deepinfra logo
groq logo
04/05/2025
128K
0.2s
193tps
$0.59/M$0.72/M
bedrock logo
groq logo
12/06/2024
128K
0.2s
$0.16/M$0.16/M
bedrock logo
09/25/2024
131K
0.1s
182tps
$0.02/M$0.05/M
Read:$0.03/M
Write:
bedrock logo
deepinfra logo
groq logo
+1
07/23/2024
131K
0.4s
32tps
$0.72/M$0.72/M
bedrock logo
deepinfra logo
07/23/2024