Skip to content
Dashboard

Llama 3.2 3B Instruct

Llama 3.2 3B Instruct offers capability gains over the 1B, outperforming comparable small models on summarization, instruction following, and tool use.

index.ts
import { streamText } from 'ai'
const result = streamText({
model: 'meta/llama-3.2-3b',
prompt: 'Why is the sky blue?'
})

More models by Meta

Model
Context
Latency
Throughput
Input
Output
Cache
Web Search
Per Query
Capabilities
Providers
ZDR
No Training
Release Date
131K
0.2s
133tps
$0.24/M$0.97/M
bedrock logo
deepinfra logo
04/05/2025
131K
0.2s
170tps
$0.17/M$0.66/M
bedrock logo
deepinfra logo
groq logo
04/05/2025
128K
0.2s
215tps
$0.59/M$0.72/M
bedrock logo
groq logo
12/06/2024
128K
0.2s
88tps
$0.10/M$0.10/M
bedrock logo
09/25/2024
131K
0.4s
30tps
$0.72/M$0.72/M
bedrock logo
deepinfra logo
07/23/2024
131K
0.1s
173tps
$0.02/M$0.05/M
Read:$0.03/M
Write:
bedrock logo
deepinfra logo
groq logo
+1
07/23/2024