Skip to content

Llama 3.2 1B Instruct

Llama 3.2 1B Instruct is Meta's smallest openly available model, with a context window of 128K tokens. It delivers text generation, summarization, and tool calling with minimal memory and compute requirements.

index.ts
import { streamText } from 'ai'
const result = streamText({
model: 'meta/llama-3.2-1b',
prompt: 'Why is the sky blue?'
})

More models by Meta

Model
Context
Latency
Throughput
Input
Output
Cache
Web Search
Per Query
Capabilities
Providers
ZDR
No Training
Release Date
131K
0.2s
33tps
$0.24/M$0.97/M
bedrock logo
deepinfra logo
04/05/2025
131K
0.2s
208tps
$0.17/M$0.66/M
bedrock logo
deepinfra logo
groq logo
04/05/2025
128K
0.1s
188tps
$0.59/M$0.72/M
bedrock logo
groq logo
12/06/2024
128K
0.2s
52tps
$0.15/M$0.15/M
bedrock logo
09/18/2024
131K
0.1s
181tps
$0.02/M$0.05/M
Read:$0.03/M
Write:
bedrock logo
deepinfra logo
groq logo
+1
07/23/2024
131K
0.4s
32tps
$0.72/M$0.72/M
bedrock logo
deepinfra logo
07/23/2024