Skip to content

Llama 3.2 1B Instruct

Llama 3.2 1B Instruct is Meta's smallest openly available model, with a context window of 128K tokens. It delivers text generation, summarization, and tool calling with minimal memory and compute requirements.

index.ts
import { streamText } from 'ai'
const result = streamText({
model: 'meta/llama-3.2-1b',
prompt: 'Why is the sky blue?'
})

More models by Meta

Model
Context
Latency
Throughput
Input
Output
Cache
Web Search
Per Query
Capabilities
Providers
ZDR
No Training
Release Date
131K
0.2s
47tps
$0.24/M$0.97/M
bedrock logo
deepinfra logo
04/05/2025
131K
0.2s
67tps
$0.17/M$0.66/M
bedrock logo
deepinfra logo
groq logo
04/05/2025
128K
0.1s
191tps
$0.59/M$0.72/M
bedrock logo
groq logo
12/06/2024
128K
0.3s
63tps
$0.72/M$0.72/M
bedrock logo
09/25/2024
128K
0.3s
53tps
$0.15/M$0.15/M
bedrock logo
09/18/2024
131K
0.1s
65tps
$0.10/M$0.10/M
Read:$0.1/M
Write:
bedrock logo
cerebras logo
deepinfra logo
+2
07/23/2024