Skip to content

Llama 3.2 1B Instruct

Llama 3.2 1B Instruct is Meta's smallest openly available model, with a context window of 128K tokens. It delivers text generation, summarization, and tool calling with minimal memory and compute requirements.

index.ts
import { streamText } from 'ai'


const result = streamText({
  model: 'meta/llama-3.2-1b',
  prompt: 'Why is the sky blue?'
})
OverviewAboutProvidersThroughputLatencyUptimeStatusSimilarFAQ

Providers

Route requests across multiple providers. Copy a provider slug to set your preference. Visit the docs for more info. Using a provider means you agree to their terms, listed under Legal.

Provider
Context
Latency
Throughput
Input
Output
Cache
Web Search
Per Query
Capabilities
ZDR
No Training
Release Date
Amazon Bedrock
128K
0.2s
90tps
$0.10/M$0.10/M——
09/25/2024