Skip to content

Llama 3.3 70B Instruct

Llama 3.3 70B Instruct is Meta's refined text-only model. It targets 405B-class results at 70B serving cost, with improved instruction following and multilingual capability.

Tool Use
index.ts
import { streamText } from 'ai'


const result = streamText({
  model: 'meta/llama-3.3-70b',
  prompt: 'Why is the sky blue?'
})
OverviewAboutProvidersThroughputLatencyUptimeStatusSimilarFAQ

Providers

Route requests across multiple providers. Copy a provider slug to set your preference. Visit the docs for more info. Using a provider means you agree to their terms, listed under Legal.

Provider
Context
Latency
Throughput
Input
Output
Cache
Web Search
Per Query
Capabilities
ZDR
No Training
Release Date
Amazon Bedrock
128K
0.2s
167tps
$0.72/M$0.72/M——
12/06/2024
Groq
128K
0.2s
169tps
$0.59/M$0.79/M——
12/06/2024