Skip to content

Llama 3.1 70B Instruct

Llama 3.1 70B Instruct introduced context of 131.1K tokens, eight-language multilingual support, and trained tool-use capability to the open 70B parameter class. This release defined Meta's approach to open frontier models.

Tool Use
index.ts
import { streamText } from 'ai'


const result = streamText({
  model: 'meta/llama-3.1-70b',
  prompt: 'Why is the sky blue?'
})
OverviewAboutProvidersThroughputLatencyUptimeStatusSimilarFAQ

Providers

Route requests across multiple providers. Copy a provider slug to set your preference. Visit the docs for more info. Using a provider means you agree to their terms, listed under Legal.

Provider
Context
Latency
Throughput
Input
Output
Cache
Web Search
Per Query
Capabilities
ZDR
No Training
Release Date
Amazon Bedrock
128K
0.4s
32tps
$0.72/M$0.72/M——
07/23/2024
DeepInfra
131K
0.4s
35tps
$0.40/M$0.40/M——
07/23/2024