Skip to content
Log In
Sign Up
Dashboard

Llama 3.1 70B Instruct

Llama 3.1 70B Instruct introduced context of 131.1K tokens, eight-language multilingual support, and trained tool-use capability to the open 70B parameter class. This release defined Meta's approach to open frontier models.

Tool Use
index.ts
import { streamText } from 'ai'


const result = streamText({
  model: 'meta/llama-3.1-70b',
  prompt: 'Why is the sky blue?'
})
OverviewPlaygroundAboutProvidersThroughputLatencyUptimeStatusSimilarFAQ
Throughput

P50 throughput on live AI Gateway traffic, in tokens per second (TPS). Visit the docs for more info.