Llama 3.1 70B Instruct
Llama 3.1 70B Instruct introduced context of 131.1K tokens, eight-language multilingual support, and trained tool-use capability to the open 70B parameter class. This release defined Meta's approach to open frontier models.
Tool Use
index.ts
import { streamText } from 'ai'
const result = streamText({ model: 'meta/llama-3.1-70b', prompt: 'Why is the sky blue?'})More models by Meta
| Model |
|---|
| 131K | 0.2s | 155tps | $0.24/M | $0.97/M | — | — |   | 04/05/2025 | |||||
| 131K | 0.2s | 187tps | $0.17/M | $0.66/M | — | — |  | 04/05/2025 | |||||
| 128K | 0.2s | 157tps | $0.59/M | $0.72/M | — | — | | 12/06/2024 | |||||
| 128K | 0.3s | 53tps | $0.15/M | $0.15/M | — | — | | 09/18/2024 | |||||
| 128K | 0.2s | 86tps | $0.10/M | $0.10/M | — | — | | 09/18/2024 | |||||
| 131K | 0.1s | 54tps | $0.10/M | $0.10/M | Read:$0.1/M Write:— | — | — |  +2 | 07/23/2024 |
