Skip to content
OpenAI

Whisper

Whisper is OpenAI's general-purpose speech recognition model, trained on 680,000 hours of multilingual audio and able to transcribe speech, translate it to English, and identify languages as a single multitask model.

translationTranscription
index.ts
import { experimental_transcribe as transcribe } from 'ai';
import { gateway } from '@ai-sdk/gateway';
import { readFile } from 'node:fs/promises';


const result = await transcribe({
  model: gateway.transcriptionModel('openai/whisper-1'),
  audio: await readFile('audio.mp3'),
});
OverviewAboutProvidersSimilarFAQ

Frequently Asked Questions

  • How do I access Whisper through AI Gateway?

    Use the AI SDK's transcribe function from the ai package with this model's slug, passing audio as a file buffer, base64 string, or URL. Audio support on AI Gateway is in beta. Authenticate with an AI Gateway API key or OIDC token.

  • What tasks can Whisper perform beyond transcription?

    Whisper is a multitask model: multilingual speech recognition, speech translation into English, and language identification. That breadth is what distinguishes Whisper from single-purpose transcription models.

  • Is Whisper the same as open-source Whisper?

    Whisper serves OpenAI's large-v2 Whisper weights through a hosted endpoint. Teams running open-source Whisper can expect familiar transcription behavior from the managed model.

  • How does Whisper compare to gpt-4o-transcribe?

    GPT-4o Transcribe and GPT-4o mini Transcribe improve word error rate and language recognition over the original Whisper models. Whisper counters with multitask coverage, translation and language identification, and duration-based pricing.

  • How is Whisper priced?

    Transcription is billed by audio duration. Current rates are listed on this page and update when providers change list prices.

  • Does Whisper support zero data retention through AI Gateway?

    Zero Data Retention is not currently available for this model. Zero Data Retention is offered on a per-provider basis. See https://vercel.com/docs/ai-gateway/capabilities/zdr for details.

  • What are typical latency characteristics?

    This page shows live performance metrics measured across real AI Gateway traffic.