Skip to content
OpenAI

Whisper

Whisper is OpenAI's general-purpose speech recognition model, trained on 680,000 hours of multilingual audio and able to transcribe speech, translate it to English, and identify languages as a single multitask model.

translationTranscription
index.ts
import { experimental_transcribe as transcribe } from 'ai';
import { gateway } from '@ai-sdk/gateway';
import { readFile } from 'node:fs/promises';


const result = await transcribe({
  model: gateway.transcriptionModel('openai/whisper-1'),
  audio: await readFile('audio.mp3'),
});
OverviewAboutProvidersSimilarFAQ

About Whisper

OpenAI released Whisper as an open-source speech recognition system in September 2022, trained on 680,000 hours of multilingual and multitask supervised data collected from the web. That scale and diversity made Whisper robust to accents, background noise, and technical language. The hosted API model, Whisper, arrived on September 21, 2022 alongside the GPT-3.5 Turbo API, serving the large-v2 weights through a managed endpoint.

Whisper is a multitask model. Beyond multilingual transcription, Whisper performs speech translation into English and language identification, so one model covers the common speech workflows without separate systems.

Because the underlying model is open source, Whisper became the reference point for speech-to-text across the industry. Teams that run open-source Whisper locally can use Whisper through AI Gateway for the hosted path, keeping output behavior familiar while gaining unified authentication, observability, and spend controls.