Whisper
Whisper is OpenAI's general-purpose speech recognition model, trained on 680,000 hours of multilingual audio and able to transcribe speech, translate it to English, and identify languages as a single multitask model.
translationTranscription
index.ts
import { experimental_transcribe as transcribe } from 'ai';import { gateway } from '@ai-sdk/gateway';import { readFile } from 'node:fs/promises';
const result = await transcribe({ model: gateway.transcriptionModel('openai/whisper-1'), audio: await readFile('audio.mp3'),});More models by OpenAI
| Model |
|---|