GPT-4o mini Transcribe
GPT-4o mini Transcribe is a speech-to-text model built on the GPT-4o mini architecture, delivering lower word error rates and better language recognition than the original Whisper models at the cost-efficient end of OpenAI's transcription lineup.
import { experimental_transcribe as transcribe } from 'ai';import { gateway } from '@ai-sdk/gateway';import { readFile } from 'node:fs/promises';
const result = await transcribe({ model: gateway.transcriptionModel('openai/gpt-4o-mini-transcribe'), audio: await readFile('audio.mp3'),});About GPT-4o mini Transcribe
GPT-4o mini Transcribe launched on March 13, 2024 as part of OpenAI's next-generation audio models for the API. The model builds on the GPT-4o mini architecture and was pretrained on specialized audio-centric datasets. OpenAI used enhanced distillation techniques to transfer knowledge from larger audio models into this smaller one.
Compared to the original Whisper models, GPT-4o mini Transcribe improves word error rate and language recognition. OpenAI attributes the gains to reinforcement learning work and midtraining on diverse, high-quality audio data. The improvements show up most in difficult conditions: accents, noisy environments, and varying speech speeds.
Through AI Gateway, GPT-4o mini Transcribe handles transcription jobs behind the same authentication, observability, and spend controls as your text models. Send audio with the AI SDK's transcribe function and get back the transcript, plus segments and language metadata where available.