MAI-Transcribe-2-Streaming

MAI-Transcribe-2-Streaming is a low-latency, "speech in, text out" realtime transcription API. Audio can be sent to the model as a continuous stream over a WebSocket connection and transcripts are returned incrementally as the speaker talks, with no need to wait for the utterance to finish. Intermediate results (aka Partials) update the current transcription; final results confirm a segment. Your use is subject to Microsoft AI's Terms & Privacy Policies.

Price: $0.54, Per hour of audio

Get API key Read the docs

import { experimental_streamTranscribe as streamTranscribe } from 'ai';
import { createGateway, gateway } from '@ai-sdk/gateway';
import { readFile } from 'node:fs/promises';

const modelId = 'microsoft/mai-transcribe-2-streaming';

// Mint this on your server, then send only the short-lived token to the client.
const { token } = await gateway.experimental_transcription.getToken({
  model: modelId,
});
const clientGateway = createGateway({ apiKey: token });

// Raw 24 kHz, 16-bit signed little-endian mono PCM audio.
const bytes = await readFile('audio.pcm');
const audio = new ReadableStream<Uint8Array>({
  start(controller) {
    controller.enqueue(new Uint8Array(bytes));
    controller.close();
  },
});

const result = streamTranscribe({
  model: clientGateway.transcription(modelId),
  audio,
  inputAudioFormat: { type: 'audio/pcm', rate: 24000 },
});

for await (const part of result.fullStream) {
  if (part.type === 'transcript-delta') {
    process.stdout.write(part.delta);
  }
}

console.log('\nFinal:', await result.text);

Read docs

Overview Playground Providers Similar

Copy link to headingPlayground

Try out MAI-Transcribe-2-Streaming by Microsoft AI. Usage is billed to your team at API rates. Free users (those who haven't made a payment) get $5 of credits every 30 days.

MAI-Transcribe-2-Streaming

Live transcription

Speak into your microphone and watch the transcript appear in real time.

Idle

Start the session and begin speaking to see the transcript.

Copy link to headingProviders

Route requests across multiple providers. Copy a provider slug to set your preference. Visit the docs for more info. Using a provider means you agree to their terms, listed under Legal.

Checking availability for your team