AI SDK streaming chat completions from a FastAPI Python Vercel Function.
This template demonstrates the usage of Data Stream Protocol to stream chat completions from a Python endpoint (FastAPI) and display them using the useChat hook in your Next.js application.
Run create-next-app
with npm, Yarn, or pnpm to bootstrap the example:
npx create-next-app --example https://github.com/vercel-labs/ai-sdk-preview-python-streaming ai-sdk-preview-python-streaming-example
yarn create next-app --example https://github.com/vercel-labs/ai-sdk-preview-python-streaming ai-sdk-preview-python-streaming-example
pnpm create next-app --example https://github.com/vercel-labs/ai-sdk-preview-python-streaming ai-sdk-preview-python-streaming-example
To run the example locally you need to:
.env.example
file, but in a new file called .env
.pnpm install
to install the required Node dependencies.virtualenv venv
to create a virtual environment.source venv/bin/activate
to activate the virtual environment.pip install -r requirements.txt
to install the required Python dependencies.pnpm dev
to launch the development server.To learn more about the AI SDK or Next.js by Vercel, take a look at the following resources:
AI SDK streaming chat completions from a FastAPI Python Vercel Function.
This template demonstrates the usage of Data Stream Protocol to stream chat completions from a Python endpoint (FastAPI) and display them using the useChat hook in your Next.js application.
Run create-next-app
with npm, Yarn, or pnpm to bootstrap the example:
npx create-next-app --example https://github.com/vercel-labs/ai-sdk-preview-python-streaming ai-sdk-preview-python-streaming-example
yarn create next-app --example https://github.com/vercel-labs/ai-sdk-preview-python-streaming ai-sdk-preview-python-streaming-example
pnpm create next-app --example https://github.com/vercel-labs/ai-sdk-preview-python-streaming ai-sdk-preview-python-streaming-example
To run the example locally you need to:
.env.example
file, but in a new file called .env
.pnpm install
to install the required Node dependencies.virtualenv venv
to create a virtual environment.source venv/bin/activate
to activate the virtual environment.pip install -r requirements.txt
to install the required Python dependencies.pnpm dev
to launch the development server.To learn more about the AI SDK or Next.js by Vercel, take a look at the following resources: