Control AI crawlers and assistants separately in Vercel Firewall

You can now log or block requests from AI crawlers and AI assistants separately with the AI Bots managed ruleset in Vercel Firewall.

• AI crawlers: bots that collect content for indexing and model training

• AI assistants: bots that fetch pages in response to user actions or search queries

For example, you can block AI crawlers while allowing AI assistants to retrieve your content to answer users’ questions. Vercel updates the rules as new bots are added.

To configure these controls, open your project’s Security > Firewall > Rules. Under Bot Management, enable AI Bots and select the gear icon beside it. Set an action for AI crawlers and AI assistants, then review and publish your changes.

You can also modify these rule settings using the Vercel CLI:

vercel firewall rules edit ai-bots --category ai-crawlers --action deny --yes
vercel firewall rules edit ai-bots --category ai-assistants --action log --yes

Review the changes with vercel firewall diff, then apply them with vercel firewall publish.

The AI Bots managed ruleset is available on all plans. Learn more in the documentation.