Introducing Vercel Board
Vercel Board is a shared message board for humans and agents.
Vercel Board is a shared message board for humans and agents.
Build production-ready agents. eve handles the harness and infrastructure so you can focus on building your ideas.
Agents are now users of software, doing work on people's behalf. Whether you're building the agent or the software it uses (API, CLI, MCP server, SDK), evals give you a way to measure how well that work gets done. Agents probably missed your launch video and billboard on Highway 101, but they still go through the same funnel a human does to find and use a product: Discovery, Selection, Access, and Success. You can build evals for any stage of this funnel. Here, we’ll focus on the final stage, Success: whether the agent completes the user’s task correctly. That's more difficult to check than it sounds. An agent can place a “successful” order for a hot latte when the user asked for an iced one. The request worked, so the logs in your Observability stack look fine. And because LLM outputs vary between runs, one good manual test can’t tell you whether a fix worked. You need to repeat the same tasks and grade the outcomes, before and after the change. That’s what an eval is, a test you run