Calibrate Frontend

Frontend for Calibrate, a framework for evaluating AI agents which let you move from slow, manual testing to a fast, automated, and repeatable testing process for your entire agent stack.

Prerequisites

• Node.js 18+
• npm

Setup

Install dependencies

npm install

Configure environment variables

Copy env.example to .env.local and fill in the values:

cp env.example .env.local

Running the App

npm run dev

Open http://localhost:3000 in your browser.

Build for Production

npm run build
npm start

Testing

Coverage is measured in two independent layers, reported separately on Codecov (the component and e2e flags / badges above):

• Component / interaction tests — Jest (jsdom) + React Testing Library, in src/**/__tests__/. Fast, no backend.
• End-to-end tests — Playwright, in e2e/. Split into public (no backend) and authenticated (*.auth.spec.ts, needs the backend on :8000). See e2e/README.md.

npm test                               # component tests (Jest)
npm run test:coverage                  # component coverage -> coverage/component/
npm run test:e2e                       # public E2E (Playwright, no backend)
npm run test:e2e:integration           # authenticated E2E (needs backend)
npm run test:e2e:coverage              # public E2E coverage -> coverage/e2e/
npm run coverage                       # component + public E2E coverage

Self-hosting

To deploy your own instance of Calibrate's frontend, see SELF_HOSTING.md.

Contributing

Calibrate also includes a backend and CLI.

Reference docs:

• Architecture diagram

License

This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.