Skip to main content

TrainLoop Evals

Comprehensive LLM evaluation framework for developers

🚀

Simplicity First

One environment variable, one function call, one folder of JSON files. Get started with LLM evaluation in minutes, not hours.

🔧

Vendor Independent

Everything stored as newline-delimited JSON with no databases required. Works with any LLM provider and integrates with your existing infrastructure.

Type-Safe & Extensible

In-code tests with full TypeScript support. Composable system with helper generators that mimic shadcn patterns.