For AI agent teams

AgentLasso

Continuous behavioral coverage for AI agents

Discover what your agent actually does in production, identify what you're not testing, turn real behavior into golden tests, and prevent regressions before they ship.

The problem

AI agents are non-deterministic

Traditional software has unit tests. But when you tweak a system prompt to fix a login bug, you risk silently breaking ten other capabilities. Maintaining a golden dataset by hand takes hundreds of hours engineering teams don't have.

The solution

Production-led evaluation

AgentLasso.dev turns your production logs into a continuous testing suite — with zero machine learning knowledge required. We map your agent's code, capture real-world edge cases from live users, and auto-generate comprehensive testing rubrics.

Key platform modules

Semantic Layer & Intent Registry

  • Auto-discovery: our CLI scans system prompts and tool schemas to reverse-engineer what your agent can do.
  • Live health dashboard for routing accuracy and technical trigger mapping.
  • Drift and mismatch alerts when the agent hallucinates tools.

Collaborative Dataset Studio

  • Google Docs for AI behavior — PMs, QA and developers refine test data together.
  • Human-in-the-loop queue turns a live complaint into a golden test case in one click.
  • No-code rubric builder for guardrails, tool validation and negative constraints.

Coverage Gaps & Offline Testing

  • Adversarial generation flags untested instructions and injects 5 targeted edge cases.
  • CI/CD regression pipeline drops straight into GitHub Actions.
  • Every pull request measured against your golden dataset before merge.

Integration in 3 simple steps

1

Get your API key

Sign up and create a project. Your project's API key is in Settings.

export AGENTLASSO_API_KEY="<your-api-key>"
Quickstart
2

Send traces

One JSON object per request your agent handles. No SDK needed, or point your OpenTelemetry exporter at the same endpoint.

curl -X POST https://agentlasso.dev/api/v1/telemetry \
  -H "x-api-key: $AGENTLASSO_API_KEY" \
  -H "Content-Type: application/json" \
  -d '{"user_input": "Refund order 44182",
       "agent_output": "Refund issued.",
       "tool_calls": [{"name": "stripe.refund"}]}'
Send traces
3

Gate releases in CI

Run your golden tests on every pull request and fail the build when your agent regresses.

- name: Run AgentLasso golden tests
  env:
    AGENTLASSO_API_KEY: ${{ secrets.AGENTLASSO_API_KEY }}
    AGENTLASSO_CAPABILITIES: process_refund  # optional; empty = every test
  run: node scripts/run-eval.mjs
CI guide

Simple, predictable pricing

Hacker

$0

Free forever

Perfect for developers building side projects.

  • 1 connected agent
  • 5,000 production traces / mo
  • 100 offline evaluation runs / mo
  • Auto-discovered Intent Registry
  • 1 user seat
Start free

Startup

Popular

$79

per month

For small engineering teams with an agent in production.

  • 3 connected agents
  • 100,000 production traces / mo
  • 2,500 offline evaluation runs / mo
  • Full collaborative Dataset Studio
  • Human-in-the-loop review queue
  • Up to 5 user seats
Start free

Growth

$299

per month

For scaling AI startups demanding deep regression testing.

  • 10 connected agents
  • 500,000 production traces / mo
  • 10,000 offline evaluation runs / mo
  • AI-generated evaluation strategies
  • Coverage gap detection & synthetic injection
  • Up to 15 user seats
Start free

Enterprise

Custom

talk to us

For organizations with strict security and massive telemetry scale.

  • Unlimited agents
  • Multi-million trace ingestion
  • Bring-your-own-key (BYOK) toggle
  • SSO & SAML integration
  • Data masking & PII redaction
  • VPC / private cloud deployment
Contact sales

Security built for the enterprise

Agent data is highly sensitive. AgentLasso.dev runs on a secure PostgreSQL architecture with row-level security, strict data isolation, and comprehensive PII scrubbing so user logs stay private.

Start evaluating for free