Private beta open for teams shipping AI agents.·See it catch a reward-hack

← All posts

Product2 min read

Shipworthy: the certified release gate for AI agents

SHIP / LIMIT / BLOCK verdicts on every agent update, from a judge-free deterministic core — now in private beta.

By Verifiable Labs

Every agent update — a prompt tweak, a model swap, a new tool — can quietly regress or quietly game its own evals. Shipworthy is our answer: a release gate that re-grades each candidate update beyond its visible tests and returns a decision you can act on.

What ships today

  • SHIP / LIMIT / BLOCK release gates on every agent update
  • Gameability certificates for your verifier
  • Reward-hacking audits of agent trajectories
  • An agent release control plane: registry, versions, releases, and approvals
  • A live API and dashboard

A judge-free, deterministic core

The gate's verdict comes from re-grading and rule scans, not from asking a model for its opinion. That makes it deterministic run to run, and cheap: 0 model calls per scan. In our own CI benchmark, serial latency was 166.5 ms p50; throughput reached 74.3 scans/s only with 64-way concurrency.

0MODEL CALLS PER SCAN
166.5msSERIAL P50, OWN RUN
3VERDICTS: SHIP / LIMIT / BLOCK
vlabs · runtime benchmark — ~0.17s p50 · 100/100 identical replays · 0 model calls

Where we are

Shipworthy is in private beta. The design-partner program is open for teams shipping agents today. We won't show you customer logos we don't have — what we have is a working gate you can run against your own agent, and we'd like your feedback on it.