Jetty
ExtensionGrade agent turns, compare experiments, and store durable evaluation trajectories.
Install
Install the Jetty extension for eve:
The extension requires Node.js 24 or later and eve 0.25 or later. It can ingest every completed turn as a durable Jetty trajectory, grade turns inline, steer experiments from their grades, and report native eve eval results.
Quick start
Add your Jetty credentials and collection to the agent's environment:
Then mount the extension under agent/extensions/:
The filename supplies the jetty namespace. The extension contributes a turn-ingestion hook, dynamic instructions that select an experiment arm, and jetty__experiment, which reports per-arm results and the current leader. Create the simple_judge task in Jetty before using inline grading; use the default ingest mode when a separate grader will score trajectories later.
Configure
The package also includes a reporter for eve's native eval runner:
The reporter reads JETTY_API_TOKEN and JETTY_COLLECTION, sends each eval result to Jetty, and warns rather than failing the eval when Jetty is unavailable. The extension no-ops when its collection is empty, so the same agent can run without Jetty credentials.
Jetty trajectories persist agent inputs and outputs. Redact PII before grading, put sensitive grader parameters in Jetty's secretParams rather than initParams, and treat trajectory storage like any other logging surface. See the Jetty eve extension documentation for all experiment settings and the worked example for the complete grading loop.