Benchmark report

Task verified

5m 30s elapsed

The saved attempt met the documented success criterion.

Experience score

96/ 100

Agent-Ready
  • SInstall
  • SAuth
  • SExecute
  • ADocs
  • SCurrent
Experience measures friction in the tested task. The verdict says whether it succeeded.
Agent profile for this run: Install S, Auth S, Execute S, Docs A, Current SSInstallSAuthSExecuteADocsSCurrent
Agent profile · this run
Judge's note · what slowed the agent most
The undocumented-in-plan org_id requirement on GET /projects cost two extra calls; a self-inflicted jq quoting error in 06_cleanup.sh forced one rerun of the last check.

Where the time went

5:31 agent time
  • Research0:25
  • Attempt3:23
  • Verify1:42
5m 30sTotal elapsed
1:55Time to first success
0:00Waited on the owner

Judge reason

Saved code + live responses support every criterion. 01_create_project.json shows real project green-cloud-38058875 (tpcbench-20261105215419-16475) in org-damp-hall-96875961; 02_seed_parent.txt shows CREATE TABLE/INSERT 0 2 on parent main via psql. 03_create_branch.sh calls the documented branch API POST /projects/{id}/branches and 03_create_branch.json returns parent_id br-damp-sky-bbkv2ja6 + parent_lsn 0/19703D8 (copy-on-write branch, not a copy); 04_migrate_branch.txt shows the branch reading 2 inherited rows before any write, then ALTER TABLE ADD COLUMN note and INSERT 0 1, so no non-inheritance citation was needed. 05_verify.txt shows parent columns id,name, has_note_column=f, row_count=2 and branch columns id,name,note, has_note_column=t, row_count=3 (row 3 gamma/branch-only row). conn.sh strips the API query string and forces sslmode=verify-full&sslrootcert=system; all three psql connects succeeded with that URI (pg_stat_ssl ssl=f behind the pooler is expected and explicitly allowed). Cleanup: DELETE branch -> suspend_compute/delete_timeline ops, GET -> 'branch not found', branch list shows only main; DELETE project -> project object returned, GET -> 'project not found', org list deleted_project_present:false, remaining_tpcbench:[]. Responses are scrubbed by a jq redactor; a grep of all saved files found no password, connection URI or API key (only [REDACTED_USER:REDACTED_PASSWORD] twins), and the key was read from /tmp/neon-private at call time only.

Attempt record

  1. 0:36Answered from saved key: NEON_API_KEYno wait
  2. —First success verified

Attempt artifacts saved.