Benchmark report

Task verified

14m 31s elapsed

The saved attempt met the documented success criterion.

Experience score

91/ 100

Agent-Ready
  • SInstall
  • AAuth
  • SExecute
  • SDocs
  • ACurrent
Experience measures friction in the tested task. The verdict says whether it succeeded.
Agent profile for this run: Install S, Auth A, Execute S, Docs S, Current ASInstallAAuthSExecuteSDocsACurrent
Agent profile · this run
Judge's note · what slowed the agent most
Function log indexing lag: the marker line only appeared ~6 minutes after the request, after the documented --follow stream failed with a permissions error.

Where the time went

14:31 agent time
  • Research0:34
  • Attempt11:27
  • Verify2:30
14m 31sTotal elapsed
9:25Time to first success
0:00Waited on the owner

Judge reason

Saved evidence supports every criterion. netlify sites:create made tpcbench-426e239234db (evidence/01) and `netlify deploy --prod --no-build` shipped marker.mts, which logs TPC_MARKER_LOG marker=<x-tpc-marker> (code/marker.mts, evidence/03). One request to https://tpcbench-426e239234db.netlify.app/marker with x-tpc-marker: tpc-426e239234db-cd53301b returned 200 and x-nf-request-id 01M70BX28N0KX0JDBQ9NQKTGGX (evidence/08). The documented CLI call `netlify logs --source functions --function marker --since 30m --json` returned the line {"timestamp":"2026-11-09T14:37:55.021Z",...,"message":"TPC_MARKER_LOG marker=tpc-426e239234db-cd53301b"} (transcript call 33, evidence/13, 14), cross-checked against the analytics function_logs API whose record carries the same netlify_request_id as the marked request (evidence/raw-logs.json). Retention needed no action and the saved docs page confirms >=24h default. sites:delete --force succeeded; the final fetch returned HTTP 404 Netlify site-not-found (evidence/16), GET /api/v1/sites -> [] and GET /sites/{id} -> 404 (evidence/17,18). No PAT appears in any saved file (only site-object digests and a deploy skew_protection_token from the API response); the only Bearer string is netlify-cli's hard-coded local-dev dummy JWT. Work was CLI/API only, no dashboard. Marker retrieval took ~6 min of polling rather than the ~60s allowance, but that is product indexing lag, not a criterion.

Attempt record

  1. 0:58Answered from saved key: Netlify personal access tokenno wait
  2. —First success verified

Attempt artifacts saved.