Benchmark report
Task verified
5m 53s elapsed
The saved attempt met the documented success criterion.
100/ 100
Agent-Ready- SInstall
- SAuth
- SExecute
- SDocs
- SCurrent
Only the sandbox's PEP 668 pip block (one venv retry) and a self-inflicted redaction bug that mangled a saved raw_body, prompting a second confirming run.
Where the time went
5:53 agent time- Research0:33
- Attempt3:44
- Verify1:36
Judge reason
Saved code (code/run_task.py) creates the session via the documented POST https://api.browser-use.com/api/v4/browsers with the X-Browser-Use-API-Key header only (never in a URL); artifacts/session_create_response.json shows HTTP 201 with id a0c90ee3-3d05-4d8a-8880-a46390b2dfa0 and cdpUrl https://a0c90ee3-....cdp.browser-use.com. Playwright connect_over_cdp (key passed via headers=) connected to remote Chromium 156.0.8078.79, loaded https://httpbin.org/forms/post, filled and submitted the form; artifacts/httpbin_echo.json and the printed JSON in run_output.txt match byte-for-byte with form.custname 'Benchmark Test' and form.custtel '555-0100', url https://httpbin.org/post, remote origin 66.93.138.147 and a macOS Chrome UA (not the local box). Termination ran in the finally block: PATCH /api/v4/browsers/{id} {"action":"stop"} -> HTTP 200, status 'stopped', finishedAt set (artifacts/session_stop_response.json). A second independent run (verification_run, session c20b60ef..., different egress IP 66.93.142.97, Windows UA) reproduces all of it with a byte-faithful raw_body. No AI agent/task API used; an independent scan of all saved files found no credential (only X-Request-Id hashes and session UUIDs).
Attempt record
- 1:51Answered from saved key: Browser Use Cloud API keyno wait
- —First success verified
Attempt artifacts saved.