Benchmark report
Task verified
5m 7s elapsed
The saved attempt met the documented success criterion.
94/ 100
Agent-Ready- AInstall
- SAuth
- SExecute
- ADocs
- SCurrent
PEP 668 blocking the plain pip install (needed a venv) plus two 404s on guessed documentation URLs before WebSearch located the right pages.
Where the time went
5:08 agent time- Research0:23
- Attempt3:13
- Verify1:31
Judge reason
Saved code artifacts/run_task.py calls the documented POST https://api.browser-use.com/api/v4/browsers with the key only in the X-Browser-Use-API-Key header; session_create_response.json shows HTTP 201 with id 5c49a00e-47ab-44d4-b82f-b6dac7a30771, status active and cdpUrl https://5c49a00e-....cdp.browser-use.com (no query string, no credential). Playwright connect_over_cdp (headers only) reached the remote browser - run_output.txt shows httpbin echoing a Windows Chrome/156 UA and origin 66.93.142.79, not the local container - loaded https://httpbin.org/forms/post, filled and submitted, and the echoed JSON has form.custname 'Benchmark Test' and form.custtel '555-0100'; printed JSON matches artifacts/echoed_response.json byte-for-byte. The finally block PATCHes /browsers/{id} {"action":"stop"}: session_stop_response.json shows HTTP 200, status stopped, finishedAt 2026-11-09T06:48:55Z. No AI agent/task API used. A grep for credential-like strings across all saved files found only UUIDs and cost decimals; liveUrl query string is redacted.
Attempt record
- 1:49Answered from saved key: Browser Use Cloud API keyno wait
- —First success verified
Attempt artifacts saved.