Benchmark report

Task verified

5m 14s elapsed

The saved attempt met the documented success criterion.

Experience score

98/ 100

Agent-Ready
  • AInstall
  • SAuth
  • SExecute
  • SDocs
  • SCurrent
Experience measures friction in the tested task. The verdict says whether it succeeded.
Agent profile for this run: Install A, Auth S, Execute S, Docs S, Current SAInstallSAuthSExecuteSDocsSCurrent
Agent profile · this run
Judge's note · what slowed the agent most
The PEP 668 externally-managed-environment block on pip install, costing one extra step to create a venv before the libsql-client driver was usable.

Where the time went

5:14 agent time
  • Research0:25
  • Attempt3:26
  • Verify1:23
5m 14sTotal elapsed
2:06Time to first success
0:00Waited on the owner

Judge reason

Saved code and raw responses prove the full lifecycle against the real Turso Platform API (api.turso.tech). 03_create_database.json: POST /v1/organizations/rickchen/databases -> 200 with Name tpcbench-cc409ead64, DbId 01a1ad6c-e401-7671-959b-d9bf45ab47a1; 04_retrieve_database.json confirms readiness with Hostname and primaryRegion aws-ap-northeast-1. A scoped DB token was minted via POST .../auth/tokens -> 200 (jwt redacted in the artifact). 04_connect_select1.py uses the stock PyPI libsql-client over the https:// libsql TLS URL; transcript idx 51 shows live runtime output 'TLS: TLSv1.3 TLS_AES_128_GCM_SHA256 verified against system CAs', 'SELECT 1 rows: [[1]]', sqlite_version 3.47.0, with ssl.create_default_context (CERT_REQUIRED, check_hostname=True) recorded in 06_connect_select1.json. Cleanup: DELETE -> 200 {"database":"tpcbench-cc409ead64"} (07), follow-up GET -> 404 'record not found' (08), and a list showing the name absent (09). No mocks or hard-coded responses; a leak scan ran and no token, password, or password-bearing connection string appears in any saved file (create response password field is empty).

Attempt record

  1. 0:52Answered from saved key: TURSO_API_TOKENno wait
  2. —First success verified

Attempt artifacts saved.