How do I get structured JSON back from a run?

output is free text, so ask for structure explicitly:

"When done, save a file named result.json as an output with this shape: {"tests_passed": number, "tests_failed": number, "notes": string}. Reply with only 'done'."

Then read it:

run = requests.get(f"{BASE}/v1/runs/{run_id}?include=files", headers=headers).json()
result = json.loads(next(f["content"] for f in run["files"] if f["name"] == "result.json"))

Validate the JSON in your code: treat it like any untrusted input.

Learn more#

• Your first real run
• Create a run