How do I get token usage when streaming in Python?

Ask for usage with stream_options. The last chunk then has usage and an empty choices list.

import os
from openai import OpenAI

client = OpenAI(
    base_url="https://api.gateway.clatterlabs.xyz/v1",
    api_key=os.environ["CLATTER_API_KEY"],
    default_headers={"X-Clatter-Account": os.environ["CLATTER_ACCOUNT_ID"]},
)

stream = client.chat.completions.create(
    model="supercosmos-max",
    messages=[{"role": "user", "content": "Give me three names for a cat."}],
    stream=True,
    stream_options={"include_usage": True},
)
usage = None
for chunk in stream:
    if chunk.choices and chunk.choices[0].delta.content:
        print(chunk.choices[0].delta.content, end="")
    if chunk.usage:
        usage = chunk.usage
print("\n", usage)

The docs also note the last content chunk carries usage. completion_tokens includes reasoning tokens on Max and Heavy, and it's what you're billed for.

The client setup above (base URL, key and the X-Clatter-Account header) is the same in every Python example; see Set up the Python SDK. Full parameter list: Create a chat completion.

Good to know#

• Model ids: supercosmos-flash, supercosmos-max, supercosmos-heavy (SuperCosmos 1.1). Which to call
• New accounts get $5 of free credit; top up from $1 to $800 per purchase in Console › Billing › Credits. Billing
• Every call shows in Console › Logs and Usage as Model API, with its price. See what you spent

Still need help?#

• General support: support@clatterlabs.com or team@clatterlabs.xyz
• Infrastructure questions, or permanent deletion of your data (your whole account or one service): infrastructure@clatterlabs.xyz

We usually reply within the first hour, and always within 24 hours. A full support team is with you.