What if I set max_tokens higher than the model allows?
max_tokens is capped per model. The caps listed by GET /v1/models (max_output_tokens) are 32,768 tokens for Flash and Max and 49,152 for Heavy, and a reply can't be longer than that whatever you ask for. Plan long outputs in parts.
Good to know#
- Every response has an
X-Request-Id; log it so a request can be found later. Why log it - New accounts get $5 of free credit; top up from $1 to $800 per purchase in Console › Billing › Credits. Billing
- Model ids:
supercosmos-flash,supercosmos-max,supercosmos-heavy(SuperCosmos 1.1). Which to call
Still need help?#
- General support: support@clatterlabs.com or team@clatterlabs.xyz
- Infrastructure questions, or permanent deletion of your data (your whole account or one service): infrastructure@clatterlabs.xyz
We usually reply within the first hour, and always within 24 hours. A full support team is with you.
Related articles
Still need help?
Tried the steps above and still stuck? Email us. We usually reply within the first hour, and always within 24 hours. A full support team is with you.
Infrastructure questions, or permanent deletion of your data
infrastructure@clatterlabs.xyzFor deleting your whole account or the data of one service.