What does model_overloaded mean?
The model is at capacity for a moment. Your request was fine; try again shortly.
Code: model_overloaded · HTTP status: 502, 503 or 504
Sent as a 5xx error, usually 503, sometimes with Retry-After.
Common causes#
- a short spike in traffic
How to fix it#
- Retry with exponential backoff, honouring
Retry-Afterwhen it's sent. - Keep retries bounded (for example up to 5 attempts).
- If it lasts, check status.clatterlabs.com.
Should my code retry?#
Retryable with backoff.
The error body uses the OpenAI shape, so OpenAI SDKs raise it as an exception you can catch:
{"error": {"message": "...", "type": "...", "code": "model_overloaded", "param": null}}
Every response also carries an X-Request-Id. Keep it in your logs; it's the quickest way for support to find a request.
See the full list in the Model API reference.
Good to know#
- New accounts get $5 of free credit; top up from $1 to $800 per purchase in Console › Billing › Credits. Billing
- Keep keys on your server, never in a browser or mobile app. Why
- Each key has its own limit: 10, 30 (default), 60 or 120 requests per minute. Rate limits
Still need help?#
- General support: support@clatterlabs.com or team@clatterlabs.xyz
- Infrastructure questions, or permanent deletion of your data (your whole account or one service): infrastructure@clatterlabs.xyz
We usually reply within the first hour, and always within 24 hours. A full support team is with you.
Related articles
Still need help?
Tried the steps above and still stuck? Email us. We usually reply within the first hour, and always within 24 hours. A full support team is with you.
Infrastructure questions, or permanent deletion of your data
infrastructure@clatterlabs.xyzFor deleting your whole account or the data of one service.