How should a SaaS product use the Model API for many customers?
- Keys: a few server-side keys per service and environment (up to 25 per account), not one per customer.
- Per-customer control: enforce your own limits and log your customer id with each request.
- Moderation: your account is responsible for all customers' text; one bad actor can get your whole account paused for 24 hours after a warning.
- Costs: track
usageper customer for pricing and alerts; keep credits topped up. - Choice of tier: Flash by default; offer Max or Heavy as a premium option if useful.
Good to know#
- Model ids:
supercosmos-flash,supercosmos-max,supercosmos-heavy(SuperCosmos 1.1). Which to call - If calls fail unexpectedly, check status.clatterlabs.com before debugging further.
- Retry only
429and 5xx errors, with backoff; honourRetry-Afterwhen it's sent. Which errors to retry
Still need help?#
- General support: support@clatterlabs.com or team@clatterlabs.xyz
- Infrastructure questions, or permanent deletion of your data (your whole account or one service): infrastructure@clatterlabs.xyz
We usually reply within the first hour, and always within 24 hours. A full support team is with you.
Related articles
Still need help?
Tried the steps above and still stuck? Email us. We usually reply within the first hour, and always within 24 hours. A full support team is with you.
Infrastructure questions, or permanent deletion of your data
infrastructure@clatterlabs.xyzFor deleting your whole account or the data of one service.