Clatter LabsHelp Center

How should a SaaS product use the Model API for many customers?

How-toUpdated
  • Keys: a few server-side keys per service and environment (up to 25 per account), not one per customer.
  • Per-customer control: enforce your own limits and log your customer id with each request.
  • Moderation: your account is responsible for all customers' text; one bad actor can get your whole account paused for 24 hours after a warning.
  • Costs: track usage per customer for pricing and alerts; keep credits topped up.
  • Choice of tier: Flash by default; offer Max or Heavy as a premium option if useful.

Good to know#

  • Model ids: supercosmos-flash, supercosmos-max, supercosmos-heavy (SuperCosmos 1.1). Which to call
  • If calls fail unexpectedly, check status.clatterlabs.com before debugging further.
  • Retry only 429 and 5xx errors, with backoff; honour Retry-After when it's sent. Which errors to retry

Still need help?#

We usually reply within the first hour, and always within 24 hours. A full support team is with you.

Related articles

Still need help?

Tried the steps above and still stuck? Email us. We usually reply within the first hour, and always within 24 hours. A full support team is with you.

Infrastructure questions, or permanent deletion of your data
infrastructure@clatterlabs.xyz
For deleting your whole account or the data of one service.