Who wrote the Benchmark 2 cases?

The honesty and purity cases were written by Clatter Labs, and graded by fixed rules listed in the harness. The coding problems come from the public HumanEval+ and MBPP+ sets. Because Clatter Labs wrote part of the benchmark, the method, cases and grading rules are described openly on the page so you can judge them, and the best test is always your own work.

Good to know#

• SuperCosmos reads text only; it doesn't take image input. What it can't do
• Every tier shares the same 1M-token context window (1,048,576 tokens). Context window
• Prices per 1M input / output tokens: Flash $1.60 / $3.40, Max $1.80 / $3.80, Heavy $2.00 / $4.40. All prices

Still need help?#

• General support: support@clatterlabs.com or team@clatterlabs.xyz
• Infrastructure questions, or permanent deletion of your data (your whole account or one service): infrastructure@clatterlabs.xyz

We usually reply within the first hour, and always within 24 hours. A full support team is with you.