How did Line Code score in benchmarks?

In the first benchmark (50 HumanEval+ and MBPP+ problems, one attempt each), Line Code scored Fast 82%, Ultra 86%, Ultra Fast 84%, against SuperCosmos (1.0) Flash 90%, Max 88%, Heavy 90%. Benchmark 2 covers SuperCosmos 1.1 only.

Good to know#

• SuperCosmos reads text only; it doesn't take image input. What it can't do
• Insulting or cursing at the assistant earns a warning, then a 24-hour pause on a second strike within 30 days. Abuse policy
• Every tier shares the same 1M-token context window (1,048,576 tokens). Context window

Still need help?#

• General support: support@clatterlabs.com or team@clatterlabs.xyz
• Infrastructure questions, or permanent deletion of your data (your whole account or one service): infrastructure@clatterlabs.xyz

We usually reply within the first hour, and always within 24 hours. A full support team is with you.