LayerLens Evaluation Audit: Findings & Contributions

<aside> ☑️

We publish independent evaluations of AI models. This page tracks real issues found by external contributors in the graded prompts, scores, and comparisons we surface. Every finding is credited. We fix what we can and leave the rest visible.

</aside>

Current Focus: Terminal Bench 2.1

Contribute · View findings

How to contribute

1. Open Terminal Bench 2.1: https://stratix.layerlens.ai/benchmarks/6a29ec63e014f99a0f32ed31
2. Look for scoring errors, ambiguous items, contamination, outdated examples, or unfair comparisons.
3. Leave a comment on the issue here:

https://github.com/LayerLens/stratix-python/issues/184

Be sure to include:

• Link (or ID) of the specific item
• What’s wrong
• Why it matters
• Suggested fix (optional)

Findings

Open issues: 0 · Fixed: 0 · Last updated: August 6, 2026

Status legend: Fixed · Acknowledged / investigating · Open · Won’t fix

Thanks to these amazing contributors!