Skill · certified
SWE Eval Pack
Harness-aware evals. The pack that made the SWE-bench Pro finding operational.
Publisher
Lattice Labs
License
commercial-usage
Latest
1.9.0
Installs
3,100
Thesis
Eval suites that hold the model constant and vary the harness — the experiment most teams swear they ran and did not.
If you cannot produce a table where the harness is the independent variable, you are not doing harness engineering. This pack is that table, weekly.
Direction
This listing is a reference. The tree lives at origin. The command is how you load it here.
Subscribe (usage) → hm install lattice/eval-pack-swe@1.9.0
Hold the model. Change the harness. Publish the table. Anything else is anecdote.
Versions
| Semver | SHA | Released | Notes | Signed |
|---|---|---|---|---|
| 1.9.0 | swe190a | 2026-08-06 | Pro subset refreshed. Cost traces. | signed · sbom |
Subscribe
$0.40
Usage · eval run
Enterprise from $14,000
Subscribe, then pin. Entitlement is checked at deploy, not in a PDF.
Compatibility
- claude-code
- codex-cli
- grok-build
- opencode
- cursor-agent
Permission manifest
- fs.read
- **
- fs.write
- **
- network
- registry.harness.market, api.github.com
- exec / secrets
- exec · GITHUB_TOKEN