HN
Show HN: Mdarena – Benchmark your Claude.md against your own PRs
Benchmark your CLAUDE.md against your own PRs.
Most CLAUDE.md files are written blindly. Research shows they often reduce agent success rates and cost 20%+ more tokens. mdarena lets you measure whether yours helps or hurts, on tasks from your actual codebase.
mdarena can run your repo's actual tests to grade agent patches, the same way SWE-bench does it.
Parses .github/workflows/*.yml , package.json , pyproject.toml , Cargo.toml , and go.mod . When tests aren't available, falls back to diff overlap scoring.
Pass a directory to benchmark a full CLAUDE.md tree:
Each directory mirrors your repo structure. Baseline strips ALL CLAUDE.md and AGENTS.md files from the entire tree.