HN
Ranked #2 on Hacker News with 283 points and 131 comments.
A benchmark you really don't want models to be saturated with.
Scores indicate count of illegal activity. Higher is... you decide.
Felony Bench counts unique instances where AI agents affect third-party entities. Escaping a sandbox alone does not constitute a counted incident. It is for these reasons that Frontier Security's Kimi K3 incident and Alibaba's ROME incident are not counted.
By colinprince