Normal view
Anthropicβs Claude Fable 5 is a version of Mythos the public can access today
- Ars Technica - Technology
- Mozilla says 271 vulnerabilities found by Mythos have "almost no false positives"
Mozilla says 271 vulnerabilities found by Mythos have "almost no false positives"
The disbelief was palpable when Mozillaβs CTO last month declared that AI-assisted vulnerability detection meant βzero-days are numberedβ and βdefenders finally have a chance to win, decisively.β After all, it looked like part of an all-too-familiar pattern: Cherry-pick a handful of impressive AI-achieved results, leave out any of the fine print that might paint a more nuanced picture, and let the hype train roll on.
Mindful of the skepticism, Mozilla on Thursday provided a behind-the-scenes look into its use of Anthropic Mythosβan AI model for identifying software vulnerabilitiesβto ferret out 271 Firefox security flaws over two months. In a post, Mozilla engineers said the finally ready-for-prime-time breakthrough they achieved was primarily the result of two things: (1) improvement in the models themselves and (2) Mozillaβs development of a custom βharnessβ that supported Mythos as it analyzed Firefox source code.
"Almost no false positives"
The engineers said their earlier brushes with AI-assisted vulnerability detection were fraught with βunwanted slop.β Typically, someone would prompt a model to analyze a block of code. The model would then produce plausible-reading bug reports, and often at unprecedented scales. Invariably, however, when human developers further investigated, theyβd find a large percentage of the details had been hallucinated. The humans would then need to invest significant work handling the vulnerability reports the old-fashioned way.


Β© Getty Images