Why AI Needs a “Genie Coefficient”

This essay was written with Barath Raghavan, and originally appeared inIEEE Spectrum. Major benchmarks measure what AI can do. None measure whether it does what you mean: the distance between what you ask an AI to do and the unspoken assumptions about how you want the AI to do it. We propose a ne...

How Humans, Bots, and Agents Communicate about Vulnerabilities in Pull Requests

Developers may reference vulnerabilities in pull request discussions through both explicit identifiers, such as CVEs or GHSAs, and implicit security-related language e.g., "unauthorized access" or "SQL injection". Prior work has primarily focused on explicit identifiers, potentially overlooking...