Snyk VulnBench JS 1.0: Can LLMs Find the Same Bugs Twice?

We ran 300 repeated vulnerability-finding scans to measure how repeatable agentic large language model LLM security review is on the same JavaScript code, prompt, and benchmark harness. The headline result is that LLM security findings were unevenly repeatable: reference-matched findings were...

Immunity Canvas: COLDFUSION_RCE

Name| coldfusionrce ---|--- CVE| CVE-2018-15957 Exploit Pack| CANVAS Description| CVE-2018-15957 Notes| CVE Name: CVE-2018-15957 VENDOR: Oracle NOTES: This exploit will work against ColdFusion 2018 update 1, ColdeFusion 2016 = update 6 and ColdFusion 11 = update 14. Repeatability: Infinite...

Immunity Canvas: MAGENTO_SET_PAY_INFO

Name| magentosetpayinfo ---|--- CVE| CVE-2016-4010 Exploit Pack| CANVAS Description| Magento unauthenticated unserialize 2.0.6 Notes| Repeatability: Infinite VENDOR: Magento CVE Url: https://vulners.com/cve/CVE-2016-4010 CVE Name: CVE-2016-4010...

Immunity Canvas: CVE_2016_1757

Name| CVE20161757 ---|--- CVE| CVE-2016-1757 Exploit Pack| CANVAS Description| Shellelevate: CVE-2016-1757 Notes| Repeatability: Multiple Times NOTES: VENDOR: Apple CVE Url: https://vulners.com/cve/CVE-2016-1757 CVE Name: CVE-2016-1757...

Immunity Canvas: VBULLETIN_PREAUTH_DECODEARGUMENTS

Name| vbulletinpreauthdecodeArguments ---|--- CVE| CVE-2015-7808 Exploit Pack| CANVAS Description| vBulletin pre-auth remote code execution Notes| CVE Name: CVE-2015-7808 VENDOR: vBulletin Solutions NOTES: Tested on Ubuntu 14.04 against: - vBulletin 5.1.4 - vBulletin 5.0.4 Repeatability: Infinite...

Immunity Canvas: ATMFD_POOL_BUFFER_UNDERFLOW

Name| atmfdpoolbufferunderflow ---|--- CVE| CVE-2015-2387 Exploit Pack| CANVAS Description| ATMFD.dll Pool Buffer Underflow Notes| Repeatability: Infinite Notes: This module exploits a vulnerability on the Adobe Type Manager Font Driver ATMFD.DLL. While processing a font data there exists a buffe...

Immunity Canvas: SANDWORM

Name| sandworm ---|--- CVE| CVE-2014-4114 Exploit Pack| CANVAS Description| Sandworm - MS14-060 - Windows OLE Remote Code Execution Vulnerability. Notes| Repeatability: Infinite Notes: This exploit creates a blank PPSX file Powerpoint show presentation, to use it you just have to add some stuff t...

Immunity Canvas: MS14_040

Name| ms14040 ---|--- CVE| CVE-2014-1767 Exploit Pack| CANVAS Description| AFD.SYS dangling pointer vulnerability Notes| Repeatability: Infinite Notes: This vulnerability affects Microsoft Windows from XP to 8.1, although the exploit is not available for every version. This module automatically...

Immunity Canvas: JAVA_JAXWS

Name| javajaxws ---|--- CVE| CVE-2012-5076 Exploit Pack| CANVAS Description| Java Applet JAX-WS Remote Code Execution Notes| CVE Name: CVE-2012-5076 VENDOR: Sun Notes: Affected versions JDK and JRE 7 Update 7 and earlier Tested on: - Windows XP SP3 with JDK/JRE 7 update 6 To run from command line...

Immunity Canvas: JAVA_FORNAME_GETFIELD

Name| javaforNamegetField ---|--- CVE| CVE-2012-4681 Exploit Pack| CANVAS Description| Java forName/getField Method Invocation Sandbox Bypass Notes| CVE Name: CVE-2012-4681 VENDOR: Sun Notes: There is a method invocation vulnerability using sun.awt.SunToolkit.getField This vulnerability can then ...

Immunity Canvas: JAVA_ATOMICREFERENCEARRAY

Name| javaAtomicReferenceArray ---|--- CVE| CVE-2012-0507 Exploit Pack| CANVAS Description| Java AtomicReferenceArray Type Confusion Sandbox Bypass Notes| CVE Name: CVE-2012-0507 VENDOR: Sun Notes: There is a Type Confusion vulnerability in java.util.concurrent.atomic.AtomicReferenceArray class...

Immunity Canvas: CVE_2012_1182

Name| CVE20121182 ---|--- CVE| CVE-2012-1182 Exploit Pack| CANVAS Description| CVE-2012-1182 Notes| References: http://www.samba.org CVE Name: CVE-2012-1182 VENDOR: Samba Repeatability: Repeatable Date Public: 04/10/2012 CVE Url: http://cve.mitre.org/cgi-bin/cvename.cgi?name=CVE-2012-CVE-2012-118...

Immunity Canvas: CVE_2011_1485

Name| CVE20111485 ---|--- CVE| CVE-2011-1485 Exploit Pack| CANVAS Description| CVE-2011-1485: pkexec stuid race Notes| CVE Name: CVE-2011-1485 VENDOR: PolKit Notes: Tested on Red Hat Enterprise Linux 6 Repeatability: Infinite CVE Url: https://vulners.com/cve/CVE-2011-1485 NOTES:...

Immunity Canvas: FIREFOX_CHANNELREDIRECT

Name| firefoxchannelredirect ---|--- CVE| CVE-2011-0065 Exploit Pack| CANVAS Description| Firefox Notes| CVE Name: CVE-2011-0065 Repeatability: Infinite MFSA: http://www.mozilla.org/security/announce/2011/mfsa2011-13.html...

Immunity Canvas: JAVA_DESERIALIZE2

Name| javadeserialize2 ---|--- CVE| CVE-2010-0094 Exploit Pack| CANVAS Description| javadeserialize2 Notes| CVE Name: CVE-2010-0094 VENDOR: Sun OSVDB: http://osvdb.org/show/osvdb/63484 Repeatability: Infinite client side - no crash References:...

Immunity Canvas: SMB2_NEGOTIATE_LOCAL

Name| smb2negotiatelocal ---|--- CVE| CVE-2009-3103 Exploit Pack| CANVAS Description| SMB2 Negotiate Pointer Dereference Vulnerability Notes| CVE Name: CVE-2009-3103 VENDOR: Microsoft VersionsAffected: Repeatability: One shot References: http://blog.48bits.com/?p=510,...

Immunity Canvas: ZENCART_REMOTE

Name| zencartremote ---|--- CVE| CVE-2009-2255 Exploit Pack| CANVAS Description| zencartremote Notes| Repeatability: Infinite CVE URL: http://web.nvd.nist.gov/view/vuln/detail?vulnId=CVE-2009-2255 VENDOR: www.zen-cart.com/ CVSS: 6.8 CVE Name: CVE-2009-2255...

Immunity Canvas: QUICKTEAM_RFI

Name| quickteamrfi ---|--- CVE| CVE-2009-1551 Exploit Pack| CANVAS Description| QuickTeam Remote File Include Notes| CVE Name: CVE-2009-1551 VENDOR: quickteam Repeatability: Infinite CVE Url: http://cve.mitre.org/cgi-bin/cvename.cgi?name=2009-1551 References: 'http://osvdb.org/show/osvdb/54217'...

Immunity Canvas: CLOUDBURST

Name| CLOUDBURST ---|--- CVE| CVE-2009-1244 Exploit Pack| CANVAS Description| CLOUDBURST VMware Workstation Guest Escape Notes| CVE Name: CVE-2009-1244 VENDOR: VMware Notes: The exploit currently only supports a Windows Guest in a Windows Host, with "Accelerate 3D Graphics" enabled default on new...

Immunity Canvas: ACUTECP_RFI

Name| acutecprfi ---|--- CVE| CVE-2009-1247 Exploit Pack| CANVAS Description| AcuteCP Remote File Include Notes| CVSS: 7.5 Repeatability: Infinite VENDOR: Acutecp CVE Url: https://vulners.com/cve/CVE-2009-1247 CVE Name: CVE-2009-1247...