255 matches found
warcannon
WARCannon - Catastrophically powerful parallel WARC processing WARCannon was built to simplify and cheapify the process of 'grepping the internet'. With WARCannon, you can: Build and test regex patterns against real Common Crawl data Easily load Common Crawl datasets for parallel processing Scale...
warcannon
WARCannon - 灾难级强大的并行WARC处理工具 WARCannon 旨在简化和降低“搜索互联网”这一过程的成本与复杂度。 通过 WARCannon，你可以： 构建并针对真实的 Common Crawl 数据测试正则表达式模式 轻松加载 Common Crawl 数据集以进行并行处理 扩展计算能力，以相当不合理的吞吐量异步处理 WARC 文件 存储并轻松检索结果 工作原理 WARCannon 巧妙利用 AWS 技术实现水平扩展至任意规模，通过竞价实例集群和同区域数据传输降低成本，以惊人速度（每节点高达 100Gbps）从 S3 拉取数据，跨数百个 CPU 核心并行处理，通过...
galer
galer root@kitploit: /' '/'' | | /'' ' | || | | | '\ ','\ | /' @dwisiswant0 A fast tool to fetch URLs from HTML attributes by crawl-in. Inspired by the @omespino Tweet, which is possible to extract src, href, url and action values by evaluating JavaScript through Chrome DevTools Protocol...
domdig
DOMDig DOMDig 是一个运行在 Chromium 浏览器内部的 DOM XSS 扫描器，可以递归地扫描单页应用（SPA）。 与其他扫描器不同，DOMDig 通过跟踪 DOM 修改和 XHR/fetch/websocket 请求来爬取任何 Web 应用（包括 Gmail），并通过触发事件来模拟真实用户交互。在此过程中，输入字段中会注入 XSS 载荷，并跟踪其执行情况，以发现注入点及相关的 URL 变更。 它基于 htcrawl 构建，这是一个功能强大的 Node 库，足以轻松爬取 Gmail 账户。 主要特性 在真实浏览器（Chromium）内运行 递归 DOM 爬取引擎 处理...
paskto
Paskto - 被动式Web扫描器 Paskto 将使用 Common Crawl 互联网索引被动扫描Web，既可以按需下载索引，也可以解析本地系统中的数据。URL 随后通过 Nikto 和已知 URL 列表进行处理，以识别感兴趣的内容。哈希签名也用于识别某些物联网设备或Web应用程序的已知默认内容。 root@kitploit: 选项 -d, --dir-input directory 包含 Common Crawl 索引文件（.gz 扩展名）的目录。例如：-d "/tmp/cc/" -v, --ia-dir-input directory 包含互联网档案馆索引文件（.gz...
paskto
Paskto - Passive Web Scanner Paskto will passively scan the web using the Common Crawl internet index either by downloading the indexes on request or parsing data from your local system. URLs are then processed through Nikto and known URL lists to identify interesting content. Hash signatures are...
skipfish
=========================================== skipfish - escáner de seguridad de aplicaciones web http://code.google.com/p/skipfish/ Escrito y mantenido por: Michal Zalewski [email protected] Niels Heinen [email protected] Sebastian Roschke [email protected] Copyright 2009 - 2012...
gau
getallurls gau getallurls gau 从 AlienVault 的 Open Threat Exchange、Wayback Machine、Common Crawl 和 URLScan 获取给定域名的已知 URL。灵感来源于 Tomnomnom 的 waybackurls。 资源 使用 安装 ohmyzsh 说明 使用： 示例： root@kitploit: $ printf example.com | gau $ cat domains.txt | gau --threads 5 $ gau example.com google.com $ gau --o...
xurlfind3r
xurlfind3r xurlfind3r is a command-line utility designed to discover URLs for a given domain in a simple, efficient way. It works by gathering information from a variety of passive sources, meaning it doesn't interact directly with the target but instead gathers data that is already publicly...
urx
从 OSINT 档案中提取 URL，助力安全洞察。 Urx 是一款命令行工具，专为从 OSINT 档案（如 Wayback Machine 和 Common Crawl）中收集 URL 而设计。它使用 Rust 构建以追求高效，利用异步处理快速查询多个数据源。该工具简化了为指定域名收集 URL 信息的过程，提供全面的数据集，可用于多种用途，包括安全测试和分析。 功能特性 并行从多个来源获取 URL（Wayback Machine、Common Crawl、OTX、Arquivo.pt） 通过 --cdx-endpoint URL 接入任何其他 CDX 索引服务器——国家网络档案、私有...
katana
A next-generation crawling and spidering framework Features • Installation • Usage • Scope • Config • Filters • Join Discord Features Fast And fully configurable web crawling Standard and Headless mode JavaScript parsing / crawling Customizable automatic form filling Scope control - Preconfigured...
cariddi
Take a list of domains, crawl urls and scan for endpoints, secrets, api keys, file extensions, tokens and more Coded with 💙 by edoardottt Share on Twitter! Install • Usage • Get Started • Changelog • Contributing • License Installation 📡 Homebrew root@kitploit: brew install cariddi Snap...
jshole
jshole A simple JavaScript components vulnrability scanner, based on RetireJS. Why use JShole instead of RetireJS? By default, RetireJS only searches one page, but JShole tries to crawl all pages. Get Started Requirements requests Install git clone https://github.com/callforpapers-source/jshole.g...
CVE-2026-82286-gpt-crawler-Arbitrary-File-Write
CVE-2026-82286 — gpt-crawler Escritura Arbitraria de Archivos sin Autenticación Prueba de concepto para una escritura arbitraria de archivos sin autenticación en BuilderIO/gpt-crawler ≈22k ★ a través del parámetro outputFileName del endpoint de API POST /crawl...
EUVD-2026-67817
gpt-crawler through 1.5.1 fails to validate the outputFileName parameter in the POST /crawl endpoint, allowing unauthenticated attackers to write arbitrary files to any filesystem path. Attackers can supply absolute paths or parent-directory segments to overwrite existing files with content sourc...
CVE-2026-82286
gpt-crawler through version 1.5.1 (BuilderIO) is vulnerable to an arbitrary file write via the outputFileName parameter in the POST /crawl endpoint. The root cause is a failure to validate this parameter, allowing unauthenticated attackers to supply absolute paths or parent-directory segments and...
CVE-2026-82286 gpt-crawler Arbitrary File Write via outputFileName Parameter
gpt-crawler through 1.5.1 fails to validate the outputFileName parameter in the POST /crawl endpoint, allowing unauthenticated attackers to write arbitrary files to any filesystem path. Attackers can supply absolute paths or parent-directory segments to overwrite existing files with content sourc...
CVE-2026-82286 gpt-crawler Arbitrary File Write via outputFileName Parameter
gpt-crawler through 1.5.1 fails to validate the outputFileName parameter in the POST /crawl endpoint, allowing unauthenticated attackers to write arbitrary files to any filesystem path. Attackers can supply absolute paths or parent-directory segments to overwrite existing files with content sourc...