hakrawler

Hakrawler Fast golang web crawler for gathering URLs and JavaScript file locations. This is basically a simple implementation of the awesome Gocolly library. Example usages Single URL: echo https://google.com | hakrawler Multiple URLs: cat urls.txt | hakrawler Timeout for each line of stdin after...

sqlifinder

SQL Injection scanner made with python. Features • Install • Usage • sqlifinder is a tool with the function of detecting GET-based sql injection vulnerabilities in web applications using waybackurls, web crawlers and sql injection payloads. Features Fast and powerful scanner Include web crawler a...

FinalRecon

Twitter - Telegram - thewhiteh4t's Blog FinalRecon is an all in one automatic web reconnaissance tool written in python. Goal of FinalRecon is to provide an overview of the target in a short amount of time while maintaining the accuracy of results. Instead of executing several tools one after...

awesome-security-vul-llm

Awesome Security Vulnerability ProjectBy LLM Project Introduction This project uses a large model combined with a crawler to retrieve all projects on GitHub that contain valuable vulnerability information, vulnerability POCs, or rule information. It automatically identifies the project's director...

SpiderFlow Crawler Platform - Remote Code Execution

A vulnerability, which was classified as critical, was found in spider-flow 0.4.3. Affected is the function FunctionService.saveFunction of the file src/main/java/org/spiderflow/controller/FunctionController.java. The manipulation leads to code injection. It is possible to launch the attack...

Photon

Photon Incredibly fast crawler designed for OSINT. Photon Wiki • How To Use • Compatibility • Photon Library • Contribution • Roadmap Sponsored By Key Features Data Extraction Photon can extract the following data while crawling: URLs in-scope & out-of-scope URLs with parameters...

PenCrawLer

PenCrawLer An Advanced Web Crawler and DirBuster PeNCrawLer is an advanced webcrawler and dirbuster designed to use in penetration testing based on Windows Os. To read more about features please read the wiki: https://github.com/TheM4hd1/PenCrawLer/wiki...

Pinkerton

🕵️ Pinkerton Investigating JavaScript files since 1850 Python project to crawl for JavaScript files and search for secrets like API keys, authorization tokens, hardcoded passwords, or related data. ⚡ Getting started A quick guide on how to install and use Pinkerton. 1. Clone the repository with:...

xepor

Xepor Xepor pronounced /ˈzɛfə/ , zephyr is a web routing framework for reverse engineers and security researchers. It provides a Flask-like API for hackers to intercept and modify HTTP requests and/or HTTP responses in a human-friendly coding style. This project is meant to be used with mitmproxy...

EasySpider

易采集/EasySpider: Visual Code-Free Web Crawler 一个完全免费 （包括商业使用和二次开发 ）的可视化浏览器自动化测试/数据采集/爬虫软件，可以使用图形化界面，无代码可视化的设计和执行任务。只需要在网页上选择自己想要操作的内容并根据提示框操作即可完成任务的设计和执行。同时软件还可以单独以命令行的方式进行执行，从而可以很方便的嵌入到其他系统中。 A completely free including for commercial use and secondary development visual browser automation...

nuubi

Nuubi Tools Scanner, Recon. Details Options: -h/--help | Show help message and exit Arguments: -b/--banner | Banner grabing of target ip address -s/--subnet | Subnetlookup of target -c/--cms | Cms detect with headers -d/--dns | Dnslookup of target domain -e/--extract | Extract links from target...

dcrawl

dcrawl dcrawl is a simple, but smart, multi-threaded web crawler for randomly gathering huge lists of unique domain names. How it works? dcrawl takes one site URL as input and detects all links in the site's body. Each found link is put into the queue. Successively, each queued link is crawled in...

CVE-2026-82286-gpt-crawler-Arbitrary-File-Write

CVE-2026-82286 — gpt-crawler Unauthenticated Arbitrary File Write Proof-of-concept for an unauthenticated arbitrary file write in BuilderIO/gpt-crawler ≈22k ★ via the outputFileName parameter of the POST /crawl API endpoint. | ---|--- CVE| CVE-2026-82286 Product| gpt-crawler BuilderIO Affected|...

festin

FestIN the powered S3 bucket finder and content discover What is FestIn Why Festin Install Using Python Using Docker Full options Usage Configure search domains Concurrency HTTP Crawling configuration Manage results Proxy usage DNS Options Full Text Support Running as a service or watching mode...

Pantheon

Pantheon About Pantheon Pantheon is a GUI application that allows users to display information regarding network cameras in various countries as well as an integrated live-feed for non-protected cameras. Functionalities Pantheon allows users to execute an API crawler. There was original...

dirmap

Dirmap 中文 An advanced web directory scanning tool that will be more powerful than DirBuster, Dirsearch, cansina, and Yu Jian Demand analysis After a lot of research, summarizing an excellent web directory scanning tool has at least the following features: Concurrency engine Can use the dictionary...

creep-web-app-scanner

creep-web-app-scanner A very primitive website scanner currently under development by an NCC Group employee and University graduate with 20% research time. creep currently crawls a site, and searches for potentially interesting information within each page. creep will crawl your HTTP only target...

mec

mec MassExploitConsole Intended for mass exploiting Follow thewiki to get started Features Easy-to-use CLI UI Execute adpated exploits with process-level concurrency Built-in exploits automated Hide your IP using proxychains4 and proxypool ZoomEye host scan 10 threads Simple Baidu crawler...

Web-Cache-Vulnerability-Scanner

Web Cache Vulnerability Scanner WCVS is a fast and versatile CLI scanner for web cache poisoning and web cache deception developed by Hackmanit and Maximilian Hildebrand. The scanner supports many different web cache poisoning and web cache deception techniques, includes a crawler to identify...

vexhub-crawler

VEX Hub Crawler vexhub-crawler is a component of the VEX Hubvexhub that automatically retrieves VEX documents from source repositories. Overview The crawler identifies source repositories from registered PURLs Package URLspurl and copies VEX documents into VEX Hub. This process ensures that VEX H...