571 matches found
xepor
Xepor Xepor pronounced /ˈzɛfə/ , zephyr is a web routing framework for reverse engineers and security researchers. It provides a Flask-like API for hackers to intercept and modify HTTP requests and/or HTTP responses in a human-friendly coding style. This project is meant to be used with mitmproxy...
grubcrawler
Agentic web crawler with anti-detection, vision fallback, and peer-to-peer mesh. Full-stack web crawling engine with JavaScript rendering, Camoufox anti-detect browser, per-request proxy routing, and autonomous agent loops. Converts pages to clean markdown with a native Rust extraction engine. Wh...
Pinkerton
🕵️ Pinkerton Investigating JavaScript files since 1850 Python project to crawl for JavaScript files and search for secrets like API keys, authorization tokens, hardcoded passwords, or related data. ⚡ Getting started A quick guide on how to install and use Pinkerton. 1. Clone the repository with:...
dirhunt
.. image:: https://raw.githubusercontent.com/Nekmo/dirhunt/v0.2.0/images/dirhunt.png | .. image:: https://raw.githubusercontent.com/Nekmo/dirhunt/pip-rating-badge/pip-rating-badge.svg :target: https://github.com/Nekmo/dirhunt/actions/workflows/pip-rating.yml :alt: pip-rating badge .. image::...
Instagram-Crawler
Instagram-Crawler Non API. Crawling post photo, likes, comments, date ... by username, hashtags Installation 1. Make sure you have Chrome browser installed. 2. Download chromedriver and put it into driver folder: ./driver/chromedriver 3. Install requirements pip install -r requirements.txt...
crawlergo
crawlergo A powerful browser crawler for web vulnerability scanners English Document | 中文文档 crawlergo is a browser crawler that uses chrome headless mode for URL collection. It hooks key positions of the whole web page with DOM rendering stage, automatically fills and submits forms, with...
freshonions-torscraper
Fresh Onions TOR Hidden Service Crawler This is a copy of the source for the http://zlal32teyptf4tvi.onion hidden service, which implements a tor hidden service crawler / spider and web site. Features Crawls the darknet looking for new hidden service Find hidden services from a number of clearnet...
ache
ACHE Focused Crawler ACHE is a focused web crawler. It collects web pages that satisfy some specific criteria, e.g., pages that belong to a given domain or that contain a user-specified pattern. ACHE differs from generic crawlers in sense that it uses page classifiers to distinguish between...
gryffin
ARCHIVED Gryffin beta Gryffin is a large scale web security scanning platform. It is not yet another scanner. It was written to solve two specific problems with existing scanners: coverage and scale. Better coverage translates to fewer false negatives. Inherent scalability translates to capabilit...
awesome-security-vul-llm
Awesome Security Vulnerability ProjectBy LLM Project Introduction This project uses a large model combined with a crawler to retrieve all projects on GitHub that contain valuable vulnerability information, vulnerability POCs, or rule information. It automatically identifies the project's director...
Pantheon
Pantheon About Pantheon Pantheon is a GUI application that allows users to display information regarding network cameras in various countries as well as an integrated live-feed for non-protected cameras. Functionalities Pantheon allows users to execute an API crawler. There was original...
creep-web-app-scanner
creep-web-app-scanner A very primitive website scanner currently under development by an NCC Group employee and University graduate with 20% research time. creep currently crawls a site, and searches for potentially interesting information within each page. creep will crawl your HTTP only target...
CVE-2024-28000
CVE-2024-28000 - LiteSpeed Cache Privilege Escalation PoC !WARNING This repository is intended for educational and research purposes only. Use the provided PoC exclusively on systems you own or have explicit permission to test. Unauthorized access , exploitation, or misuse of any material in this...
spider
Spider The fastest web crawler and scraper for Rust. spider.cloud · Guides · Docs · Examples · Discord Spider is a concurrency-first crawling engine written in Rust. It streams pages as they arrive, renders JavaScript only on pages that need it, and scales from a single script to a distributed...
shellshock_crawler
Prerequisite 1. sudo pip install shell 2. install google python search. https://github.com/MarioVilas/google Run I use google to search first 1000 sites and try to get the /etc/passwd After tesing, there are many many many host that can be rooted!!!! By the way, this is only a proto, it has false...
webpwn3r
webpwn3r This project is not maintained for years, and was written when I started learning Python, but still people likes it :D. it only supports python2.7 WebPwn3r - Web Applications Security Scanner. By Ebrahim Hegazy - @Zigoo0 Thanks: @lnxg33k, @dia2diab @Aelhemily, @okamalo Please send all yo...
CVE-2014-6271_Test
CVE-2014-6271Test CVE-2014-6271Test Obviously, this project is used to check if a server with cgi enabled is affected with CVE-2014-6271aka shellshock. Dependency Need GoogleSearchCrawler. Usage eg: python exp.py -g www.google.com This will test urls collected from google search result with keywo...
Bashter
Bashter 4.1 Web Crawler, Scanner, and Analyzer Framework Shell-Script based...
CVE-2026-82286-gpt-crawler-Arbitrary-File-Write
CVE-2026-82286 — gpt-crawler Unauthenticated Arbitrary File Write Proof-of-concept for an unauthenticated arbitrary file write in BuilderIO/gpt-crawler ≈22k ★ via the outputFileName parameter of the POST /crawl API endpoint. | ---|--- CVE| CVE-2026-82286 Product| gpt-crawler BuilderIO Affected|...