Pinkerton

🕵️ Pinkerton Investigating JavaScript files since 1850 Python project to crawl for JavaScript files and search for secrets like API keys, authorization tokens, hardcoded passwords, or related data. ⚡ Getting started A quick guide on how to install and use Pinkerton. 1. Clone the repository with:...

sqlifinder

SQL Injection scanner made with python. Features • Install • Usage • sqlifinder is a tool with the function of detecting GET-based sql injection vulnerabilities in web applications using waybackurls, web crawlers and sql injection payloads. Features Fast and powerful scanner Include web crawler a...

Web-Cache-Vulnerability-Scanner

Web Cache Vulnerability Scanner WCVS is a fast and versatile CLI scanner for web cache poisoning and web cache deception developed by Hackmanit and Maximilian Hildebrand. The scanner supports many different web cache poisoning and web cache deception techniques, includes a crawler to identify...

secator

The pentester's swiss knife. Features • Supported commands • Installation • Usage • Documentation • Join us on Discord ! secator is a task and workflow runner used for security assessments. It supports dozens of well-known security tools and it is designed to improve productivity for pentesters a...

SpiderSuite

SpiderSuite is an advance cross-platform and multi-feature web crawler designed for security professionals. For more information visit SpiderSuite's website. Installation and Usage Spider Suite is designed for easy installation and usage even for first timers. First, download the package of your...

Photon

Photon Incredibly fast crawler designed for OSINT. Photon Wiki • How To Use • Compatibility • Photon Library • Contribution • Roadmap Key Features Data Extraction Photon can extract the following data while crawling: URLs in-scope & out-of-scope URLs with parameters example.com/gallery.php?id=2...

spider

Spider El rastreador y extractor web más rápido para Rust. · · · ·...

ache

ACHE Focused Crawler ACHE is a focused web crawler. It collects web pages that satisfy some specific criteria, e.g., pages that belong to a given domain or that contain a user-specified pattern. ACHE differs from generic crawlers in sense that it uses page classifiers to distinguish between...

FinalRecon

Twitter - Telegram - thewhiteh4t's Blog FinalRecon is an all in one automatic web reconnaissance tool written in python. Goal of FinalRecon is to provide an overview of the target in a short amount of time while maintaining the accuracy of results. Instead of executing several tools one after...

EasySpider

易采集/EasySpider: 可视化无代码网络爬虫 一个完全免费 （包括商业使用和二次开发 ）的可视化浏览器自动化测试/数据采集/爬虫软件，可以使用图形化界面，无代码可视化的设计和执行任务。只需要在网页上选择自己想要操作的内容并根据提示框操作即可完成任务的设计和执行。同时软件还可以单独以命令行的方式进行执行，从而可以很方便地嵌入到其他系统中。...

dirmap

Dirmap English 一个高级web目录扫描工具，功能将会强于DirBuster、Dirsearch、cansina、御剑 需求分析 经过大量调研，总结一个优秀的web目录扫描工具至少具备以下功能： 并发引擎 能使用字典 能纯爆破 能爬取页面动态生成字典 能fuzz扫描 自定义请求 自定义响应结果处理... 那么接下来看看Dirmap的特点 吧 功能特点 1. 支持n个targetn个payload并发 2. 支持递归扫描 3. 支持自定义需要递归扫描的状态码 4. 支持单|多字典扫描 5. 支持自定义字符集爆破 6. 支持爬虫动态字典扫描 7. 支持自定义标签fuzz目标url...

Instagram-Crawler

Instagram-Crawler Non API. Crawling post photo, likes, comments, date ... by username, hashtags Installation 1. Make sure you have Chrome browser installed. 2. Download chromedriver and put it into driver folder: ./driver/chromedriver 3. Install requirements pip install -r requirements.txt...

freshonions-torscraper

Fresh Onions TOR Hidden Service Crawler This is a copy of the source for the http://zlal32teyptf4tvi.onion hidden service, which implements a tor hidden service crawler / spider and web site. Features Crawls the darknet looking for new hidden service Find hidden services from a number of clearnet...

hakrawler

Hakrawler 用于收集URL和JavaScript文件位置的高速Go语言网络爬虫。这基本上是优秀的Gocolly库的一个简单实现。 使用示例 单个URL： root@kitploit: echo https://google.com | hakrawler 多个URL： root@kitploit: cat urls.txt | hakrawler 每行标准输入的超时时间设为5秒： root@kitploit: cat urls.txt | hakrawler -timeout 5 通过代理发送所有请求： root@kitploit: cat urls.txt | hakrawle...

hakrawler

Hakrawler Fast golang web crawler for gathering URLs and JavaScript file locations. This is basically a simple implementation of the awesome Gocolly library. Example usages Single URL: root@kitploit: echo https://google.com | hakrawler Multiple URLs: root@kitploit: cat urls.txt | hakrawler Timeou...

PenCrawLer

PenCrawLer An Advanced Web Crawler and DirBuster PeNCrawLer is an advanced webcrawler and dirbuster designed to use in penetration testing based on Windows Os. To read more about features please read the wiki: https://github.com/TheM4hd1/PenCrawLer/wiki...

Pantheon

Pantheon About Pantheon Pantheon is a GUI application that allows users to display information regarding network cameras in various countries as well as an integrated live-feed for non-protected cameras. Functionalities Pantheon allows users to execute an API crawler. There was original...

gospider

GoSpider GoSpider - 用Go编写的快速网络爬虫 无需痛苦地将Gospider集成到你的侦察工作流中？ 该项目是Osmedeus引擎的一部分。查看它在@OsmedeusEngine上的集成方式 安装 GO安装 root@kitploit: GO111MODULE=on go install github.com/jaeles-project/gospider@latest Docker root@kitploit: 克隆仓库 git clone https://github.com/jaeles-project/gospider.git 构建容器 docker build...

dirhunt

.. image:: https://raw.githubusercontent.com/Nekmo/dirhunt/v0.2.0/images/dirhunt.png | .. image:: https://raw.githubusercontent.com/Nekmo/dirhunt/pip-rating-badge/pip-rating-badge.svg :target: https://github.com/Nekmo/dirhunt/actions/workflows/pip-rating.yml :alt: pip-rating badge .. image::...

xepor

Xepor Xepor pronounced /ˈzɛfə/ , zephyr is a web routing framework for reverse engineers and security researchers. It provides a Flask-like API for hackers to intercept and modify HTTP requests and/or HTTP responses in a human-friendly coding style. This project is meant to be used with mitmproxy...