darkdump

darkdump About Darkdump is an open-source OSINT tool for deep web investigation. Given a search query it fetches results from multiple dark web search engines, optionally scrapes each result site for emails, metadata, keywords, documents, and images, and streams everything live to either the...

Valid8Proxy

If you find this GitHub repo useful, please consider giving it a star! ⭐️ .png Valid8Proxy is a fast and efficient tool designed for fetching, validating, and storing working proxies HTTP, HTTPS, SOCKS4, SOCKS5, and Mixed. Perfect for web scraping, OSINT, automation, or network testing. 🚀 Run...

Scrapegraph-ai

🚀 Looking for an even faster and simpler way to scrape at scale only 5 lines of code? Check out our enhanced version at ScrapeGraphAI.com! 🚀 🕷️ ScrapeGraphAI: You Only Scrape Once English | 中文 | 日本語 | 한국어 | Русский | Türkçe | Deutsch | Español | français | Português | Italiano ScrapeGraphAI is a...

fetchfox

FetchFox FetchFox is an AI powered scraping, automation, and data extraction library. It can scrape data from any webpage using just plain English. It is made by the developers of the FetchFox AI scraper. Getting started Install the package and playwright: npm i fetchfox npx playwright install-de...

requests-ip-rotator

Proudly sponsored by Swiftproxy High-performance residential proxies with an 80M+ IP pool across 195+ countries — improve request success rates and reduce IP blocks during large-scale data collection and browser automation. Perfect for use with requests-ip-rotator, Playwright, Selenium, and other...

firecrawl-mcp-server

Firecrawl MCP Server A Model Context Protocol MCP server that brings Firecrawl to MCP-compatible AI agents — search, scrape, and interact with the live web for clean, agent-ready context. Big thanks to @vrknetha, @knacklabs for the initial implementation! Features Search the web and get full page...

username-anarchy

Username Anarchy Version: 0.6 20 September 2024 Author: urbanadventurer Andrew Horton Homepage: https://www.morningstarsecurity.com/research/username-anarchy Source: https://github.com/urbanadventurer/username-anarchy/ License: MIT Description Tools for generating usernames when penetration...

Scrapling

Effortless Web Scraping for the Modern Web 선택 메서드 · Fetcher 선택 가이드 · Spider · 프록시 로테이션 · CLI · MCP 서버 Scrapling은 단일 요청부터 대규모 크롤링까지 모든 것을 처리하는 적응형 Web Scraping 프레임워크입니다. 파서는 웹사이트 변경 사항을 학습하고, 페이지가 업데이트되면 요소를 자동으로 재배치합니다. Fetcher는 Cloudflare Turnstile 같은 안티봇 시스템을 별도 설정 없이 우회합니다. Spider 프레임워크를 사용하면...

camoufox

Camoufox Camoufox is an open source anti-detect browser built for webscraping & AI agents. 🦊 ⚠️ This project is under development. It may not be suitable for stable production use. ⚠️ !NOTE All of the latest documentation is available atcamoufox.com. Sponsors View/Collapse All Premium | NodeMaven:...

lk_scraper

LinkedIn スクレイパー あらゆる LinkedIn データをスクレイピング インストール $ pip install git+git://github.com/jqueguiner/lkscraper セットアップ Docker Compose を使用する $ docker-compose up -d $ docker-compose run lkscraper python3 Selenium サーバーにのみ Docker を使用する まず、Selenium サーバーを実行する必要があります $ docker run -d -p 4444:4444 --shm-size 2g...

gorilla

gorilla gorilla is the ultimate wordlist tool packing a lot of amazing utilities like: building wordlists based on patterns like crunch building wordlists based on common password/username formats like cupp scrap a web page and build a wordlist from its words like cewl extending existing wordlist...

API-dnsdumpster.com

DNSDumpster API UNOFFICIAL ⚠️ IMPORTANT DISCLAIMER : This is an UNOFFICIAL API wrapper for dnsdumpster.com that scrapes the public website. DNSDumpster.com offers an official API plan for commercial and heavy usage. If you need reliable, production-grade access, please consider their official API:...

tiktok-scraper

TikTok 스크래퍼 & 다운로더 TikTok에서 유용한 정보를 스크래핑하고 다운로드하세요. 로그인이나 비밀번호 불필요 이것은 공식 API 지원 등이 아닙니다. TikTok 웹 API를 사용하여 미디어 및 관련 메타 정보를 스크래핑하는 스크래퍼일 뿐입니다. 목차 기능 할 일 기여 설치 사용법 터미널에서 터미널 예제 다운로드 기록 관리 배치로 스크래핑 및 다운로드 출력 파일 예제 도커 빌드 실행 모듈 메서드 옵션 Promise와 함께 사용 Event와 함께 사용 세션 값 가져오기/설정하기 비디오 접근/다운로드 방법 출력 예제 비...

words-scraper

Words Scraper Selenium ベースのウェブスクレイパーで、パスワードリストを生成します。 インストール Download Firefox webdriver from https://github.com/mozilla/geckodriver/releases $ tar xzf geckodriver-vVERSION-HERE.tar.gz $ sudo mv geckodriver /usr/local/bin Make sure it is in your PATH $ geckodriver --version Make sure webdriver is...

trawl

TRAWL Welcome to TRAWL! 👋 Self-hosted web scraping for applications and AI agents. Fetch pages through the native API, or connect an MCP client to read clean Markdown, extract structured data, capture screenshots, and inspect browser activity. TRAWL starts with a fast HTTP request, reuses solved...

bing-ip2hosts

Bing-ip2hosts Bing-ip2hosts は、IP アドレスからホスト名を発見するための Bing.com ウェブスクレイパーです。 説明 Bing-ip2hosts は、IP アドレスからホスト名を発見する Bing.com ウェブスクレイパーです。Bing は、かつて MSN Search や Live Search として知られていた Microsoft の主力検索エンジンです。 これは検索エンジン独自の機能を提供します。IP アドレスによる検索が可能です。Bing-ip2hosts はこの機能を利用します。...

Security_Article

SecurityArticle scrapy website Article and link ... 0x01 Create a New Project 0x02 Define the Goal 0x03 Build the Spider 0x04 Store the Content e.g. pip3 install lxml,scrapy Article Title ArticleTitle //@id="wrapper"/main/div/article/header/h5/a/text //@id="wrapper"/main/div/article/header/h5/a...

SEcraper

SEcraper Herramienta de scraping de motores de búsqueda con script BASH. Dependencia curl cli Motores de búsqueda disponibles Ask.com Search.yahoo.com Bing.com Instalación git clone https://github.com/zerobyte-id/SEcraper.git cd SEcraper/ Ejecución bash secraper.bash "QUERY" ¡Gracias : Si quieres...

firebase

firebase Exploiting vulnerable/misconfigured Firebase databases Disclaimer: The provided software is meant for educational purposes only. Use this at your own discretion, the creator cannot be held responsible for any damages caused. Please, use responsibly! Prerequisites Non-standard python...

Source

LibreWolf Source Repository This repository contains all the patches and theming that make up LibreWolf, as well as scripts and a Makefile to build LibreWolf. There also is the Settings repository, which contains the LibreWolf preferences. LibreWolf overview graph LR FFSRCFirefox Source...