Valid8Proxy

If you find this GitHub repo useful, please consider giving it a star! ⭐️ .png Valid8Proxy is a fast and efficient tool designed for fetching, validating, and storing working proxies HTTP, HTTPS, SOCKS4, SOCKS5, and Mixed. Perfect for web scraping, OSINT, automation, or network testing. 🚀 Run...

firecrawl-mcp-server

Firecrawl MCP Server A Model Context Protocol MCP server that brings Firecrawl, the context API for AI agents, to MCP-compatible clients: search, scrape, and interact with the live web and get back clean Markdown or structured data. Big thanks to @vrknetha, @knacklabs for the initial...

requests-ip-rotator

Proudly sponsored by Swiftproxy High-performance residential proxies with an 80M+ IP pool across 195+ countries — improve request success rates and reduce IP blocks during large-scale data collection and browser automation. Perfect for use with requests-ip-rotator, Playwright, Selenium, and other...

fetchfox

FetchFox FetchFox is an AI powered scraping, automation, and data extraction library. It can scrape data from any webpage using just plain English. It is made by the developers of the FetchFox AI scraper. Getting started Install the package and playwright: npm i fetchfox npx playwright install-de...

Scrapling

Effortless Web Scraping for the Modern Web -DFE0E5 !Static Badgehttps://img.shields.io/badge/Skill-black?style=flat&label=Agent&...

Security_Article

SecurityArticle scrapy website Article and link ... 0x01 Create a New Project 0x02 Define the Goal 0x03 Build the Spider 0x04 Store the Content e.g. pip3 install lxml,scrapy Article Title ArticleTitle //@id="wrapper"/main/div/article/header/h5/a/text //@id="wrapper"/main/div/article/header/h5/a...

darkdump

darkdump About Darkdump is an open-source OSINT tool for deep web investigation. Given a search query it fetches results from multiple dark web search engines, optionally scrapes each result site for emails, metadata, keywords, documents, and images, and streams everything live to either the...

camoufox

Camoufox Camoufox is an open source anti-detect browser built for webscraping & AI agents. 🦊 ⚠️ This project is under development. It may not be suitable for stable production use. ⚠️ !NOTE All of the latest documentation is available atcamoufox.com. Sponsors View/Collapse All Premium | NodeMaven:...

trawl

TRAWL Self-hosted web scraping for applications and AI agents. Get page content through an API or MCP, with built-in handling for supported browser challenges and CAPTCHAs. TRAWL starts with HTTP, reuses verified clearance and opens Camoufox when a browser is needed. Repeat requests fetch fresh...

git-dump

git-dump This script is a tool to recursively download the contents of the '.git' directory from a website. Using Python and libraries like 'requests' and 'BeautifulSoup', this script examines the directory structure, downloads files, and identifies SHA-1 hashes within Git files. Feature...

crawlee

A web scraping and browser automation library Crawlee covers your crawling and scraping end-to-end and helps you build reliable scrapers. Fast. Your crawlers will appear human-like and fly under the radar of modern bot protections even with the default configuration. Crawlee gives you the tools t...

API-dnsdumpster.com

DNSDumpster API UNOFFICIAL ⚠️ IMPORTANT DISCLAIMER : This is an UNOFFICIAL API wrapper for dnsdumpster.com that scrapes the public website. DNSDumpster.com offers an official API plan for commercial and heavy usage. If you need reliable, production-grade access, please consider their official API:...

Scrapegraph-ai

🚀 Looking for an even faster and simpler way to scrape at scale only 5 lines of code? Check out our enhanced version at ScrapeGraphAI.com! 🚀 🕷️ ScrapeGraphAI: You Only Scrape Once English | 中文 | 日本語 | 한국어 | Русский | Türkçe | Deutsch | Español | français | Português | Italiano ScrapeGraphAI is a...

username-anarchy

Username Anarchy Version: 0.6 20 September 2024 Author: urbanadventurer Andrew Horton Homepage: https://www.morningstarsecurity.com/research/username-anarchy Source: https://github.com/urbanadventurer/username-anarchy/ License: MIT Description Tools for generating usernames when penetration...

gorilla

gorilla gorilla is the ultimate wordlist tool packing a lot of amazing utilities like: building wordlists based on patterns like crunch building wordlists based on common password/username formats like cupp scrap a web page and build a wordlist from its words like cewl extending existing wordlist...

SEcraper

SEcraper Search engine scraper tool with BASH script. Dependency curl cli Available search engine Ask.com Search.yahoo.com Bing.com Installation git clone https://github.com/zerobyte-id/SEcraper.git cd SEcraper/ Run bash secraper.bash "QUERY" Thank you : If you want to buy us a coffee...

firebase

firebase Exploiting vulnerable/misconfigured Firebase databases Disclaimer: The provided software is meant for educational purposes only. Use this at your own discretion, the creator cannot be held responsible for any damages caused. Please, use responsibly! Prerequisites Non-standard python...

Source

LibreWolf Source Repository This repository contains all the patches and theming that make up LibreWolf, as well as scripts and a Makefile to build LibreWolf. There also is the Settings repository, which contains the LibreWolf preferences. LibreWolf overview graph LR FFSRCFirefox Source...

tiktok-scraper

TikTok Scraper & Downloader Extrae y descarga información útil de TikTok. No se requieren inicio de sesión ni contraseña Esto no es un soporte de API oficial ni nada por el estilo. Es solo un scraper que utiliza la API web de TikTok para extraer contenido multimedia e información meta relacionada...

lk_scraper

LinkedIn Scraper Extrae cualquier dato de LinkedIn Instalación $ pip install git+git://github.com/jqueguiner/lkscraper Configuración Usando Docker compose $ docker-compose up -d $ docker-compose run lkscraper python3 Usando Docker solo para el servidor de Selenium Primero, necesita ejecutar un...