crawpy

Crawpy Yet another content discovery tool written in python. What makes this tool different than others: Sends asynchronous HTTP requests, fast Calibration mode, applies filters on its own Recursive scan mode with additional flags Report generation, you can later go and check your results Multipl...