bjesus/pipet: a swiss-army tool for scraping and extracting data from online assets, made for hackers [https://github.com/bjesus/pipet] - 2024-10-11 16:23:08 - public:xxx commandline, crawler, curl, scraping, tools, web - 6 | id:1506891 -
bluedragonz/bad-bot-blocker: Block bad, possibly even malicious web crawlers (automated bots) using htaccess. [https://github.com/bluedragonz/bad-bot-blocker] - 2024-09-14 18:05:49 - public:xxx bad, bot, crawler, htaccess, list, seo, spiders - 7 | id:1492984 -
Crawlee for Python · Fast, reliable crawlers. [https://crawlee.dev/python/] - 2024-07-19 14:36:25 - public:xxx automation, browser, crawler, python, scraping, web - 6 | id:1492570 -
projectdiscovery/katana: A next-generation crawling and spidering framework. [https://github.com/projectdiscovery/katana] - 2024-03-28 16:25:52 - public:xxx crawler, golang, opensource, scraping - 4 | id:1490804 -
semanser/JsonGenius: Get structured JSON data from any page. [https://github.com/semanser/JsonGenius] - 2023-10-14 14:03:03 - public:xxx crawler, data, json, parsing, web - 5 | id:1484885 -
Paterva / Maltego [https://www.paterva.com/web6/] - 2015-02-02 18:27:06 - public:xxx crawler, datamining, forensics, intelligence, opensource, scanner, search, security, tools - 9 | id:126 - scans your network
