Ethical, compliant, and powerful data collection system
Two production-ready projects for collecting IP intelligence from Regional Internet Registries and web data from public APIs with built-in compliance and rate limiting.
Built-in compliance with robots.txt, rate limiting, and official API usage. No unauthorized scraping.
SQLite with JSON blob storage supports any data structure. Easy to query and export.
All 5 Regional Internet Registries (RIRs) supported: RIPE, ARIN, APNIC, AFRINIC, LACNIC.
Powerful command-line tools for collection, search, export, and statistics.
Containerized with Docker and docker-compose for easy deployment anywhere.
43 automated tests with 100% pass rate. Verified with real data collection.
Global IP allocation tracking from Regional Internet Registries
Collects and stores IP address allocation data from all 5 Regional Internet Registries (RIRs). Includes ASN tracking, WHOIS enrichment, and powerful search capabilities.
Ethical API-first web data collection with compliance built-in
API-first data collection platform with robots.txt compliance, rate limiting, and flexible storage. Perfect for business intelligence and market research.
Installation, setup, and quick start guide
Deploy to Docker, cloud platforms, and production
IP Intelligence Database documentation
Web Data Collection Platform documentation
43 automated tests with 100% pass rate
Complete project metrics and achievements
Clone the repository and start collecting data in minutes