astrocrawl is an open-source, professional-grade web crawler offering both GUI and CLI interfaces. Built on Playwright and supporting async crawling, it features AI-powered data extraction, proxy rotation, and a declarative CSS rule engine. It is ideal for data engineers and technical users needing robust web scraping capabilities.
Latest indexed changes and source events
Other apps tracked under the same category.
