Skip to content
Back to the index

crawlr

PyPIInfrastructure

PulseGate's liveness check found it on 14 Sep 2026; it is registered on GitHub and PyPI and has been in the index since 15 Jul 2026. How this is checked

Crawlr is an open-source, AI-powered command-line tool for web scraping, designed to be self-healing and robust against site changes. It specializes in e-commerce price intelligence and monitoring, making it ideal for developers and data engineers who need reliable, automated data extraction from online stores.

Inferred · not functionally tested

Open SourceMITCLI
Visit PyPI

Overview

6 features

Purpose: Automating and maintaining robust web scraping for e-commerce price monitoring without manual intervention.

Inferred · not functionally tested

Audience: developers and data engineers

Inferred · not functionally tested

Functions: data_extraction, monitoring

Inferred · not functionally tested

Interfaces: API: unknown · MCP: unknown · CLI: indicated (inferred, not tested) · Self-hosting: unknown

Recorded constraints: pricing: open_source · license: MIT · platforms: CLI · deployment: cli

Constraint provenance is unknown; confirm requirements with the publisher.

Record sources: pypi.org · github.com. These links do not verify the individual claims.

In the CLI tools & terminal space, crawlr takes a focused approach. Inferred · not functionally tested: It focuses on automating and maintaining robust web scraping for e-commerce price monitoring without manual intervention. Inferred · not functionally tested: crawlr is an open-source project aimed at developers and data engineers. Basis unknown · not verified: crawlr is open source under the MIT license. Basis unknown · not verified: It ships for the command line.

crawlr first shipped in 2026. Development happens publicly on GitHub with 19 commits in the last 90 days. Inferred · not functionally tested: Among its 6 catalogued features are self-healing scraping, E-commerce focus, and price monitoring.

Summary written by a language model from the project’s public pages.

Tasks: Inferred · not functionally tested

  • Self-healing scraping
  • E-commerce focus
  • Price monitoring
  • CLI interface
  • AI-powered extraction
  • MIT License

Topics: Inferred · not functionally tested

Tags
web-scrapingprice-monitoringself-healing-scraperecommerce-intelligencecli-tool
AI capabilities
Text

JSON profile · Text profile · Access guide

Built with & integrations

Framework
FastAPI
Runs on
CLI

Trust & compliance

License
MIT
Public signals
HTTPSOpen SourceFree tierGitHubActive maintenance

Indexing history

1

What PulseGate has recorded for this listing

  1. Indexed15 Jul · 12:20 UTC
    crawlr seen via PyPI Bulk Enumerator
    Source: PyPI Bulk Enumerator · Open

Frequently asked questions about crawlr

What does crawlr do?
Inferred · not functionally tested: Crawlr focuses on automating and maintaining robust web scraping for e-commerce price monitoring without manual intervention. It is catalogued under CLI tools & terminal on PulseGate.
Who should use crawlr?
Inferred · not functionally tested: crawlr is an open-source project built for developers and data engineers.
Is crawlr free?
Basis unknown · not verified: Yes — crawlr is open source under the MIT license and free to use.
What platforms does crawlr run on?
Basis unknown · not verified: crawlr runs on the command line.
Is crawlr still maintained?
PulseGate's liveness check found it on 14 Sep 2026. Its GitHub repository shows 19 commits in the last 90 days.
When did crawlr launch?
crawlr first shipped in 2026.
Is crawlr open source?
Basis unknown · not verified: Yes — crawlr is open source under the MIT license, developed on GitHub.

Similar projects

Closest matches by what these projects do