Collecting, crawling, searching, and extracting web content for applications and AI agents. It is catalogued under RAG, search & retrieval on PulseGate.

CRW is an open-source project built for developers building web-data and AI-agent applications.

Yes — CRW is open source under the Open Source license and free to use.

What platforms does CRW run on?

CRW runs on the web, the command line, and API. It can also be self-hosted.

Is CRW still maintained?

Unverified. CRW has not been re-checked since it entered the index, so there is no finding either way — and only a positive finding would say otherwise.

What projects are similar to CRW?

Similar projects tracked by PulseGate include fastCRW, firecrawl, and Firecrawl.

Yes — CRW is open source under the Open Source license.

Back to the index

CRW

Name: CRW
Author: us

github.comInfrastructure

CRW is a Rust-based web scraper, crawler, and search API that provides Firecrawl-compatible endpoints for scraping, crawling, and search workflows. It can run as a single self-hosted binary or through managed cloud infrastructure, and includes an MCP server for AI-agent integrations.

Open SourceWebCLISelf-hostedCloud-managedAPI

Visit github.com

1alternative

8features

2026since

Overview

8 features

CRW sits in PulseGate's RAG, search & retrieval category. Collecting, crawling, searching, and extracting web content for applications and AI agents. It is built as an open-source project for developers building web-data and AI-agent applications. CRW is open source under the Open Source license. It runs on the web, the command line, and API, and it can be self-hosted.

It is developed by us. Among its 8 catalogued features are Web Scraping, Web Crawling, and Search API. It exposes integrations via an MCP server and a public API.

Summary written by a language model from the project’s public pages.

Web Scraping
Web Crawling
Search API
MCP Server
Firecrawl API
Single Binary
Self Hosting
AI Agent Support

Built with & integrations

Connectors

MCPAPI

Runs on

BrowserCLISelf-hostedCloud-managedAPI-only

Trust & compliance

License

Open Source

Verified signals

HTTPSOpen Source

Indexing history

What PulseGate has recorded for this listing

Indexed2 Sept · 06:34 UTC
CRW Web Scraper verified against its public source
Source: PulseGate · Open

Frequently asked questions about CRW

What is CRW?: Collecting, crawling, searching, and extracting web content for applications and AI agents. It is catalogued under RAG, search & retrieval on PulseGate.
Who is CRW for?: CRW is an open-source project built for developers building web-data and AI-agent applications.
Is CRW free?: Yes — CRW is open source under the Open Source license and free to use.
What platforms does CRW run on?: CRW runs on the web, the command line, and API. It can also be self-hosted.
Is CRW still maintained?: Unverified. CRW has not been re-checked since it entered the index, so there is no finding either way — and only a positive finding would say otherwise.
What projects are similar to CRW?: Similar projects tracked by PulseGate include fastCRW, firecrawl, and Firecrawl.fastCRW firecrawl Firecrawl
Who develops CRW?: CRW is developed by us.
Is CRW open source?: Yes — CRW is open source under the Open Source license.

At a glance

Pricing: Open Source
Platforms: API · CLI · Web
Languages: English
License: Open Source
First seen: 2 Sept 2026
Built for: developers building web-data and AI-agent applications
Model: Open source
Solves: Collecting, crawling, searching, and extracting web content for applications and AI agents.

Developer

Index record

Indexed: 2 Sept 2026
Lifecycle: Alive
First seen: Sept 2026
Last seen: 2 Sept 2026

Identity audit (13)

Slug: crw-web-scraper-github-com
Lifecycle state recorded: 2 Sept 2026
Verification state: Indexed for public listing
Listing state: Listed: yes
Index status: Included in index
Latest evidence snapshot: 2 Sept 2026
Timeline basis: Indexed-at chronology (no inferred launch/funding milestones).
Name from: Written by a language model from the project's public pages.
Category from: Assigned by a language model.
Summary from: Written by a language model from public pages.
Languages from: Detected by a language model, checked against the page's own declaration.
Last updated: 2 Sept 2026
Canonical URL: https://github.com/us/crw

Ship this? Send a correction — no account, and you get a link to follow it.

Similar projects

Closest matches by what these projects do