CrawlForge
CrawlForge provides an enterprise web-scraping service with 27 MCP-native tools for extracting clean Markdown or structured JSON from websites. It connects to AI clients and custom code through an MCP server and API, with a hosted playground and credit-based usage.
Overview
8 featuresCrawlForge is a RAG, search & retrieval project. It focuses on collecting clean, structured web data for AI agents without building and maintaining scraping infrastructure. CrawlForge is a B2B product aimed at AI application developers and engineering teams. There is a free tier. CrawlForge is available on the web, the command line, and API.
It is developed by CrawlForge, and it first shipped in 2025. The project is developed in the open on GitHub with 110 commits in the last 90 days. Key capabilities include web scraping, content extraction, and Structured JSON. The interface is available in 4 languages, including English, Spanish, and Malay. It exposes integrations via an MCP server and a public API.
Summary written by a language model from the project’s public pages.
- Web scraping
- Content extraction
- Structured JSON
- Markdown output
- Web search
- MCP tools
- Credit-based usage
- Playground
Built with & integrations
- Next.js
- x-nextjs-prerender header · /_next/static/ in the HTML · __next_f in the HTML
- Vercel
- x-vercel-id header · x-vercel-cache header
- multiple
- bLangChain in the HTML · bLlamaIndex in the HTML
- local_oss
- bollama in the HTML
Trust & compliance
Indexing history
1What PulseGate has recorded for this listing
- Indexed14 Aug · 14:27 UTCCrawlForge v5.0.0: Security, Correctness, MCP Spec verified against its public sourceSource: PulseGate · Open
Frequently asked questions about CrawlForge
- What is CrawlForge?
- CrawlForge focuses on collecting clean, structured web data for AI agents without building and maintaining scraping infrastructure. It is catalogued under RAG, search & retrieval on PulseGate.
- Who is CrawlForge for?
- CrawlForge is a B2B product built for AI application developers and engineering teams.
- Is CrawlForge free?
- Yes — there is a free tier, with paid plans for advanced use.
- What platforms does CrawlForge run on?
- CrawlForge runs on the web, the command line, and API.
- Is CrawlForge still maintained?
- The GitHub repository shows 110 commits in the last 90 days.
- Who develops CrawlForge?
- CrawlForge is developed by CrawlForge.
- How long has CrawlForge been around?
- CrawlForge first shipped in 2025.
- Is CrawlForge open source?
- CrawlForge has a public GitHub repository.
Similar projects
Closest matches by what these projects do