PulseGatePost-LLM software, agents & workflows market (since 2022)
Coverage
166,852

Apps indexed

 

Freshness
43 min ago

Last update

 

Cadence
1,442/day

7-day average

Indexed today: 576

PulseGate

Market catalog for public software products, models, infra, and workflow tools.

Software is shipping faster than ever, and a growing share of it lives outside the official app stores. PulseGate is a free public catalog — built for builders, analysts, and everyday users.

Platform

  • All Apps
  • Categories
  • Industry Updates
  • Data Sources
  • Coverage Rules
  • Glossary
  • Embed Widget

Support

  • Help Center
  • Submit a Project
  • Report an Issue

Company

  • About
  • Press & Data
  • Contact
  • Platform Status

Legal

  • Privacy
  • Terms
  • Disclaimer

© 2026 PulseGate. Operated by Dymaxio s.r.o., Prague, Czech Republic.·

All systems operational
PulseGate
CR
crawlboy
Visit ↗
  1. Home/
  2. CLI tools & terminal/
  3. crawlboy
←Back to results
C

crawlboy

github.com·Infrastructure

crawlboy is an open-source CLI tool that crawls sitemap URLs using Crawl4AI and exports the results as Markdown files. It is designed for developers and SEO professionals who need to automate website crawling and documentation.

Open SourceMIT
WebCLISelf-hosted
C
crawlboy preview
Visit github.com↗
⭐1
star
✓5
features
📅2026
since

Overview

5 features
  • ✓Sitemap crawling
  • ✓Markdown export
  • ✓Web scraping
  • ✓Command-line interface
  • ✓Open source

Tags

sitemap-crawlermarkdown-exportweb-scraping

Built with & integrations

Runs on
BrowserCLISelf-hosted

Trust & compliance

LicenseMIT
Verified signals
✓ HTTPS✓ Open Source✓ GitHub · ★ 1✓ Active maintenance

Recent events

Latest indexed changes and source events

  1. IndexedJun 25, 10:35 PM

    pypi.org discovered by the PulseGate indexer

    Source: PulseGate indexerOpen ↗

At a glance

Platforms
Cli
Languages
English
Open source
Yes · ★ 1
License
MIT
First seen
Jun 29, 2026
Activity
🟢 Active
Status
🟢 Active
Built for
Developers and technical SEO specialists
Model
Open source
Solves
Automates crawling of sitemap URLs and exports structured results for documentation or analysis.

Developer

aksharahegde
Solo developer
↗ GitHub

Open source

View on GitHub →
⭐ Stars
1
🍴 Forks
0
Open issues
0
Last commit
1mo ago
Commits 90d
15
Contributors
1
Authorship
Solo
Default branch
main
Latest release
v1.2.0 · 1mo ago

PulseGate index

Confidence
Low · 64
Indexed
Jun 25, 2026
Lifecycle
Alive
Activity
Active
First seen
Jun 2026
Last seen
2w ago
Freshness
Unknown
Identity audit (9)
Entity ID
cmqu30fz703yddntv1zuwlhtu
Slug
crawlboy-pypi-org
Verification state
Indexed for public listing
Claim / listing state
Unclaimed · listed: yes
Index status
Included in index
Latest evidence snapshot
Jun 25, 2026
Timeline basis
Indexed-at chronology (no inferred launch/funding milestones).
Last updated
Jun 25, 2026
Canonical URL
https://github.com/aksharahegde/crawlboy

Similar apps

Other apps tracked under the same category.

  • crawldown
    pypi.org
  • markcrawl
    github.com
  • crawler.sh
    crawler.sh
  • docscrape
    github.com
  • Thecrawltool
    thecrawltool.com
  • Web crawling and data extraction
    webcrawlerapi.com