OpenRobots
OpenRobots is a browser-based generator and auditor for robots.txt and llms.txt files. It provides presets and controls for allowing or blocking more than 50 AI crawlers, including training, search, and assistant bots, without requiring an account or uploading data.
Overview
10 featuresIn the Other SEO & content space, OpenRobots takes a focused approach. It focuses on managing how AI crawlers access and use website content without manually maintaining crawler rules. OpenRobots is an open-source project aimed at website owners and SEO professionals. The project is open source (MIT). It runs on the web and the command line.
It is developed by OpenRobots contributors, and it first shipped in 2026. The project is developed in the open on GitHub with 11 commits in the last 90 days. Key capabilities include robots.txt generation, llms.txt generation, and crawler auditing.
Summary written by a language model from the project’s public pages.
- Robots.txt generation
- Llms.txt generation
- Crawler auditing
- AI crawler presets
- Crawler filtering
- Training bot controls
- Search bot controls
- In-browser processing
- No signup
- No tracking
Built with & integrations
- Next.js
- x-nextjs-prerender header · /_next/static/ in the HTML · __next_f in the HTML
- Vercel
- x-vercel-id header · x-vercel-cache header
- google_gemini
- aiplatform in the HTML
Trust & compliance
Indexing history
1What PulseGate has recorded for this listing
- Indexed5 Sept · 23:07 UTCShow HN: Openrobots verified via Hacker News firehose (Algolia)Source: Hacker News firehose (Algolia) · Open
Frequently asked questions about OpenRobots
- What does OpenRobots do?
- OpenRobots focuses on managing how AI crawlers access and use website content without manually maintaining crawler rules. It is catalogued under Other SEO & content on PulseGate.
- Who should use OpenRobots?
- OpenRobots is an open-source project built for website owners and SEO professionals.
- Is OpenRobots free?
- Yes — OpenRobots is open source under the MIT license and free to use.
- What platforms does OpenRobots run on?
- OpenRobots runs on the web and the command line.
- Is OpenRobots still maintained?
- The GitHub repository shows 11 commits in the last 90 days.
- What projects are similar to OpenRobots?
- Similar projects tracked by PulseGate include robots2.txt, ai-crawler-robots, and OpenBotAuth.robots2.txtai-crawler-robotsOpenBotAuth
- Who develops OpenRobots?
- OpenRobots is developed by OpenRobots contributors.
- When did OpenRobots launch?
- OpenRobots first shipped in 2026.
Similar projects
Closest matches by what these projects do