42crawl

42crawl is an SEO crawler and analysis tool focused on website analysis for search engines and for AI-powered search systems. It describes its work as AI-ready SEO analysis and GEO readiness, and it is built to produce actionable reports and prioritized recommendations after a crawl.

The tool scans a site after the user enters a website URL. Its feature set includes dashboard health scores and overviews, SEO to-do items, meta tags and headings review, performance checks for speed and Core Web Vitals, a full page data table, broken link detection, crawlability checks for robots.txt and sitemap, accessibility checks for WCAG 2.1 compliance, and security analysis covering security headers, HTTPS status, and mixed content issues. The page also lists meta and content analysis, link health checks for broken links, redirect chains, and orphan pages, image optimization checks for missing alt tags, oversized images, and WebP opportunities, and performance metrics such as load times and HTML size. Additional features named on the site include AI bot access testing, analysis of llms.txt and ai.txt files, GEO analysis, internal link graph and PageRank, keyword ranking tracking, scheduled crawls, history and comparison, and task exports to Trello, Notion, and Jira.

Several features are marked as Pro or new. Pro features include GEO analysis, internal link analysis, international SEO checks with hreflang validation, scheduled crawls, full WCAG 2.1 accessibility, and indexNow submissions. The keyword ranking tracker can monitor Google positions over time, show position history with trend visualization, connect to free SERP API providers, support multiple countries and devices, and export ranking data as CSV. The site also mentions a fix-with-AI IDE feature that generates prompts for Lovable, Cursor, or Windsurf, or pushes fixes directly to Jules.

42crawl offers a free plan and a Pro plan. The free plan is listed at $0 per month and includes up to 100 pages per crawl, 2-level crawl depth, 3 crawls per day, 7-day history retention, basic SEO analysis, meta and content analysis, link health checks for 200 links, basic accessibility checks, AI bot access testing, task exports, fix-with-AI IDE prompts, full GEO readiness analysis, internal link graph and PageRank, and keyword ranking tracker. The Pro plan is listed at $4.20 per month or €4.20 per month and adds up to 1,000 pages per crawl, 5-level crawl depth, unlimited crawls per day, 90-day history retention, international SEO, PDF, Sheets, Looker, and task board exports, anchor text analysis, and IndexNow URL submissions. The page also states that no signup is required and that data stays private, with no tracking or selling.