Who should use Crawlee for Python?

Crawlee for Python is an open-source project built for python developers needing web scraping.

What platforms does Crawlee for Python run on?

Crawlee for Python runs on the web, the command line, and API.

Is Crawlee for Python still active?

The GitHub repository shows 188 commits in the last 90 days.

Who makes Crawlee for Python?

Crawlee for Python is developed by Crawlee contributors.

How long has Crawlee for Python been around?

Crawlee for Python first shipped in 2024.

Is Crawlee for Python open source?

Yes — Crawlee for Python is open source under the Apache-2.0 license, developed on GitHub.

Back to the index

Crawlee for Python

Name: Crawlee for Python
Author: Crawlee contributors

crawlee.devInfrastructure

Crawlee for Python is an open-source library for building fast and reliable web crawlers in Python. It provides features like proxy handling, browser automation, and data export, making web scraping accessible and efficient for developers.

Open SourceApache-2.0WebCLIAPI

Visit crawlee.dev

9.3kstars

764forks

5features

2024since

Overview

5 features

In the API design, testing & docs space, Crawlee for Python takes a focused approach. It focuses on building reliable and scalable web scrapers is complex; this library simplifies the process for developers. It is built as an open-source project for python developers needing web scraping. Crawlee for Python is open source under the Apache-2.0 license. Crawlee for Python is available on the web, the command line, and API.

It is developed by Crawlee contributors, and it first shipped in 2024. The project is developed in the open on GitHub with 9.3k stars and 188 commits in the last 90 days. Among its 5 catalogued features are web scraping, proxy support, and browser automation.

Summary written by a language model from the project’s public pages.

Web scraping
Proxy support
Browser automation
Data export
Python and JavaScript support

Built with & integrations

Hosting

AWS

Runs on

BrowserCLIAPI-only

Detected from

AWS: x-amz-cf-id header · x-amz-cf-pop header · via header

Trust & compliance

License

Apache-2.0

Verified signals

HTTPSOpen SourceFree tierGitHub · ★ 9.3kActive maintenance

Indexing history

What PulseGate has recorded for this listing

Indexed26 Jun · 13:46 UTC
Listing verified against its public source
Source: PulseGate · Open

Frequently asked questions about Crawlee for Python

What is Crawlee for Python?: Crawlee for Python focuses on building reliable and scalable web scrapers is complex; this library simplifies the process for developers. It is catalogued under API design, testing & docs on PulseGate.
Who should use Crawlee for Python?: Crawlee for Python is an open-source project built for python developers needing web scraping.
Does Crawlee for Python have a free plan?: Yes — Crawlee for Python is open source under the Apache-2.0 license and free to use.
What platforms does Crawlee for Python run on?: Crawlee for Python runs on the web, the command line, and API.
Is Crawlee for Python still active?: The GitHub repository shows 188 commits in the last 90 days.
Who makes Crawlee for Python?: Crawlee for Python is developed by Crawlee contributors.
How long has Crawlee for Python been around?: Crawlee for Python first shipped in 2024.
Is Crawlee for Python open source?: Yes — Crawlee for Python is open source under the Apache-2.0 license, developed on GitHub.

At a glance

Pricing: Open Source
Platforms: CLI · API · Web
Languages: English
Open source: Yes · ★ 9.3k
License: Apache-2.0
Built for: python developers needing web scraping
Model: Open source
Solves: Building reliable and scalable web scrapers is complex; this library simplifies the process for developers.

Registered as

GitHub: apify/crawlee-python
PyPI: crawlee

Developer

Crawlee contributors

Community-driven

GitHub

Open source

View on GitHub

Stars: 9,261
Forks: 764
Open issues: 78
Last commit: 26 Jun 2026
Commits 90d: 188
Contributors: 46
Authorship: Community-driven
Default branch: master
Latest release: v1.7.3 · 22 Jun 2026

Index record

Indexed: 26 Jun 2026
Lifecycle: Alive
Last seen: 26 Jun 2026

Identity audit (12)

Slug: crawlee-crawlee-dev
Lifecycle last checked: 8 Aug 2026
Verification state: Indexed for public listing
Listing state: Listed: yes
Index status: Included in index
Latest evidence snapshot: 26 Jun 2026
Timeline basis: Indexed-at chronology. This listing's first-seen date was written by the catalog backfill, not observed here, so it is not treated as a sighting.
Name from: Derived from the project's own page and URL.
Category from: Assigned by a language model.
Summary from: Written by a language model from public pages.
Languages from: Detected by a language model from page content.
Canonical URL: https://crawlee.dev/python

Ship this? Send a correction — no account, and you get a link to follow it.

Similar projects

Closest matches by what these projects do