Crawlee
An Apache-2.0-licensed crawling library you can run independently of Apify.
- All time
- — views
- — clicks
- Last 30 days
- — views
- — clicks
Loading activity…
What is Crawlee?
Key Features
HTTP and browser-based crawling
Playwright and Puppeteer integrations
Request queues, sessions and retries
Configurable storage and proxy integrations
Use Cases
- Building custom JavaScript or TypeScript crawlers
- Operating crawler code on owned infrastructure
- Adapting reusable Crawlee logic from custom Actors
How to Use Crawlee
- 1Install Crawlee in a compatible Node.js project.
- 2Implement and test a crawler against a permitted source.
- 3Configure hosting, storage, scheduling, monitoring and proxies as required.
Best For
FAQ
Can I use Crawlee without Apify?
Yes. The Apache-2.0-licensed library can run independently and does not require an Apify subscription.
Is Crawlee completely free to operate?
The software has no required library subscription. Compute, browser runtime, proxies, storage, monitoring and maintenance can still incur costs.
Will my Apify Actor run unchanged?
Not necessarily. Reusable Crawlee logic may transfer, while Apify-specific initialization, inputs, storage, scheduling and runtime APIs may need replacing.
Quick Info
Related Tools
More active tools in Automation.
Apify
The web scraping and automation cloud — 4,000+ ready-made Actors plus infrastructure for your own crawlers.
Axiom.ai
A no-code browser RPA bot — automate clicks, typing, and scraping in any web app from a Chrome extension.
Browse AI
Train a robot in two minutes to scrape and monitor any website — no code required.
Zyte
Host Scrapy spiders in Scrapy Cloud or use Zyte API for managed web extraction.