crawlee

Web Scraping

apify/crawlee

26.2K1.7KTypeScriptApache-2.0

A tool for automatically scraping website data, with support for simulating browser operations to easily collect web information.

🕷️ Web Scraping🧩 Browser Automation

crawlee preview — Preview card generated by GitHub from the repository. Star counts on the card may lag behind the figures above.

Tool Info

Type🐙 Open Source

Stars26.2K

Forks1.7K

LanguageTypeScript

LicenseApache-2.0

Unlock the full analysis — free

You're reading the public preview of crawlee. The AI-written pros & cons, use cases, setup guide and audience fit are free with an account — no credit card. Pro adds AI comparisons (50 per 30 days) and member daily & weekly reports.

Compare crawlee with alternatives

See how it stacks up against other web scraping tools.

More Tools

firecrawl

193.9K

A web scraping and search API that helps AI agents and developers easily obtain web data.

Scrapling

89.0K

An adaptive web scraping framework that automatically extracts data from a single page or an entire website, saving time and effort.

crawl4ai

86.0K

Automatically crawl web content and organize it into a format AI can directly use, convenient for data analysis and knowledge bases.

MediaCrawler

67.6K

One-click crawling of notes, videos, and comments from platforms like Xiaohongshu, Douyin, and Bilibili to help you quickly collect social media data.

scrapy

64.9K

A Python web scraping framework that helps you quickly crawl website data, suitable for batch collection and data analysis.