crawlee-python

Web Scraping

apify/crawlee-python

9.6K812PythonApache-2.0

A Python library for building web scrapers that can pull page content, PDFs and images, with built-in proxy rotation and browser rendering.

🕷️ Web Scraping⚙️ Automation Workflows📊 Data Analysis

crawlee-python preview — Preview card generated by GitHub from the repository. Star counts on the card may lag behind the figures above.

Tool Info

Type🐙 Open Source

Stars9.6K

Forks812

LanguagePython

LicenseApache-2.0

Unlock the full analysis — free

You're reading the public preview of crawlee-python. The AI-written pros & cons, use cases, setup guide and audience fit are free with an account — no credit card. Pro adds AI comparisons (50 per 30 days) and member daily & weekly reports.

Compare crawlee-python with alternatives

See how it stacks up against other web scraping tools.

More Tools

firecrawl

193.9K

A web scraping and search API that helps AI agents and developers easily obtain web data.

Scrapling

89.0K

An adaptive web scraping framework that automatically extracts data from a single page or an entire website, saving time and effort.

crawl4ai

86.0K

Automatically crawl web content and organize it into a format AI can directly use, convenient for data analysis and knowledge bases.

MediaCrawler

67.6K

One-click crawling of notes, videos, and comments from platforms like Xiaohongshu, Douyin, and Bilibili to help you quickly collect social media data.

scrapy

64.9K

A Python web scraping framework that helps you quickly crawl website data, suitable for batch collection and data analysis.