Skip to content

[GitHub Trending] D4Vinci/Scrapling

7.3 relevance
Score Breakdown
technical depth
7
novelty
6
actionability
8
community
7
strategic
3
personal
4

Scored daily by a customisable AI persona to surface the most relevant engineering leadership news.

Web scraping framework, not strongly aligned with reader's core interests.

Open Source github.com
🕷️ An adaptive Web Scraping framework that handles everything from a single request to a full-scale crawl! - D4Vinci/Scrapling
Summary

Scrapling, trending on GitHub, is a Python web scraping framework featuring adaptive parsers that auto-relocate elements and fetchers like StealthyFetcher for bypassing Cloudflare Turnstile. Its Spider API supports concurrent multi-session crawls with pause/resume and proxy rotation, while the adaptive=True parameter lets scraped data survive site redesigns. MCP and N8N integrations extend automation workflows.

Author

D4Vinci