Scrapling
BSD-3 adaptive scrape/crawl framework + MCP
AI Agents / Browser Automation · BSD-3-Clause · 88.5k
Reviewed 2026-09-15 · last push 2026-10-18 · repo checked 2026-10-19
What's Good
BSD-3-Clause (D4Vinci/Scrapling). Handles fetching, parsing, and crawl scale with an adaptive stance toward modern sites. Docs at scrapling.readthedocs.io; Docker Hub image; MCP surface so agents can call scrape tools without inventing another HTTP client. pip-installable Python stack.
The Catch
Vs Firecrawl-style hosted scrape APIs: Scrapling is a library/framework you run (plus MCP), not a metered scrape SaaS with a managed anti-bot fleet. You own proxies, blockers, and ops; MCP does not erase site ToS or legal risk. Not a general browser-agent product like Browser Use/Steel.
Verdict
BSD-3 adaptive scrape/crawl + MCP. Self-run framework vs Firecrawl-shaped APIs.
Embed
Maintainer? Add the badge to your README. It is free, links to this review, and there is no paid version.
Markdown
[](https://stackgems.com/gems/scrapling)
HTML
<a href="https://stackgems.com/gems/scrapling"><img src="https://stackgems.com/badge/scrapling.svg" alt="Scrapling reviewed on Stack Gems" height="20"></a>
Related
AI Agents →- StagehandAI-native browser automation that mixes code and natural language
- Browser UseOpen-source framework for LLM-driven browser agents
- Playwright MCPOfficial Microsoft MCP server for Playwright browser automation
- Chrome DevTools MCPOfficial Chrome DevTools as an MCP server for coding agents
- agent-browserVercel Labs Rust CLI with compact a11y refs for agents