{"data":[{"slug":"crawl4ai","name":"Crawl4AI","tagline":"Apache-2.0 LLM-friendly crawler — markdown for agents","category":"agents","url":"https://crawl4ai.com","github":"https://github.com/unclecode/crawl4ai","pricing":"open-source","hook":"Crawl4AI turns the web into clean, LLM-ready markdown — a crawler shaped for RAG and agents, not a generic scrape SDK.","whatsGood":"Apache-2.0 (unclecode/crawl4ai). Async Python crawler tuned for LLM pipelines: markdown extraction, chunking hooks, and agent-friendly output. Site at crawl4ai.com; pip-installable. Huge adoption (~84k★).","theCatch":"Vs Scrapling (adaptive scrape/crawl + MCP), Agent Reach (public-web CLI eyes), Browser Use/Stagehand (browser agents): Crawl4AI is an LLM-oriented crawler/extraction library, not a hosted scrape API, not a site-specific eyes CLI, and not a Playwright agent. You own proxies, blockers, rate limits, and site ToS.","verdict":"Apache-2.0 LLM crawler. Markdown-for-agents vs Scrapling/Agent Reach/Browser Use/Stagehand.","addedAt":"2026-09-16","featured":false,"domain":"AI Agents","subSpecialty":"Agents","subcategory":"Scraping for LLMs","tags":["sdk","self-host","permissive","rag","scraping","active","fast-stars"],"capabilities":["sdk"],"surfaces":["SDK","Self-host"],"ecosystem":["Multi-platform"],"licenseModel":"Apache-2.0","githubStars":85801,"starsPerWeek":672,"access":"free","archived":false,"repo":{"createdAt":"2024-05-09","pushedAt":"2026-10-19","license":"Apache-2.0","archived":false,"checkedAt":"2026-10-19"},"links":{"self":"/api/gems/crawl4ai","html":"/gems/crawl4ai","markdown":"/gems/crawl4ai.md"}},{"slug":"firecrawl","name":"Firecrawl","tagline":"AGPL-3.0 OSS + cloud scrape API — LLM-ready pages","category":"agents","url":"https://www.firecrawl.dev/","github":"https://github.com/firecrawl/firecrawl","pricing":"freemium","hook":"Firecrawl is the scrape/crawl API that returns LLM-ready markdown — self-host the AGPL engine or burn cloud credits.","whatsGood":"AGPL-3.0 core (firecrawl/firecrawl; org moved from mendableai). Scrape/crawl/map/search APIs aimed at agents and RAG. Cloud Free plan: 1,000 credits/mo (~1k basic pages), no card (firecrawl.dev/pricing). Self-host path exists for the OSS engine. Massive adoption (~181k★).","theCatch":"AGPL-3.0 on the open engine — network copyleft if you modify and offer it as a service. cloud: Free is only 1k credits/mo with low concurrency; Hobby starts ~$16–19/mo for 5k credits — past that you pay. Vs Scrapling/Crawl4AI (self-run libraries) and Agent Reach (zero-API-fee eyes CLI): Firecrawl is API-first with a metered cloud; self-host trades SaaS bill for AGPL+ops. Distinct from Scrapling/Crawl4AI — do not treat as the same card.","verdict":"AGPL+cloud scrape API. Freemium credits vs Scrapling/Crawl4AI self-run; license and Free-tier limits are loud.","addedAt":"2026-09-16","featured":false,"domain":"AI Agents","subSpecialty":"Agents","subcategory":"Scraping for LLMs","tags":["api","self-host","free-tier","copyleft","scraping","active","fast-stars"],"capabilities":["api"],"surfaces":["API","Self-host","Hosted"],"ecosystem":["Multi-platform"],"licenseModel":"Freemium","githubStars":192854,"starsPerWeek":1471,"access":"free","archived":false,"repo":{"createdAt":"2024-04-15","pushedAt":"2026-10-19","license":"AGPL-3.0","archived":false,"checkedAt":"2026-10-19"},"links":{"self":"/api/gems/firecrawl","html":"/gems/firecrawl","markdown":"/gems/firecrawl.md"}},{"slug":"tradingview-mcp","name":"TradingView MCP","tagline":"Local CDP bridge: Claude/agents on your TradingView Desktop charts","category":"agents","url":"https://github.com/tradesdontlie/tradingview-mcp","github":"https://github.com/tradesdontlie/tradingview-mcp","pricing":"open-source","hook":"TradingView MCP gives coding agents eyes and hands on your own TradingView Desktop charts via Chrome DevTools Protocol — chart analysis and Pine workflow, not a cloud scrape of TV.","whatsGood":"Unofficial MCP/CLI bridge to a locally running TradingView Desktop instance over CDP. Chart navigation, indicator reads, and Pine Script workflow stay on your machine; the README is explicit that it does not hit TradingView servers or redistribute market data. Hot builder signal on GitHub trending with a clear research framing: make a professional trading UI legible to an LLM agent.","theCatch":"You need a valid paid TradingView subscription plus Desktop with remote debugging enabled — the bridge does not bypass paywalls. Undocumented Electron internals can break on any TradingView update. Vs playwright-mcp / BrowserSkill / Hyperbrowser MCP: this is desktop TradingView CDP, not a general browser or scrape API. Not a trade-execution bot.","verdict":"Open MCP for agents on your TradingView Desktop. Paid TV sub required; chart interface layer, not a trading bot.","addedAt":"2026-09-19","featured":false,"domain":"AI Agents","subSpecialty":"Agents","subcategory":"Scraping for LLMs","tags":["mcp","desktop-app","self-host","local-first","permissive","license-unclear","coding-agents","browser-automation","scraping","workflows","active"],"capabilities":["mcp"],"surfaces":["MCP","Self-host"],"ecosystem":["Multi-platform"],"licenseModel":"OSS/MIT","githubStars":6867,"starsPerWeek":235,"access":"free","archived":false,"repo":{"createdAt":"2026-03-29","pushedAt":"2026-07-28","license":"NOASSERTION","archived":false,"checkedAt":"2026-10-19"},"links":{"self":"/api/gems/tradingview-mcp","html":"/gems/tradingview-mcp","markdown":"/gems/tradingview-mcp.md"}},{"slug":"growth-engineer","name":"growth.engineer","tagline":"MIT agent-readable GTM catalog — tools, functions, workflows via MCP","category":"agents","url":"https://www.growth.engineer","github":"https://github.com/GetBrew/growth-engineer","pricing":"open-source","hook":"growth.engineer is a MIT catalog of go-to-market tools and workflows written as markdown files agents can run — connect once to the read-only MCP and stop scraping human docs for “which key, which endpoint, what it costs.”","whatsGood":"MIT (GetBrew/growth-engineer). Live site + MCP at `https://www.growth.engineer/mcp` (HTTP 200); Claude Code / Codex / Cursor HTTP MCP one-liners in README. Catalog entries and workflows are files in the repo; self-host with `pnpm dev` if you want your own origin. ★~138.","theCatch":"Read-only catalog MCP — it does not execute vendor APIs for you; you still need each tool’s own keys when a workflow says so. Vs Apify MCP / generic awesome-lists: Apify runs Store Actors; this catch is GTM tool+workflow markdown as MCP prompts/tools. Vendor accuracy drifts — treat entries as starting maps, pin commits if you fork.","verdict":"MIT GTM catalog MCP when agents need operator maps for growth tools — not Apify scrape Actors and not a static awesome-list dump.","addedAt":"2026-10-04","featured":false,"domain":"AI Agents","subSpecialty":"Agents","subcategory":"Scraping for LLMs","tags":["mcp","self-host","permissive","scraping","workflows","active","young-repo"],"capabilities":["mcp"],"surfaces":["MCP","Self-host"],"ecosystem":["Multi-platform"],"licenseModel":"OSS/MIT","githubStars":249,"starsPerWeek":52,"access":"free","archived":false,"repo":{"createdAt":"2026-09-16","pushedAt":"2026-10-16","license":"MIT","archived":false,"checkedAt":"2026-10-19"},"links":{"self":"/api/gems/growth-engineer","html":"/gems/growth-engineer","markdown":"/gems/growth-engineer.md"}}],"meta":{"total":4,"count":4,"offset":0,"limit":null,"sort":"curated","sorts":["curated","catalog","new","stars","trending","name"],"filters":{"subcategory":"scraping-for-llms"},"next":null,"categories":["agents","nextjs","python","shopify","databases","devops","design","observability","rust","payments","comms","notifications","libraries"],"tags":["mcp","cli","tui","api","sdk","desktop-app","web-ui","editor-plugin","self-host","local-first","free-tier","paid-only","paid-led","permissive","copyleft","source-available","license-unclear","coding-agents","local-llm","rag","memory","evals","browser-automation","scraping","sandbox","skills","voice","security","auth","payments","realtime","postgres","vector","kubernetes","containers","observability","testing","workflows","graphics-3d","git","active","stale","archived","young-repo","fast-stars"]}}