Agent skill · data analytics · nousresearch
scrapling
Scrape sites with stealth browsing and Cloudflare bypass.
Why this skill is useful
Adds niche commands and strategies for bypassing Cloudflare and scraping dynamic content that the AI wouldn't reliably generate on its own.
What it needs
Requires python, scrapling installed locally. About 4k tokens when loaded. Last updated 2026-08-07. 226,679 stars on the source repository.
What this skill does
Scrapling Scrapling is a web scraping framework with anti-bot bypass, stealth browser automation, and a spider framework. It provides three fetching strategies (HTTP, dynamic JS, stealth/Cloudflare) and a full CLI. This skill is for educational and research purposes only. Users must comply with local/international data scraping laws and respect website Terms of Service. When to Use Scraping static HTML pages (faster than browser tools) Scraping JS-rendered pages that need a real browser Bypassing Cloudflare Turnstile or bot detection Crawling multiple pages with a spider When the built-in webextract tool does not return the data you need Installation Minimal install (HTTP only, no browser): With browser automation only: Quick Reference Approach Class Use When ---------- ------- ---------- HTTP Fetcher / FetcherSession Static pages, APIs, fast bulk requests Dynamic DynamicFetcher / DynamicSession JS-rendered content, SPAs Stealth StealthyFetcher / StealthySession Cloudflare, anti-bot protected sites Spider Spider Multi-page crawling with link following CLI Usage Extract Static Page With CSS selector and browser impersonation: Extract JS-Rendered Page Extract Cloudflare-Protected Page POST Request Output Formats The output format is determined by the file extension: .html -- raw HTML .md -- converted to Markdown .txt -- plain text .json / .jsonl -- JSON Python: HTTP Scraping Single Request Session (Persistent Cookies) POST / PUT / DELETE With Proxy Python: Dynamic Pages (JS-Rendered) For pages that require JavaScript execution (SPAs, lazy-loaded content): Wait for Specific Element Disable Resources for Speed Blocks fonts, images, media, stylesheets (~25% faster): Custom Page Automation Python: Stealth Mode (Anti-Bot Bypass) For Cloudflare-protected or heavily fingerprinted sites: Stealth Session Element Selection All fetchers return a Selector object with these methods: CSS Selectors XPath Find Methods Similar Elements Find elements with similar structure (useful for …
How to use it
Reference it in AdaL, Claude Code, Cursor or any coding agent — nothing to install:
@skills nousresearch/scrapling