Agent skill · writing content · davila7
scrape
Scrape any webpage as clean markdown via Bright Data Web Unlocker API. Bypasses bot detection and CAPTCHA. Requires BRIGHTDATA_API_KEY and BRIGHTDATA_UNLOCKER_ZONE environment variables.
Why this skill is useful
Adds a script for scraping webpages that bypasses bot detection and CAPTCHA, which the AI wouldn't generate on its own.
What it needs
Requires curl installed locally. Requires brightdata account access. About 1k tokens when loaded. Last updated 2026-08-06. 30,138 stars on the source repository.
What this skill does
Bright Data - Web Scraper Scrape any webpage and get clean markdown content using Bright Data's Web Unlocker API. Automatically bypasses bot detection and CAPTCHA. Setup 1. Get your API Key: Get a key from Bright Data Dashboard. 2. Create a Web Unlocker zone: Create a zone at brightdata.com/cp by clicking "Add" (top-right), selecting "Unlocker zone". 3. Set environment variables: Usage Parameters: url (required): The webpage URL to scrape Examples: Output Format Returns clean markdown content extracted from the webpage: Features Bot Detection Bypass: Automatically handles anti-bot measures CAPTCHA Solving: Bypasses CAPTCHA challenges Clean Markdown: Returns well-formatted markdown content JavaScript Rendering: Handles JavaScript-heavy pages Dependencies curl - For API requests
How to use it
Reference it in AdaL, Claude Code, Cursor or any coding agent — nothing to install:
@skills davila7/scrape