Agent skill · bighardperson
playwright-scraper-skill
Playwright-based web scraping OpenClaw Skill with anti-bot protection. Successfully tested on complex sites like Discuss.com.hk.
What it needs
About 3k tokens when loaded.
What this skill does
Playwright Scraper Skill A Playwright-based web scraping OpenClaw Skill with anti-bot protection. Choose the best approach based on the target website's anti-bot level. --- 🎯 Use Case Matrix Target Website Anti-Bot Level Recommended Method Script --------------- ---------------- ------------------- -------- Regular Sites Low webfetch tool N/A (built-in) Dynamic Sites Medium Playwright Simple scripts/playwright-simple.js Cloudflare Protected High Playwright Stealth ⭐ scripts/playwright-stealth.js YouTube Special deep-scraper Install separately Reddit Special reddit-scraper Install separately --- 📦 Installation --- 🚀 Quick Start 1️⃣ Simple Sites (No Anti-Bot) Use OpenClaw's built-in webfetch tool: --- 2️⃣ Dynamic Sites (Requires JavaScript) Use Playwright Simple: Example output: --- 3️⃣ Anti-Bot Protected Sites (Cloudflare etc.) Use Playwright Stealth: Features: Hide automation markers (navigator.webdriver = false) Realistic User-Agent (iPhone, Android) Random delays to mimic human behavior Screenshot and HTML saving support --- 4️⃣ YouTube Video Transcripts Use deep-scraper (install separately): --- 📖 Script Descriptions scripts/playwright-simple.js Use Case: Regular dynamic websites Speed: Fast (3-5 seconds) Anti-Bot: None Output: JSON (title, content, URL) scripts/playwright-stealth.js ⭐ Use Case: Sites with Cloudflare or anti-bot protection Speed: Medium (5-20 seconds) Anti-Bot: Medium-High (hides automation, realistic UA) Output: JSON + Screenshot + HTML file Verified: 100% success on Discuss.com.hk --- 🎓 Best Practices 1. Try webfetch First If the site doesn't have dynamic loading, use OpenClaw's webfetch tool—it's fastest. 2. Need JavaScript? Use Playwright Simple If you need to wait for JavaScript rendering, use playwright-simple.js. 3. Getting Blocked? Use Stealth If you encounter 403 or Cloudflare challenges, use playwright-stealth.js. 4. …
How to use it
Reference it in AdaL, Claude Code, Cursor or any coding agent — nothing to install:
@skills bighardperson/Playwright Scraper