Agent skill · data analytics · composiohq
Firecrawl Automation
Automate web crawling and data extraction with Firecrawl -- scrape pages, crawl sites, extract structured data, batch scrape URLs, and map website structures through the Composio Firecrawl integration.
Why this skill is useful
Adds multiple executable workflows for web crawling and data extraction that significantly enhance the AI's capabilities.
What it needs
Requires firecrawl installed locally. Requires composio account access. About 4k tokens when loaded. Last updated 2026-07-24. 71,973 stars on the source repository.
What this skill does
Firecrawl Automation Run Firecrawl web crawling and extraction directly from Claude Code. Scrape individual pages, crawl entire sites, extract structured data with AI, batch process URL lists, and map website structures without leaving your terminal. Toolkit docs: composio.dev/toolkits/firecrawl --- Setup 1. Add the Composio MCP server to your configuration: 2. Connect your Firecrawl account when prompted. The agent will provide an authentication link. 3. Be mindful of credit consumption -- scope your crawls tightly and test on small URL sets before scaling. --- Core Workflows 1. Scrape a Single Page Fetch content from a URL in multiple formats with optional browser actions for dynamic pages. Tool: FIRECRAWLSCRAPE Key parameters: url (required) -- fully qualified URL to scrape formats -- output formats: markdown (default), html, rawHtml, links, screenshot, json onlyMainContent (default true) -- extract main content only, excluding nav/footer/ads waitFor -- milliseconds to wait for JS rendering (default 0) timeout -- max wait in ms (default 30000) actions -- browser actions before scraping (click, write, wait, press, scroll) includeTags / excludeTags -- filter by HTML tags jsonOptions -- for structured extraction with schema and/or prompt Example prompt: "Scrape the main content from https://example.com/pricing as markdown" --- 2. Crawl an Entire Site Discover and scrape multiple pages from a website with configurable depth, path filters, and concurrency. …
How to use it
Reference it in AdaL, Claude Code, Cursor or any coding agent — nothing to install:
@skills composiohq/firecrawl-automation