Agent skill · writing content · rookie-ricardo
web-to-markdown
Convert a web URL into cleaned Markdown with deterministic routing. Use when Codex needs to read article-like content from links and should apply source-aware fetch strategies: default to r.jina.ai for general pages (including X/Twitter), use defuddle.md for YouTube links, and use browser-impersonated extraction for WeChat/Zhihu/Feishu pages with Mozilla Readability cleanup.
Why this skill is useful
Adds executable scripts for domain-aware URL fetching and Markdown conversion that are not commonly available in public documentation.
What it needs
Requires npm installed locally. About 2k tokens when loaded. Last updated 2026-07-25. 929 stars on the source repository.
What this skill does
Web To Markdown Convert URLs into usable Markdown by applying domain-aware fetching routes, then return the cleaned content directly. Quick Workflow 1. Normalize and validate the input URL. 2. Select route: r.jina.ai: general web + X/Twitter. defuddle.md: YouTube transcript/content extraction. special-browser-fetch: WeChat/Zhihu/Feishu. 3. Return markdown text (or JSON metadata if needed). For generic URLs (non-YouTube, non-WeChat/Zhihu/Feishu), use this fallback chain: try r.jina.ai first, if it fails, fallback to direct HTTP fetch + Readability, if direct fetch still fails or returns shell-like content, fallback to browser extraction. Commands Run from this skill directory (skills/web-to-markdown): Return metadata with markdown: Force special-site browser extraction: Routing Policy Default route: https://r.jina.ai/<url>. YouTube (youtube.com, youtu.be): https://defuddle.md/<url>. X/Twitter (x.com, twitter.com): https://r.jina.ai/<url>. WeChat/Zhihu/Feishu: run scripts/fetchspecialsites.mjs. If input is already proxy-formatted (https://defuddle.md/https://... or https://r.jina.ai/https://...), normalize back to the original URL and re-apply routing. Special-Site Extraction Behavior Use a two-stage strategy for WeChat/Zhihu/Feishu: 1. Try cuimp HTTP/TLS impersonation first, then clean HTML with Mozilla Readability. 2. If stage 1 fails or returns blocked/shell content, fallback to puppeteer-extra browser impersonation. HTTP stage impersonates modern Chrome TLS/HTTP profile via cuimp. Browser stage impersonates a modern Chrome user agent and standard sec-ch-ua headers. Remove known login modals and backdrop overlays (best effort). Scroll the page to trigger lazy-loaded article blocks. Parse cleaned document with Mozilla Readability. Convert extracted HTML body to Markdown via Turndown. Resolve browser executable from CHROMEPATH first, then system Chrome/Chromium/Edge paths. …
How to use it
Reference it in AdaL, Claude Code, Cursor or any coding agent — nothing to install:
@skills rookie-ricardo/web-to-markdown