Agent skill · nousresearch
blocked-page-recovery
Use when a fetch fails: 403/429, paywall, WAF, bot wall.
What it needs
About 3k tokens when loaded.
What this skill does
Blocked-Page Recovery When a page won't fetch — 403/429, Cloudflare "Just a moment...", a paywall, or a bot-detection interstitial — don't give up and don't loop on the same URL. Third-party services often hold a copy of the page. Work down this ladder, cheapest first. The ladder Run it in one shot with the bundled script: The script tries each route in order, validates every body (see "Fake successes" below), and prints the first genuine hit with its provenance. Provenance discipline (non-negotiable) Every recovered copy carries a provenance you MUST preserve when citing: Route Provenance How to cite ------- ----------- ------------- Wayback / archive.today snapshot Cite WITH the snapshot date: "as archived 2026-08-06". Never present a snapshot as the live page — it may be stale. Jina Reader live Server-side re-render of the live page; cite normally. Live fetch / browser live Cite normally. If the user needs current data (prices, availability, breaking news), a snapshot is context, not an answer — say so explicitly and note its age. Manual routes 1. Wayback Machine (best provenance, try first) For enumerating many snapshots (or recovering deleted pages), the CDX index: CDX intermittently returns 503 under load — if it does, fall back to the available API; don't retry-hammer it. Works for: any publicly crawled URL. Fails for: robots-blocked sites, never-crawled URLs, JS-only SPAs (snapshots don't render). 2. archive.today (paywalls, deleted content) User-submitted archives — often has paywalled news articles Wayback lacks. Rate-limits aggressively (429) and rotates domains, so iterate: Validate the body, not the status code — a 429 still ships several KB of rate-limit HTML that looks like a success to a size check alone. 3. Jina Reader (requires JINAAPIKEY) r.jina.ai re-renders the live page in a real browser server-side and returns markdown. Anonymous access is dead (401 → Turnstile); a key is required: Handles JS SPAs that archives can't. …
How to use it
Reference it in AdaL, Claude Code, Cursor or any coding agent — nothing to install:
@skills nousresearch/blocked-page-recovery