Agent skill · marketing growth · sickn33
seo-technical
Audit technical SEO across crawlability, indexability, security, URLs, mobile, Core Web Vitals, structured data, JavaScript rendering, and related platform signals like robots.txt and AI crawler access.
Why this skill is useful
Provides specific technical SEO audit procedures and checks that the AI wouldn't reliably generate on its own.
What it needs
About 5k tokens when loaded. Last updated 2026-08-07. 44,571 stars on the source repository.
What this skill does
Technical SEO Audit When to Use Use when the user wants a technical SEO review focused on crawlability, indexability, performance, or rendering. Use when auditing robots.txt, canonicalization, JavaScript SEO, Core Web Vitals, or AI crawler access. Use when the task is infrastructure- and implementation-oriented rather than content-focused. Categories 1. Crawlability robots.txt: exists, valid, not blocking important resources XML sitemap: exists, referenced in robots.txt, valid format Noindex tags: intentional vs accidental Crawl depth: important pages within 3 clicks of homepage JavaScript rendering: check if critical content requires JS execution Crawl budget: for large sites (>10k pages), efficiency matters AI Crawler Management As of 2025-2026, AI companies actively crawl the web to train models and power AI search. Managing these crawlers via robots.txt is a critical technical SEO consideration. Known AI crawlers: Crawler Company robots.txt token Purpose --------- --------- ----------------- --------- GPTBot OpenAI GPTBot Model training ChatGPT-User OpenAI ChatGPT-User Real-time browsing ClaudeBot Anthropic ClaudeBot Model training PerplexityBot Perplexity PerplexityBot Search index + training Bytespider ByteDance Bytespider Model training Google-Extended Google Google-Extended Gemini training (NOT search) CCBot Common Crawl CCBot Open dataset Key distinctions: Blocking Google-Extended prevents Gemini training use but does NOT affect Google Search indexing or AI Overviews (those use Googlebot) Blocking GPTBot prevents OpenAI training but does NOT prevent ChatGPT from citing your content via browsing (ChatGPT-User) ~3-5% of websites now use AI-specific robots.txt rules Example, selective AI crawler blocking: Recommendation: Consider your AI visibility strategy before blocking. Being cited by AI systems drives brand awareness and referral traffic. Cross-reference the seo-geo skill for full AI visibility optimization. 2. …
How to use it
Reference it in AdaL, Claude Code, Cursor or any coding agent — nothing to install:
@skills sickn33/seo-technical