Git-Fg

crawling-content

"High-speed read-only web extraction. Use when fetching documentation, blogs, and static pages. Do not use for apps requiring login or interaction."

Git-Fg 1 Updated 4mo ago
GitHub

Install

npx skillscat add git-fg/thecattoolkit/crawling-content

Install via the SkillsCat registry.

SKILL.md

Content Crawler Protocol

Usage

Use @just-every/crawl for zero-latency markdown extraction.

Single Page (Read)

npx -y @just-every/crawl "https://example.com"

Site Map (Spider)

npx -y @just-every/crawl "https://example.com" --pages 20 --output json

Failure Mode

If output contains "JavaScript required" or "Access Denied", STOP. Switch to Skill(browsing-web) to handle the dynamic rendering.