Scraping

Web scraping and data extraction

Showing 337-360 of 735 skills
HMS091

lightpanda

by HMS091

"Lightpanda headless browser (Zig, AI-focused) — use via Hermes MCP tools (mcp_lightpanda_*) for fast local bulk scraping / markdown dumps. When user asks to grab a page's content fast, batch-fetch many URLs, or dump a site to markdown/html without anti-bot concerns. NOT for anti-bot/login sites — use Scrapling/browser there."

Auth 0 8d ago
groupzer0

engineering-standards

by groupzer0

Core software engineering principles (SOLID, DRY, YAGNI, KISS) with detection patterns and refactoring guidance. Load when reviewing code quality, planning architecture, or identifying technical debt.

Code Gen 292 10mo ago
samhvw8

chrome-devtools

by samhvw8

"Browser automation via Puppeteer CLI scripts (JSON output). Capabilities: screenshots, PDF generation, web scraping, form automation, network monitoring, performance profiling, JavaScript debugging, headless browsing. Actions: screenshot, scrape, automate, test, profile, monitor, debug browser. Keywords: Puppeteer, headless Chrome, screenshot, PDF, web scraping, form fill, click, navigate, network traffic, performance audit, Lighthouse, console logs, DOM manipulation, element selector, wait, scroll, automation script. Use when: taking screenshots, generating PDFs from web, scraping websites, automating form submissions, monitoring network requests, profiling page performance, debugging JavaScript, testing web UIs."

CLI Tools 15 8mo ago
acedergren

firecrawl

by acedergren

Web scraping and search CLI returning clean Markdown from any URL (handles JS-rendered pages, SPAs). Use when user requests: (1) "search the web for X", (2) "scrape/fetch URL content", (3) "get content from website", (4) "find recent articles about X", (5) research tasks needing current web data, (6) extract structured data from pages. Outputs LLM-friendly Markdown, handles authentication via firecrawl login, supports parallel scraping for bulk operations. Automatically writes to .firecrawl/ directory. Triggers: web scraping, search web, fetch URL, extract content, Firecrawl, scrape website, get page content, web research, site map, crawl site.

Processing 25 8mo ago
idanbeck

playwright-skill

by idanbeck

Browser automation for web tasks. Use when the user needs to automate browser interactions, take screenshots, extract data from websites, fill forms, or perform web scraping. Supports persistent sessions for logged-in state.

Auth 14 8mo ago
tao3k

crawl4ai

by tao3k

Use when crawling web pages, extracting markdown content, or scraping website data with intelligent chunking and skeleton planning. Use when the user provides a URL or link to fetch or crawl.

Docs Gen 14 8mo ago
emdashcodes

docs-to-skill

by emdashcodes

Use this skill when the user wants to ingest a documentation site and generate a Claude Code skill from it. Converts documentation websites into structured skill packages with a SKILL.md index and markdown reference files.

Docs Gen 14 8mo ago
EngineerWithAI

airflow-dag-patterns

by EngineerWithAI

Build production Apache Airflow DAGs with best practices for operators, sensors, testing, and deployment. Use when creating data pipelines, orchestrating workflows, or scheduling batch jobs.

Automation 4 10mo ago
jxnl

youtube-extractor

by jxnl

Extract transcripts, titles, and thumbnails from YouTube videos. Use for ingesting video content, capturing captions with timestamps, or downloading video metadata.

CLI Tools 281 9mo ago
openclaw

4chan-reader

by openclaw

Browse 4chan boards and extract thread discussions into structured text files. Use when you need to fetch catalog information or specific thread content (including post text and file metadata) from 4chan boards like /a/, /vg/, /v/, etc.

Scraping 4.5K 8mo ago
openclaw

Instructions

by openclaw

All versions of all skills that are on clawhub.com archived

Processing 4.5K 8mo ago
parcadei

firecrawl-scrape

by parcadei

Scrape web pages and extract content via Firecrawl MCP

Processing 3.9K 9mo ago
joaquimscosta

playwright-cli

by joaquimscosta

Browser automation via Playwright CLI for navigating pages, interacting with elements, capturing screenshots, and testing web applications through shell commands. Use when user mentions "playwright", "browser automation", "take a screenshot", "browser testing", "headless browser", "web testing", "fill out a form", "e2e test", or needs to automate browser workflows from the command line. This is a pre-installed CLI tool — do NOT install anything via npx or npm. Invoke this skill first, then use playwright-cli bash commands.

CLI Tools 21 8mo ago
MimonWish

拼多多/1688 商品爬虫

by MimonWish

Pinduoduo 1688 ecommerce product scraper

CLI Tools 2 7mo ago
freestylefly

wechat-article-extractor

by freestylefly

Extract metadata and content from WeChat Official Account articles. Use when user needs to parse WeChat article URLs (mp.weixin.qq.com), extract article info (title, author, content, publish time, cover image), or convert WeChat articles to structured data. Supports various article types including posts, videos, images, voice messages, and reposts.

Scraping 137 8mo ago
salvo-rs

salvo-data-extraction

by salvo-rs

Extract and validate data from requests including JSON, forms, query parameters, and path parameters. Use for handling user input and API payloads.

Processing 20 8mo ago
vitalics

playwright-best-practices

by vitalics

Review code for Playwright Guidelines compliance. Use when asked to "review my playwright tests", "check accessibility", or "check my tests against best practices".

Accessibility 20 9mo ago
refly-ai

jina

by refly-ai

"Extract content from URLs and search with Jina. Use when you need to: (1) read and extract content from any URL, (2) perform site-specific searches, or (3) scrape web page content."

Agents 204 8mo ago
quran

pdf

by quran

Comprehensive PDF manipulation toolkit for extracting text and tables, creating new PDFs,

CLI Tools 1.9K 9mo ago
Cam10001110101

pdf

by Cam10001110101

Comprehensive PDF manipulation toolkit for extracting text and tables, creating new PDFs, merging/splitting documents, and handling forms. When Claude needs to fill in a PDF form or programmatically process, generate, or analyze PDF documents at scale.

CLI Tools 8 12mo ago
yoanbernabeu

supabase-extract-url

by yoanbernabeu

Extract the Supabase project URL from client-side JavaScript code, environment variables, and configuration files.

API Dev 70 8mo ago
vasilyu1983

document-pdf

by vasilyu1983

Extract text/tables from PDFs, create formatted PDFs, merge/split/rotate, handle forms and metadata. Supports pdf-lib/pdfkit (Node.js) and pypdf/pdfplumber/ReportLab (Python).

Code Gen 102 8mo ago
yoanbernabeu

supabase-extract-anon-key

by yoanbernabeu

Extract the Supabase anon/public API key from client-side code. This key is expected in client apps but important for RLS testing.

Processing 70 8mo ago
shiqkuangsan

tooyoung:ink-reader

by shiqkuangsan

"Intelligently read any URL content with auto platform detection and fallback strategies. Supports WeChat, Zhihu, Bilibili, Toutiao, Weibo, Xiaohongshu, Douyin, X/Twitter, and generic websites. Trigger words: read url, read link, read this, fetch url, grab content, ink-reader"

Scraping 17 8mo ago