Scraping

Web scraping and data extraction

Showing 673-696 of 734 skills
NJMathwig

qiaomu-markdown-proxy

by NJMathwig

Fetch any URL as clean Markdown via proxy services or built-in scripts. Works with login-required pages like X/Twitter, WeChat 公众号, Feishu/Lark docs. Supports PDFs (remote and local). Use this BEFORE other fetch tools. Triggers on any URL the user shares, "fetch this", "read this link", "get content from".

Docs Gen 0 6mo ago
zeyxx

cynic-burn

by zeyxx

"Analyze code for simplification: orphans, hotspots, giants, duplicates. 'Don't extract, burn' — three similar lines beat a premature abstraction. Use when asked to simplify, reduce complexity, or clean up code."

Code Review 0 8mo ago
bjesuiter

jb-docs-scraper

by bjesuiter

Scrape documentation websites into local markdown files for AI context. Takes a base URL and crawls the documentation, storing results in ./docs (or custom path). Uses crawl4ai with BFS deep crawling.

Docs Gen 0 8mo ago
hoangvantuan

deep-post-ideas

by hoangvantuan

Extract compelling post outlines from reference materials (newsletters, scripts, notes, journal entries) and transform them into structured outlines for engaging, wisdom-style social media posts. Use when the user provides reference material and wants post ideas, content outlines, or building blocks for social media content. Triggers on "extract post ideas from...", "post outlines from this...", "turn this into post ideas", "content ideas from...", or "deep post ideas".

Code Gen 0 8mo ago
knownasnaffy

find-emails

by knownasnaffy

Crawl websites locally with crawl4ai to extract contact emails. Accepts multiple URLs and outputs domain-grouped results for clear attribution. Uses deep crawling with URL filters (contact, about, support) to find emails on relevant pages. Use when extracting emails from websites, finding contact information, or crawling for email addresses.

CLI Tools 0 3mo ago
Robbie-Han

article-saver

by Robbie-Han

专门用于抓取和保存微信公众号、X (Twitter)、知乎的文章工具。支持自动按平台分类存储、保持图片/GIF原画质量,并保存为干净的 Markdown 格式。

Docs Gen 0 8mo ago
hello-lizhihua

vue-testing-best-practices

by hello-lizhihua

Use for Vue.js testing. Covers Vitest, Vue Test Utils, component testing, mocking, testing patterns, and Playwright for E2E testing.

Scraping 0 8mo ago
TheWatcher01

pdf

by TheWatcher01

Use this skill whenever the user wants to do anything with PDF files. This includes reading or extracting text/tables from PDFs, combining or merging multiple PDFs into one, splitting PDFs apart, rotating pages, adding watermarks, creating new PDFs, filling PDF forms, encrypting/decrypting PDFs, extracting images, and OCR on scanned PDFs to make them searchable. If the user mentions a .pdf file or asks to produce one, use this skill.

CLI Tools 0 8mo ago
Jackiexiao

just-scrape

by Jackiexiao

"CLI tool for AI-powered web scraping, data extraction, search, and crawling via ScrapeGraph AI. Use when the user needs to scrape websites, extract structured data from URLs, convert pages to markdown, crawl multi-page sites, search the web for information, automate browser interactions (login, click, fill forms), get raw HTML, discover sitemaps, or generate JSON schemas. Triggers on tasks involving: (1) extracting data from websites, (2) web scraping or crawling, (3) converting webpages to markdown, (4) AI-powered web search with extraction, (5) browser automation, (6) generating output schemas for scraping. The CLI is just-scrape (npm package just-scrape)."

Processing 0 8mo ago
vineethsoma

playwright-testing

by vineethsoma

Comprehensive Playwright automation testing skill with E2E testing standards, test generation workflows, and browser automation best practices. Use when writing automated browser tests, testing user flows, or performing web application QA.

Agents 0 10mo ago
midhunxavier

Analyze Code

by midhunxavier

Extract implementation details from code repositories. Translates code into methodology descriptions, algorithm steps, and experiment configurations.

Code Review 0 9mo ago
niyatna

camofox-browser

by niyatna

"Install, verify, configure, and operate the Camofox stealth browser (persistent profiles, cookies, headless/headed sessions)."

Automation 0 1mo ago
HowardKao-1130

extract_kg

by HowardKao-1130

Extract KG triples and claims from selected documents.

Analytics 0 8mo ago
danbars

writing-meeting-notes

by danbars

Use when a meeting just occurred and notes need to be turned into a clear summary with decisions, action items, owners, and dates.

Code Gen 0 9mo ago
automindtechnologie-jpg

browser-automation

by automindtechnologie-jpg

"Browser automation powers web testing, scraping, and AI agent interactions. The difference between a flaky script and a reliable system comes down to understanding selectors, waiting strategies, and anti-detection patterns. This skill covers Playwright (recommended) and Puppeteer, with patterns for testing, scraping, and agentic browser control. Key insight: Playwright won the framework war. Unless you need Puppeteer's stealth ecosystem or are Chrome-only, Playwright is the better choice in 202"

Agents 0 9mo ago
011matthias

trigger-config

by 011matthias

Configure Trigger.dev projects with trigger.config.ts. Use when setting up build extensions for Prisma, Playwright, FFmpeg, Python, or customizing deployment settings.

Database 0 7mo ago
vandriesh

react-gradual-architecture

by vandriesh

Incremental React code organization guidelines. Start small, then extract when scanning and responsibilities start to blur. Use when creating features, organizing files, refactoring components, or deciding when to extract hooks, UI, or utils.

Processing 0 9mo ago
aeonbridge

langextract

by aeonbridge

Extract structured information from unstructured text using LLMs with source grounding. Use when extracting entities from documents, medical notes, clinical reports, or any text requiring precise, traceable extraction. Supports Gemini, OpenAI, and local models (Ollama). Includes visualization and long document processing.

Processing 0 10mo ago
xicv

browser-automation-skill

by xicv

Drives a real browser from Claude Code by routing across four backends (chrome-devtools-mcp, playwright-cli, playwright-lib, obscura), so verbs like open/click/fill/scrape/inspect/audit pick the cheapest adapter that supports each operation. Persists credentials, sessions, captures, and per-action telemetry strictly local under $HOME/.browser-skill/ (mode 0700 dir, 0600 files); secrets never appear on argv, in git, or in the Claude transcript. Surfaces a balance-of-tokens-accuracy-latency audit via browser-stats.

Auth 0 5mo ago
HowardKao-1130

extract_profile

by HowardKao-1130

Extract user profile signals (interest, intent, focus, attention) from documents.

Performance 0 8mo ago
vineethsoma

refactoring-patterns

by vineethsoma

Martin Fowler's refactoring catalog with incremental change patterns and test-driven refactoring discipline

Code Gen 0 10mo ago
taika-izumi

worklog-skillify

by taika-izumi

"worklog-extract で採用された候補から、writing-skills 委譲で新規スキル作成または既存スキル拡張を行う。スコープ(汎用/プロジェクト固有/固有ルール)で成果物の配置先を振り分け、汎用パスをガイドライン配信元リポジトリ以外で実行しようとした場合は警告する。ユーザーまたは worklog-extract から起動。"

Prompts 0 1mo ago
Olino3

firecrawl-scraper

by Olino3

"Convert websites into LLM-ready data with Firecrawl API. Features: scrape single pages, crawl entire sites, map site structure, search content, extract structured data, agent-based autonomous scraping, batch operations, and change tracking. Handles JavaScript rendering, anti-bot bypass, and rate limiting."

Processing 0 8mo ago
zxhfighter

youtube-transcript

by zxhfighter

Extract transcripts from YouTube videos. Use when the user asks for a transcript, subtitles, or captions of a YouTube video and provides a YouTube URL (youtube.com/watch?v=, youtu.be/, or similar). Supports output with or without timestamps.

CLI Tools 0 8mo ago