Scraping

Web scraping and data extraction

Uses and selection guide

Use these skills to collect, transform and examine datasets. Compare supported formats, data volume and handling of missing values; inspect a small sample before applying a transformation to the complete dataset.

Showing 1-24 of 708 skills
open-metadata

writing-playwright-tests

by open-metadata

Redirect only — this skill was merged into playwright. Invoke playwright instead for Playwright E2E authoring guidance and the required lint gate.

Scraping 15.1K 10d ago
ComposioHQ

competitive-ads-extractor

by ComposioHQ

Extracts and analyzes competitors' ads from ad libraries (Facebook, LinkedIn, etc.) to understand what messaging, problems, and creative approaches are working. Helps inspire and improve your own ad campaigns.

Analytics 73.3K 10mo ago
openclaw

slacrawl

by openclaw

"Slack archive: search, sync freshness, threads/DMs, SQL counts, and Slacrawl repo work."

CLI Tools 389.1K 1d ago
openclaw

gitcrawl

by openclaw

"GitHub archive: issue/PR search, sync freshness, duplicate clusters, current GitHub handoff, and Gitcrawl repo work."

Git & VCS 389.1K 1d ago
manaflow-ai

cmux-browser

by manaflow-ai

"End-user browser automation with cmux. Use when you need to open sites, inspect or interact with browser surfaces, wait for page state, and extract data without stealing focus."

Automation 26.8K 5d ago
kepano

defuddle

by kepano

Extract clean markdown content from web pages using Defuddle CLI, removing clutter and navigation to save tokens. Use instead of WebFetch when the user provides a URL to read or analyze, for online documentation, articles, blog posts, or any standard web page. Do NOT use for URLs ending in .md — those are already markdown, use WebFetch directly.

CLI Tools 47.3K 5mo ago
eze-is

web-access

by eze-is

所有联网操作必须通过此 skill 处理,包括:搜索、网页抓取、登录后操作、网络交互等。

Automation 8.7K 3mo ago
0xMassi

webclaw

by 0xMassi

Web extraction engine with antibot bypass. Scrape, crawl, extract, summarize, search, map, diff, monitor, research, and analyze any URL — including Cloudflare-protected sites. Use when you need reliable web content, the built-in web_fetch fails, or you need structured data extraction from web pages.

Processing 2.3K 5mo ago
JimLiu

baoyu-post-to-weibo

by JimLiu

Posts content to Weibo (微博). Supports regular posts with text, images, and videos, and headline articles (头条文章) with Markdown input via Chrome CDP. Use when user asks to "post to Weibo", "发微博", "发布微博", "publish to Weibo", "share on Weibo", "写微博", or "微博头条文章".

Automation 25.4K 4mo ago
openai

playwright

by openai

"Use when the task requires automating a real browser from the terminal (navigation, form filling, snapshots, screenshots, data extraction, UI-flow debugging) via playwright-cli or the bundled wrapper script."

Automation 25.2K 7mo ago
SawyerHood

dev-browser

by SawyerHood

Browser automation with persistent page state. Use when users ask to navigate websites, fill forms, take screenshots, extract web data, test web apps, or automate browser workflows. Trigger phrases include "go to [url]", "click on", "fill out the form", "take a screenshot", "scrape", "automate", "test the website", "log into", or any browser interaction request.

Automation 6.6K 5mo ago
cloudflare

cloudflare-browser

by cloudflare

Control headless Chrome via Cloudflare Browser Rendering CDP WebSocket. Use for screenshots, page navigation, scraping, and video capture when browser automation is needed in a Cloudflare Workers environment. Requires CDP_SECRET env var and cdpUrl configured in browser.profiles.

Automation 10K 7mo ago
ALBEDO-TABAI

lets-go-rss

by ALBEDO-TABAI

轻量级全平台 RSS 订阅管理器。一键聚合 YouTube、Vimeo、Behance、Twitter/X、知识星球、B站、微博、抖音、小红书的内容更新,支持增量去重和 AI 智能分类。

Automation 99 4mo ago
walidgdg1-ai

dce-retrieval

by walidgdg1-ai

Resolve, download, preserve, unpack, extract, and hand off public tender DCE/procurement packs at high parallelism using the Tender Engine portal-adapter fleet.

Agents 0 23d ago
paperclipai

agent-browser

by paperclipai

Drive a real browser to inspect or interact with a web page or app — navigate, take screenshots, read console and network, fill simple forms — for verification tasks, not unattended automation.

Responsive 80.1K 3mo ago
mukul975

analyzing-windows-registry-for-artifacts

by mukul975

Extract and analyze Windows Registry hives to uncover user activity, installed software, autostart entries, and evidence of system compromise.

Code Review 31.3K 6mo ago
mukul975

analyzing-golang-malware-with-ghidra

by mukul975

Reverse engineer Go-compiled malware using Ghidra with specialized scripts for function recovery, string extraction, and type reconstruction in stripped Go binaries.

Processing 31.3K 6mo ago
mukul975

analyzing-pdf-malware-with-pdfid

by mukul975

Analyzes malicious PDF files using PDFiD, pdf-parser, and peepdf to identify embedded JavaScript, shellcode, exploits, and suspicious objects without opening the document. Determines the attack vector and extracts embedded payloads for further analysis. Activates for requests involving PDF malware analysis, malicious document analysis, PDF exploit investigation, or suspicious attachment triage.

Processing 31.3K 6mo ago
K-Dense-AI

histolab

by K-Dense-AI

Lightweight WSI tile extraction and preprocessing. Use for basic slide processing tissue detection, tile extraction, stain normalization for H&E images. Best for simple pipelines, dataset preparation, quick tile-based analysis. For advanced spatial proteomics, multiplexed imaging, or deep learning pipelines use pathml.

Analytics 34.7K 8mo ago
ArabelaTso

code-refactoring-assistant

by ArabelaTso

Suggest and apply code refactorings to improve readability, maintainability, and code quality. Use this skill when improving existing code structure, eliminating code smells, applying design patterns, simplifying complex logic, extracting duplicated code, renaming for clarity, or preparing code for new features. Provides specific before/after examples, explains benefits, identifies risks, and ensures behavior preservation through tests.

Code Gen 238 6mo ago
Prat011

pdf

by Prat011

Comprehensive PDF manipulation toolkit for extracting text and tables, creating new PDFs, merging/splitting documents, and handling forms. When Claude needs to fill in a PDF form or programmatically process, generate, or analyze PDF documents at scale.

CLI Tools 1.7K 10mo ago
Prat011

webapp-testing

by Prat011

Toolkit for interacting with and testing local web applications using Playwright. Supports verifying frontend functionality, debugging UI behavior, capturing browser screenshots, and viewing browser logs.

Automation 1.7K 10mo ago
wondelai

refactoring-patterns

by wondelai

'Apply named refactoring transformations to improve code structure without changing behavior. Use when the user mentions "refactor this", "code smells", "extract method", "replace conditional", or "technical debt". Covers smell-driven refactoring, safe transformation sequences, and testing guards. For code quality foundations, see clean-code. For managing complexity, see software-design-philosophy.'

File Ops 2K 6mo ago
affaan-m

e2e-testing

by affaan-m

Playwright E2E testing patterns, Page Object Model, configuration, CI/CD integration, artifact management, and flaky test strategies.

Processing 243.5K 6mo ago