Scraping
Web scraping and data extraction
Uses and selection guide
Use these skills to collect, transform and examine datasets. Compare supported formats, data volume and handling of missing values; inspect a small sample before applying a transformation to the complete dataset.
web-access
by eze-is
所有联网操作必须通过此 skill 处理，包括：搜索、网页抓取、登录后操作、网络交互等。
agent-browser
by paperclipai
Drive a real browser to inspect or interact with a web page or app — navigate, take screenshots, read console and network, fill simple forms — for verification tasks, not unattended automation.
cloudflare-browser
by cloudflare
Control headless Chrome via Cloudflare Browser Rendering CDP WebSocket. Use for screenshots, page navigation, scraping, and video capture when browser automation is needed in a Cloudflare Workers environment. Requires CDP_SECRET env var and cdpUrl configured in browser.profiles.
writing-playwright-tests
by open-metadata
Redirect only — this skill was merged into playwright. Invoke playwright instead for Playwright E2E authoring guidance and the required lint gate.
dev-browser
by SawyerHood
Browser automation with persistent page state. Use when users ask to navigate websites, fill forms, take screenshots, extract web data, test web apps, or automate browser workflows. Trigger phrases include "go to [url]", "click on", "fill out the form", "take a screenshot", "scrape", "automate", "test the website", "log into", or any browser interaction request.
playwright-migration
by zebbern
Step-by-step migration guides for moving to Playwright from Cypress or Selenium/WebDriver — command mappings, architecture changes, and incremental adoption strategies.
competitive-ads-extractor
by ComposioHQ
Extracts and analyzes competitors' ads from ad libraries (Facebook, LinkedIn, etc.) to understand what messaging, problems, and creative approaches are working. Helps inspire and improve your own ad campaigns.
baoyu-post-to-weibo
by JimLiu
Posts content to Weibo (微博). Supports regular posts with text, images, and videos, and headline articles (头条文章) with Markdown input via Chrome CDP. Use when user asks to "post to Weibo", "发微博", "发布微博", "publish to Weibo", "share on Weibo", "写微博", or "微博头条文章".
defuddle
by kepano
Extract clean markdown content from web pages using Defuddle CLI, removing clutter and navigation to save tokens. Use instead of WebFetch when the user provides a URL to read or analyze, for online documentation, articles, blog posts, or any standard web page. Do NOT use for URLs ending in .md — those are already markdown, use WebFetch directly.
webclaw
by 0xMassi
Web extraction engine with antibot bypass. Scrape, crawl, extract, summarize, search, map, diff, monitor, research, and analyze any URL — including Cloudflare-protected sites. Use when you need reliable web content, the built-in web_fetch fails, or you need structured data extraction from web pages.
gifgrep
by openclaw
"Search GIF providers with CLI/TUI, download results, and extract stills/sheets."
playwright
by openai
"Use when the task requires automating a real browser from the terminal (navigation, form filling, snapshots, screenshots, data extraction, UI-flow debugging) via playwright-cli or the bundled wrapper script."
discrawl
by openclaw
"Discord archive: search, sync freshness, DMs, summaries, TUI, repo/release work."
xhs-explore
by autoclaw-cc
小红书内容发现与分析技能。搜索笔记、浏览首页、查看详情、获取用户资料。 当用户要求搜索小红书、查看笔记详情、浏览首页、查看用户主页时触发。
lets-go-rss
by ALBEDO-TABAI
轻量级全平台 RSS 订阅管理器。一键聚合 YouTube、Vimeo、Behance、Twitter/X、知识星球、B站、微博、抖音、小红书的内容更新，支持增量去重和 AI 智能分类。
smart-web-fetch
by rolandcanyon-cmd
Fetch web content efficiently by checking llms.txt first, then Cloudflare markdown endpoints, then falling back to HTML. Reduces token usage by 80% on sites that support clean markdown delivery. No external dependencies — installs a single Python script. Trigger words: fetch URL, web content, read website, scrape page, download page, get webpage, read this link.
skill-goodinfo-fetch
by wenchiehlee-investment
GoodInfo.tw 台股資料三段式管線（下載 XLS → 轉換 CSV → 公司層級富化）的統一入口技能，同一份技能同步部署於 Python-Actions.GoodInfo、Python-Actions.GoodInfo.Analyzer、Python-Actions.GoodInfo.CompanyInfo 三個 repo。
Super Green Tender Hunt — Agent Skill V2
by walidgdg1-ai
A run may stop only when the requested workload is complete, sources are exhausted, or a legitimate terminal blocker is proven. Finding one attractive candidate is not a stop condition.
dce-retrieval
by walidgdg1-ai
Resolve, download, preserve, unpack, extract, and hand off public tender DCE/procurement packs at high parallelism using the Tender Engine portal-adapter fleet.
autonomous-tender-fleet
by walidgdg1-ai
Operate the Tender Engine as a persistent self-healing CI fleet across GitHub Actions and CircleCI with durable state, transactional DCE leases, capacity management, retries, and GPT handoff.
vue-testing-best-practices
by vuejs-ai
Use for Vue.js testing. Covers Vitest, Vue Test Utils, component testing, mocking, testing patterns, and Playwright for E2E testing.
scrape-webpage
by adobe
Scrape webpage content, extract metadata, download images, and prepare for import/migration to AEM Edge Delivery Services. Returns analysis JSON with paths, metadata, cleaned HTML, and local images.
playwright-skill
by lackeyjb
Complete browser automation with Playwright. Auto-detects dev servers, writes clean test scripts to /tmp. Test pages, fill forms, take screenshots, check responsive design, validate UX, test login flows, check links, automate any browser task. Use when user wants to test websites, automate browser interactions, validate web functionality, or perform any browser-based testing.
bulk-wgcna-analysis-with-omicverse
by Starlitnightly
Assist Claude in running PyWGCNA through omicverse—preprocessing expression matrices, constructing co-expression modules, visualising eigengenes, and extracting hub genes.