Scraping

Web scraping and data extraction

Showing 121-144 of 708 skills
forcedotcom

playwright-e2e

by forcedotcom

writing, running, and debugging Playwright tests. working with their output from github actions

CI/CD 1K 6mo ago
aiskillstore

sitemapkit

by aiskillstore

Discover and extract sitemaps from any website using SitemapKit. Use this skill whenever the user wants to find pages on a website, get a list of URLs from a domain, audit a site's structure, crawl a sitemap, check what pages exist on a site, or do anything involving sitemaps or site URL discovery — even if they don't explicitly say "sitemap". Requires the sitemapkit MCP server configured with a valid SITEMAPKIT_API_KEY.

Scraping 414 5mo ago
tavily-ai

tavily-extract

by tavily-ai

Extract clean markdown or text content from specific URLs via the Tavily CLI. Use this skill when the user has one or more URLs and wants their content, says "extract", "grab the content from", "pull the text from", "get the page at", "read this webpage", or needs clean text from web pages. Handles JavaScript-rendered pages, returns LLM-optimized markdown, and supports query-focused chunking for targeted extraction. Can process up to 20 URLs in a single call.

CLI Tools 462 5mo ago
openakita

browser-get-content

by openakita

Extract page content and element text from current webpage. When you need to read page information, get element values, scrape data, or verify page content.

Processing 2K 7mo ago
WenJunDuan

webapp-testing

by WenJunDuan

Toolkit for interacting with and testing local web applications using Playwright. Supports verifying frontend functionality, debugging UI behavior, capturing browser screenshots, and viewing browser logs.

Automation 186 7mo ago
tradingstrategy-ai

extract-vault-protocol-logo

by tradingstrategy-ai

Extract a logo for vault protocol metadata

Docker 825 8mo ago
tradingstrategy-ai

extract-project-logo

by tradingstrategy-ai

Extract a project's logo from its website, brand kit, or other sources

Code Review 825 7mo ago
adobe

scrape-webpage

by adobe

Scrape webpage content, extract metadata, download images, and prepare for import/migration to AEM Edge Delivery Services. Returns analysis JSON with paths, metadata, cleaned HTML, and local images.

Docker 170 7mo ago
jaechang-hits

histolab-wsi-processing

by jaechang-hits

"Whole slide image processing for digital pathology. Tissue detection, tile extraction (random, grid, score-based), filter pipelines for H&E/IHC preprocessing. Use for dataset preparation, tile-based deep learning, and slide quality assessment. For advanced spatial proteomics or multiplexed imaging use pathml."

Analytics 344 6mo ago
aiskillstore

webapp-testing

by aiskillstore

Toolkit for interacting with and testing local web applications using Playwright. Supports verifying frontend functionality, debugging UI behavior, capturing browser screenshots, and viewing browser logs.

Automation 414 7mo ago
aiskillstore

extract-transcripts

by aiskillstore

Extract readable transcripts from Claude Code and Codex CLI session JSONL files

Auth 414 7mo ago
phodal

pdf

by phodal

Extract and analyze information from PDF documents

Code Review 4.5K 8mo ago
QuixiAI

email-digest

by QuixiAI

Digest and ingest emails into memory, surfacing important threads and action items

Code Gen 607 6mo ago
freekmurze

pdf

by freekmurze

Comprehensive PDF manipulation toolkit for extracting text and tables, creating new PDFs, merging/splitting documents, and handling forms. When Claude needs to fill in a PDF form or programmatically process, generate, or analyze PDF documents at scale.

CLI Tools 1K 7mo ago
bear2u

web-to-markdown

by bear2u

웹페이지 URL을 입력받아 마크다운 형태로 변환하여 저장합니다. 웹 문서를 로컬 마크다운 파일로 아카이빙하거나 정리할 때 유용합니다.

Prompts 916 10mo ago
bear2u

web-to-markdown

by bear2u

웹페이지 URL을 입력받아 마크다운 형태로 변환하여 저장합니다. 웹 문서를 로컬 마크다운 파일로 아카이빙하거나 정리할 때 유용합니다.

Prompts 916 10mo ago
colonelpanic8

playwright-cli

by colonelpanic8

Automate browser interactions from the shell using Playwright via the playwright-cli command (open/goto/snapshot/click/type/screenshot, tabs/storage/network). Use when you need deterministic browser automation for web testing, form filling, screenshots/PDFs, or data extraction.

Auth 221 6mo ago
openakita

webapp-testing

by openakita

Toolkit for interacting with and testing local web applications using Playwright. Supports verifying frontend functionality, debugging UI behavior, capturing browser screenshots, and viewing browser logs.

Automation 2K 7mo ago
antfu

vue-testing-best-practices

by antfu

Use for Vue.js testing. Covers Vitest, Vue Test Utils, component testing, mocking, testing patterns, and Playwright for E2E testing.

Scraping 5.8K 7mo ago
yzfly

douyin-video

by yzfly

"抖音无水印视频下载和文案提取工具. 从抖音分享链接获取无水印视频下载链接, 下载视频, 提取视频中的语音文案并自动保存到文件. 适用场景包括获取抖音视频信息, 下载无水印视频, 批量提取视频文案. 当用户需要处理抖音视频链接或提取视频内容时触发."

API Dev 1.3K 7mo ago
GPTomics

bio-atac-seq-nucleosome-positioning

by GPTomics

Extract nucleosome positions from ATAC-seq data using NucleoATAC, ATACseqQC, and fragment analysis. Use when analyzing chromatin organization, identifying nucleosome-free regions at promoters, or characterizing nucleosome occupancy patterns from ATAC-seq fragment size distributions.

CLI Tools 1.2K 6mo ago
GPTomics

bio-atac-seq-footprinting

by GPTomics

Detect transcription factor binding sites through footprinting analysis in ATAC-seq data using TOBIAS. Use when identifying TF occupancy patterns within accessible regions, as TF binding protects DNA from Tn5 cutting.

CLI Tools 1.2K 6mo ago
GPTomics

bio-isoform-switching

by GPTomics

Analyzes isoform switching events and functional consequences using IsoformSwitchAnalyzeR. Predicts protein domain changes, NMD sensitivity, ORF alterations, and coding potential shifts between conditions. Use when investigating how splicing changes affect protein function.

Code Gen 1.2K 6mo ago
GPTomics

bio-clinical-databases-hla-typing

by GPTomics

Call HLA alleles from NGS data using OptiType, HLA-HD, or arcasHLA for immunogenomics applications. Use when determining HLA genotype for transplant matching, neoantigen prediction, or pharmacogenomic screening.

Processing 1.2K 6mo ago