KitScout

Categories › Web & Browser

See all Web & Browser tools →

Scraping, crawling & page-to-text

1,772 agent tools in this category, ranked by GitHub stars for now. Hands-on test results will replace this ranking as they finish.

Starter kit Draft

The three most-starred tools here. Not tested together yet.

Scrapling MCP Server

Web scraping with stealth HTTP, real browsers, and Cloudflare bypass. CSS selectors supported.

pypi:scrapling
apiflash-automation

Automate Apiflash tasks via Rube MCP (Composio). Always search tools first for current schemas.

npx skills add ComposioHQ/awesome-claude-skills --skill apiflash-automation
Apify Automation

Automate web scraping and data extraction with Apify -- run Actors, manage datasets, create reusable tasks, and retrieve crawl results through the Composio Apif

npx skills add ComposioHQ/awesome-claude-skills --skill Apify Automation

All tools

Works with
Type
Publisher
Runs
Status
Access
ToolStarsLast updateLicense
Scrapling MCP Server
Web scraping with stealth HTTP, real browsers, and Cloudflare bypass. CSS selectors supported.
MCP serverGitHub-verified authorLocal · PyPI
102,2542 days agoBSD-3-Clause
apiflash-automation
Automate Apiflash tasks via Rube MCP (Composio). Always search tools first for current schemas.
SkillInstall · skills CLI
79,45156 days ago—
Apify Automation
Automate web scraping and data extraction with Apify -- run Actors, manage datasets, create reusable tasks, and retrieve crawl results through the Com
SkillInstall · skills CLI
79,45156 days ago—
competitive-ads-extractor
Extracts and analyzes competitors' ads from ad libraries (Facebook, LinkedIn, etc.) to understand what messaging, problems, and creative approaches ar
SkillInstall · skills CLI
79,45156 days ago—
diffbot-automation
Automate Diffbot tasks via Rube MCP (Composio). Always search tools first for current schemas.
SkillInstall · skills CLI
79,45156 days ago—
clone-website
Rebuild existing web pages as working local code, matching their real content, assets, responsive layout, and interactions. Use for website cloning, r
SkillInstall · skills CLI
39,1204 days agoMIT
x-twitter-scraper
Use when the user wants to integrate with the X (Twitter) API via Xquik to search tweets, look up user profiles, extract followers, run giveaway draws
SkillInstall · skills CLI
33,495todayMIT
browser-automation
Automate a browser: scrape websites, fill forms, pull structured data from web pages. Use whenever the user wants to grab data from a site, fill a web
SkillInstall · skills CLI
29,7731 day agoMIT
crawling-social-media
Downloads and extracts content from social media platforms. Use when user wants to crawl, download, or extract videos/content from Bilibili, YouTube,
SkillInstall · skills CLI
27,7171 day agoMIT
baoyu-url-to-markdown
Fetch any URL and convert to markdown using baoyu-fetch CLI (Chrome CDP with site-specific adapters). Built-in adapters for X/Twitter, YouTube transcr
SkillInstall · skills CLI
27,5337 days agoMIT
firecrawl-search
Web search and page scraping via Firecrawl, returning full-page markdown. Use when user says "firecrawl search", "firecrawl scrape" or "/firecrawl-sea
SkillInstall · skills CLI
19,1622 days agoMIT
defuddle
Plan optional Defuddle extraction and retain already available local source files through reviewed filesystem capture. Use for defuddle, clean this UR
SkillInstall · skills CLI
16,46219 days agoMIT
Apify MCP Server
Extract data from any website with thousands of scrapers, crawlers, and automations on Apify Store ⚡
MCP serverVerified domain · apify.comRemoteSign-in needed
16,076todayMIT
SeleniumBase MCP
Stealthy browser automation, testing, and web-scraping via CDP Mode.
MCP serverGitHub-verified authorLocal · PyPI
13,2507 days agoMIT
ads-landing
Audit paid-ad landing pages for message match, mobile experience, performance, accessibility, trust, forms, consent, tracking, security, and conversio
SkillInstall · skills CLI
11,01712 days agoMIT
baoyu-url-to-markdown
技术写作员与内容创作者在沉淀网页资料时,当需要抓取包含JS动态渲染或需登录的复杂页面,使用此技能一键将其转换为干净的Markdown格式,自动提取正文与元数据,轻松构建本地知识库,让网页内容归档效率翻倍!
SkillInstall · skills CLI
9,543today—
intelligent-content-system
内容创作者与运营专员在需要采集网页、追踪热点或进行多平台分发时,使用此技能可一键完成从内容获取、智能配图、小红书图文生成到微信、小红书、X、B站等多平台自动发布的全流程,轻松实现内容产出与分发效率翻倍。 智能内容创作与发布全流程系统。根据用户需求自动识别场景, 编排调用网页采集、智能配图、小红书图文
SkillInstall · skills CLI
9,543today—
burpsuite-project-parser
Searches and explores Burp Suite project files (.burp) from the command line. Use when searching response headers or bodies with regex patterns, extra
SkillInstall · skills CLI
8,1791 day agoCC-BY-SA-4.0
google-maps-scraper
Find businesses, leads, emails, reviews, ratings, and contact details from Google Maps. Use for requests such as "find dentists in Berlin", "scrape Go
SkillInstall · skills CLI
8,0225 days agoMIT
Robin: AI-Powered Dark Web OSINT
Dark web OSINT over Tor: search onion engines, scrape pages, report with your own model.
MCP serverGitHub-verified authorLocal · Docker
7,97542 days agoMIT
Firecrawl MCP Server
Firecrawl, the context API for AI agents: search, scrape, interact with the web, plus paper search.
MCP serverGitHub-verified authorLocal · npm
7,815todayMIT
Business Contact Finder
Check how to contact a business website, and whether that contact path actually works.
MCP serverVerified domain · ottobot.agencyRemote● LiveFree to try
7,4671 day ago—
Contact Affordance
Check how to contact a business website, and whether that contact path actually works.
MCP serverVerified domain · ottobot.orgRemote● LiveFree to try
7,4671 day ago—
Domain Liveness
Is this business's website still there? Checks apex and www, and DNS separately from HTTP.
MCP serverVerified domain · ottobot.orgRemote● LiveFree to try
7,4671 day ago—
stitched-full-page-capture
Capture or repair reliable full-page screenshots for lazy-loaded, scroll-animated, Framer, WebGL/canvas, or reveal-heavy web pages. Use when full-page
SkillInstall · skills CLI
7,4641 day agoMIT
comment-mining
Use when the user wants to mine comments and replies for audience reactions, customer language, questions, objections, complaints, product ideas, buyi
SkillInstall · skills CLI
6,4282 months agoMIT
competitor-social-research
Use when the user wants to research competitors' social media strategy, compare brands or creators, find what content is working in a niche, identify
SkillInstall · skills CLI
6,4282 months agoMIT
content-repurposing
Use when the user wants to turn public social videos, transcripts, posts, or creator research into reusable content assets such as LinkedIn posts, X t
SkillInstall · skills CLI
6,4282 months agoMIT
creator-profile-teardown
Use when the user wants to analyze a creator, influencer, founder, or brand social account and understand positioning, content pillars, outlier posts,
SkillInstall · skills CLI
6,4282 months agoMIT
influencer-prospecting
Use when the user wants to find creators, influencers, affiliates, or social accounts in a niche for outreach, partnerships, sponsorships, UGC, seedin
SkillInstall · skills CLI
6,4282 months agoMIT
outlier-post-finder
Use when the user wants to find posts, videos, reels, shorts, tweets, or social content that overperformed versus a creator, brand, or competitor base
SkillInstall · skills CLI
6,4282 months agoMIT
product-demand-research
Use when the user wants to validate a product idea, find pain points, mine demand signals, discover objections, or gather voice-of-customer language f
SkillInstall · skills CLI
6,4282 months agoMIT
scrapecreators-api
Scrape and extract public data from 27+ social media platforms using the ScrapeCreators REST API. Covers TikTok, Instagram, YouTube, LinkedIn, Faceboo
SkillInstall · skills CLI
6,4282 months agoMIT
social-listening-brief
Use when the user wants a social listening report about what people are saying about a brand, person, product, topic, category, or niche across public
SkillInstall · skills CLI
6,4282 months agoMIT
transcript-intelligence
Use when the user wants to summarize, analyze, or repurpose transcripts from TikTok, Instagram, YouTube, Facebook, X/Twitter, LinkedIn, Rumble, or Red
SkillInstall · skills CLI
6,4282 months agoMIT
trend-discovery
Use when the user wants to discover trending social topics, hashtags, sounds, posts, reels, shorts, creators, or formats in a niche. Searches public t
SkillInstall · skills CLI
6,4282 months agoMIT
1688-product-detail
Extracts comprehensive wholesale product data from 1688.com product detail pages: title, tiered pricing, SKU variants with dimensions/weight, product
SkillInstall · skills CLI
6,3509 days agoMIT
airbnb-listing-detail
Fetches complete Airbnb listing details for a given numeric listing ID via the internal GraphQL API, returning title, room type, description, amenitie
SkillInstall · skills CLI
6,3509 days agoMIT
airbnb-search-listing
Extracts Airbnb accommodation search results from a destination query via SSR-embedded data, returning listing ID, URL, name, coordinates, rating, pri
SkillInstall · skills CLI
6,3509 days agoMIT
amazon-asin-lookup-api-skill
This skill helps users extract structured product details from Amazon using a specific ASIN (Amazon Standard Identification Number). Use this skill wh
SkillInstall · skills CLI
6,3509 days agoMIT
amazon-best-selling-products-finder-api-skill
This skill helps users extract structured best-selling product data from Amazon via the BrowserAct API. Agent should proactively apply this skill when
SkillInstall · skills CLI
6,3509 days agoMIT
amazon-bestseller-listing
Amazon Best Sellers listing scraper: extract product cards from any Amazon Best Sellers (zgbs) or /gp/bestsellers/ category page — returns rank (posit
SkillInstall · skills CLI
6,3509 days agoMIT
amazon-buy-box-monitor-api-skill
This skill helps users extract basic product details other sellers prices and seller ratings from Amazon via ASIN automatically using the BrowserAct A
SkillInstall · skills CLI
6,3509 days agoMIT
amazon-competitor-analyzer
Scrapes Amazon product data from ASINs using browseract.com automation API and performs surgical competitive analysis. Compares specifications, pricin
SkillInstall · skills CLI
6,3509 days agoMIT
amazon-listing-competitor-analysis-skill
This skill helps users analyze Amazon competitor listings by ASIN and produce structured competitive intelligence plus strategic opportunity points fo
SkillInstall · skills CLI
6,3509 days agoMIT
amazon-product-api-skill
This skill helps users extract structured product listings from Amazon, including titles, ASINs, prices, ratings, and specifications. Use this skill w
SkillInstall · skills CLI
6,3509 days agoMIT
amazon-product-detail
Amazon product detail page scraper: extract full product data from any open Amazon product detail URL (any /dp/{asin} or /gp/product/{asin} page acros
SkillInstall · skills CLI
6,3509 days agoMIT
amazon-product-search-api-skill
This skill is designed to help users automatically extract product data from Amazon search results. The Agent should proactively apply this skill when
SkillInstall · skills CLI
6,3509 days agoMIT
amazon-reviews-api-skill
This skill helps users automatically extract Amazon product reviews via the Amazon Reviews API. Agent should proactively apply this skill when users e
SkillInstall · skills CLI
6,3509 days agoMIT
amazon-search-listing
Amazon search and category listing scraper: extract product listings from any Amazon search results page, keyword search URL, or category browse page
SkillInstall · skills CLI
6,3509 days agoMIT
business-contact-social-links-skill
This skill helps users automatically extract official website and social media profiles. Agent should proactively apply this skill when users express
SkillInstall · skills CLI
6,3509 days agoMIT
ebay-item-detail
Extracts full item detail from any open eBay item URL, returning JSON with url, itemNumber, title, subTitle, categories, price, priceWithCurrency, cur
SkillInstall · skills CLI
6,3509 days agoMIT
ebay-search-listing
Extracts product listings from any eBay search or category page URL, returning per-item cards (itemNumber, url, title, subtitle, caption, price, price
SkillInstall · skills CLI
6,3509 days agoMIT
ebay-sold-listings-search
eBay sold-listings scraper across 8 marketplaces (ebay.com/.co.uk/.de/.fr/.it/.es/.ca/.com.au). Takes keyword plus filters (category, price range, ite
SkillInstall · skills CLI
6,3509 days agoMIT
ecommerce-listing
Extract product list from any e-commerce category page, search results page, or keyword search with filters. Returns paginated product arrays with URL
SkillInstall · skills CLI
6,3509 days agoMIT
ecommerce-product-detail
Extract complete product information from any e-commerce product page. Returns name, price, currency, brand, images, description, SKU/ASIN/EAN/UPC/GTI
SkillInstall · skills CLI
6,3509 days agoMIT
ecommerce-reviews
Extract customer reviews from any e-commerce product page or reviews page. Returns reviewer name, star rating, date, review title, review body, verifi
SkillInstall · skills CLI
6,3509 days agoMIT
ecommerce-seller-info
Extract seller or merchant profile data from marketplace platform seller pages. Returns seller name, rating, review count, positive feedback percentag
SkillInstall · skills CLI
6,3509 days agoMIT
etsy-category-listing
Etsy category page scraper: given an Etsy category URL (e.g. https://www.etsy.com/c/jewelry) and optional page number, returns paginated product listi
SkillInstall · skills CLI
6,3509 days agoMIT
etsy-keyword-search
Etsy keyword search scraper: given a search keyword and optional page number, returns paginated product listings with listingId, shopId, title, url, i
SkillInstall · skills CLI
6,3509 days agoMIT
etsy-product-detail
Etsy product detail scraper: given an Etsy listing URL, returns full product detail including listingId, title, priceCurrent, priceOriginal, currency,
SkillInstall · skills CLI
6,3509 days agoMIT
etsy-shop-catalog
Etsy shop catalog scraper: given an Etsy shop URL (e.g. https://www.etsy.com/shop/{shop-name}) and optional page number, returns paginated product lis
SkillInstall · skills CLI
6,3509 days agoMIT
facebook-ads-library-search
Searches Meta Ad Library (Facebook/Instagram/WhatsApp ads) by keyword or Facebook page ID and extracts ad details including creatives, copy, CTA, publ
SkillInstall · skills CLI
6,3509 days agoMIT
facebook-groups-scrape-posts
Scrapes posts from a Facebook group given a group URL, sort order, and desired count — returns structured post metadata including post_id, permalink,
SkillInstall · skills CLI
6,3509 days agoMIT
facebook-page-posts
Scrapes posts from any public Facebook Page timeline, returning structured data including post text, author info, engagement metrics (likes/comments/s
SkillInstall · skills CLI
6,3509 days agoMIT
facebook-page-profile-posts
Scrapes posts from any public Facebook Page or personal Profile timeline, returning structured data including post text, author info with profile pict
SkillInstall · skills CLI
6,3509 days agoMIT
github-project-contributor-finder-api-skill
This skill helps users extract GitHub repository project details and contributor contact information using keywords, stars, and update dates. Agent sh
SkillInstall · skills CLI
6,3509 days agoMIT
goofish-item-detail
Extracts full detail data from a single Goofish (闲鱼/xianyu, goofish.com) second-hand item page. Input: item URL or item ID. Output: title, price, sell
SkillInstall · skills CLI
6,3509 days agoMIT
goofish-search-list
Scrapes second-hand item search results from Goofish (闲鱼/xianyu, goofish.com) — China's largest second-hand marketplace. Input: keyword, optional sort
SkillInstall · skills CLI
6,3509 days agoMIT
google-maps-api-skill
This skill helps users automatically scrape business data from Google Maps using the BrowserAct Google Maps API. Agent should proactively trigger this
SkillInstall · skills CLI
6,3509 days agoMIT
google-maps-contact-extract
Extracts business contact details from Google Maps search results and place detail pages, then visits each business website to collect emails, phone n
SkillInstall · skills CLI
6,3509 days agoMIT
google-maps-reviews-api-skill
This skill is designed to help users automatically extract reviews from Google Maps via the Google Maps Reviews API. Agent should proactively apply th
SkillInstall · skills CLI
6,3509 days agoMIT
google-maps-search-api-skill
This skill is designed to help users automatically extract business data from Google Maps search results. The Agent should proactively apply this skil
SkillInstall · skills CLI
6,3509 days agoMIT
indeed-job-search
Scrape job listings from Indeed.com by keyword, location, and country. Returns job title, company, salary, rating, description, benefits, and apply li
SkillInstall · skills CLI
6,3509 days agoMIT
industry-key-contact-radar-api-skill
This skill helps users discover key contacts across industries, roles, and social platforms via the BrowserAct API. Agent should proactively apply thi
SkillInstall · skills CLI
6,3509 days agoMIT
instagram-hashtag-posts
Scrapes Instagram posts by hashtag, returning media items with captions, like/comment counts, media URLs and user info from the hashtag explore feed.
SkillInstall · skills CLI
6,3509 days agoMIT
instagram-place-posts
Scrapes Instagram posts tagged at a specific location or place, returning media items with captions, like/comment counts, media URLs and user info. Us
SkillInstall · skills CLI
6,3509 days agoMIT
instagram-post-comments
Fetches comments from an Instagram post including comment text, username, timestamp, like count and reply count. Use when user mentions Instagram comm
SkillInstall · skills CLI
6,3509 days agoMIT
instagram-profile-meta
Fetches Instagram user profile metadata including bio, follower count, following count, post count, verification status and other profile details. Use
SkillInstall · skills CLI
6,3509 days agoMIT
instagram-profile-posts
Scrapes posts from an Instagram user's profile feed including captions, media URLs, like/comment counts, timestamps and location tags. Use when user m
SkillInstall · skills CLI
6,3509 days agoMIT
linkedin-jobs-search
Search LinkedIn job listings and extract full job details. Supports filtering by work type (remote/on-site/hybrid), contract type (full-time/part-time
SkillInstall · skills CLI
6,3509 days agoMIT
producthunt-launches
Scrape Product Hunt daily/weekly/monthly/yearly leaderboard launches with full product details, maker profiles, and website contact info. Use when use
SkillInstall · skills CLI
6,3509 days agoMIT
reddit-competitor-analysis-api-skill
This skill helps users extract structured data from Reddit posts and comments via BrowserAct API. Agent should proactively apply this skill when users
SkillInstall · skills CLI
6,3509 days agoMIT
reddit-warmup
Reddit account onboarding and a staged 30-day warm-up workflow through BrowserAct CLI. Use for Reddit warmup, daily browsing and engagement, account h
SkillInstall · skills CLI
6,3509 days agoMIT
taobao-keyword-search
Search Taobao and Tmall product listings by keyword, returning paginated product cards with title, price, shop, image, sales, and tags. Use when user
SkillInstall · skills CLI
6,3509 days agoMIT
taobao-product-detail
Fetch full product detail from a Taobao or Tmall product page by itemId, returning title, price, shop info, images, SKU variants, and product attribut
SkillInstall · skills CLI
6,3509 days agoMIT
taobao-product-reviews
Fetch customer reviews for a Taobao or Tmall product by itemId, returning reviewer name, date, purchased variant, review text, and photo URLs. Use whe
SkillInstall · skills CLI
6,3509 days agoMIT
taobao-shop-catalog
Browse a Taobao or Tmall shop's product catalog by shopId, returning paginated product listings with itemId and title. Use when user asks to scrape a
SkillInstall · skills CLI
6,3509 days agoMIT
threads-keyword-search
Searches Threads posts by keyword or hashtag and returns matching posts with engagement metrics, extracted from SSR-embedded JSON. Use when user asks
SkillInstall · skills CLI
6,3509 days agoMIT
threads-profile-search
Discovers Threads user accounts by keyword, extracting profile data including username, display name, verification status, biography, and follower cou
SkillInstall · skills CLI
6,3509 days agoMIT
threads-user-posts
Fetches public posts from a Threads user's profile page, extracting post text, engagement metrics, and media info from SSR-embedded JSON. Use when use
SkillInstall · skills CLI
6,3509 days agoMIT
trustpilot-company-info
Trustpilot company profile lookup on trustpilot.com — input a company domain (e.g. apple.com, shopify.com, shopwagandtail.com) and extract company met
SkillInstall · skills CLI
6,3509 days agoMIT
trustpilot-reviews
Trustpilot customer reviews scraper for any company listed on trustpilot.com — given a company domain (e.g. shopify.com, apple.com, shopwagandtail.com
SkillInstall · skills CLI
6,3509 days agoMIT
walmart-category-listing
Walmart category page scraper: input a walmart.com browse or category URL with optional page number, extract paginated product listings with itemId, u
SkillInstall · skills CLI
6,3509 days agoMIT
walmart-product-detail
Walmart product detail page extractor: given a walmart.com product URL (walmart.com/ip/...), extract full product data including itemId, title, brand,
SkillInstall · skills CLI
6,3509 days agoMIT
walmart-product-reviews
Walmart product reviews scraper: given a walmart.com product item ID, navigate to the reviews page and extract paginated customer reviews including re
SkillInstall · skills CLI
6,3509 days agoMIT
web-search-scraper-api-skill
This skill helps users automatically extract complete Markdown content from any website via the BrowserAct Web Search Scraper API. The Agent should pr
SkillInstall · skills CLI
6,3509 days agoMIT
webcrawler-deep-crawl
Deep-crawl any website from start URLs, return per-page LLM-ready text/markdown/HTML plus metadata (title, description, author, language, canonical UR
SkillInstall · skills CLI
6,3509 days agoMIT
wechat-article-search-api-skill
Search public WeChat articles by keyword through the BrowserAct API, with an article limit and a publication-date value or explicit unrestricted value
SkillInstall · skills CLI
6,3509 days agoMIT
x-dm-auto-chat
X (Twitter) DM automated chat end-to-end Skill: scan DM inbox to identify pending-reply conversations, read message history, generate persona-based re
SkillInstall · skills CLI
6,3509 days agoMIT
x-keyword-comment
X (Twitter) keyword-based reply posting: search tweets by keyword, read each tweet's content, generate contextual replies from a configured brand pers
SkillInstall · skills CLI
6,3509 days agoMIT
x-tweet-by-conversation
Collects every tweet in an X (Twitter) conversation thread given a conversation id (root tweet id) — the focal tweet plus all replies, sub-replies, an
SkillInstall · skills CLI
6,3509 days agoMIT
x-tweet-by-handle
Scrapes tweets from an X (Twitter) user profile timeline given a handle, with selectable mode: tweets, tweets+replies, or media-only. Returns normaliz
SkillInstall · skills CLI
6,3509 days agoMIT
x-tweet-by-url
Scrapes tweets from any X (Twitter) URL — search results, user profile, single tweet detail, or list timeline — and returns normalized per-tweet data
SkillInstall · skills CLI
6,3509 days agoMIT
x-tweet-search
Scrapes tweets from X (Twitter) by search query, user handle, or direct URL — returns full tweet data including text, author info, engagement metrics,
SkillInstall · skills CLI
6,3509 days agoMIT
x-tweet-search-by-query
Searches X (Twitter) for tweets by free-form advanced query and returns a normalized tweet list with text, author profile, engagement counts, media, h
SkillInstall · skills CLI
6,3509 days agoMIT
xiaohongshu-auto-posting
Automates the complete Xiaohongshu (XHS / Little Red Book) content operation workflow: pain-point topic collection → style case collection → topic sel
SkillInstall · skills CLI
6,3509 days agoMIT
xiaohongshu-note-detail
Fetch Xiaohongshu (RedNote / xhs) note detail and comments by note ID, returning title, description, author info, engagement stats, tags, and paginate
SkillInstall · skills CLI
6,3509 days agoMIT
xiaohongshu-search-full
Search Xiaohongshu (XHS / RedNote) notes by keyword with full field extraction including body text, topics/tags, image list URLs, video stream URL, pu
SkillInstall · skills CLI
6,3509 days agoMIT
youtube-channel-business-email
YouTube channel business email and contact extractor: accepts a channel id (UCxxx), handle (@name), or URL; navigates the channel About view; extracts
SkillInstall · skills CLI
6,3509 days agoMIT
translate-to-quarto
Translate Beamer LaTeX to Quarto RevealJS. Multi-phase workflow with TikZ extraction and QA.
SkillInstall · skills CLI
5,0134 days ago—
reels-scripting
Turn a reference Instagram Reel into a script for your own Reel, tuned to your voice and repurposed from your newsletter content. Takes a Reel URL or
SkillInstall · skills CLI
4,69826 days agoMIT
skill-trending-topics
抓取微博、抖音、知乎、头条、B站实时热搜,筛选与创作者赛道相关的热点,输出二创选题建议。 当用户说"今天有什么热搜""热点""最近大家在聊什么""追热点""蹭热点""二创选题""热搜榜"时使用。 和 skill-news-intelligence 的区别:本 SKILL 抓分钟级实时热搜榜做快速二创
SkillInstall · skills CLI
4,6702 days agoApache-2.0
deep-scrape
Build sourced JSON dossiers on people, companies, or topics with DeepAPI. Use for profiles, prospects, vendor due diligence, or customer research acro
SkillInstall · skills CLI
4,309todayMIT
firecrawl-scrape
Scrape web pages and extract content via Firecrawl MCP
SkillInstall · skills CLI
3,9499 months agoMIT
scrapling
CLI-first web scraping & content extraction with optional MCP server. Use when you have target URLs and need clean, selector-based outputs (html/md/tx
SkillInstall · skills CLI
3,8164 days agoApache-2.0
add-webmcp
Analyze an existing web application, identify safe user-visible capabilities across routes, forms, server actions, handlers, and schemas, then impleme
SkillInstall · skills CLI
3,75717 days ago—
browser-to-api
Turn a website's observable HTTP traffic into a best-effort OpenAPI 3.1 spec by analyzing a `browser-trace` capture. Use when the user wants to discov
SkillInstall · skills CLI
3,75717 days ago—
browser-trace
Capture a full DevTools-protocol trace of any browser automation — CDP firehose, screenshots, and DOM dumps — then bisect the stream into per-page sea
SkillInstall · skills CLI
3,75717 days ago—
webmcp-gen
Create, compile, and validate site-specific WebMCP init scripts from a target URL and desired tool capability. Use when the user wants to author WebMC
SkillInstall · skills CLI
3,75717 days ago—
x-twitter-scraper
X (Twitter) data extraction and monitoring via Xquik: tweet search, user lookup, follower extraction, giveaway draws, trending topics, account monitor
SkillInstall · skills CLI
3,743todayMIT
RedBookSkills
将图文/视频内容自动发布到小红书(XHS),并支持登录检查、内容检索与互动操作。 适用场景:发布图文、发布视频、仅启动测试浏览器、获取登录二维码、首页推荐抓取、搜索笔记、评论互动、抓取内容数据。
SkillInstall · skills CLI
3,601todayMIT
run-claude-osint
Build, validate, and run the claude-osint skills repo — check SKILL.md frontmatter, run the secret_scan.py and h1_reference.py helpers, run sync-skill
SkillInstall · skills CLI
3,03024 days agoMIT
web-to-markdown
Use ONLY when the user explicitly says: 'use the skill web-to-markdown ...' (or 'use a skill web-to-markdown ...'). Converts webpage URLs to clean Mar
SkillInstall · skills CLI
2,6798 months agoMIT
apify-actor-development
Create, modify, debug, and deploy Apify Actors, and write their input and output schemas. Use when building an Actor from scratch, changing or trouble
SkillInstall · skills CLI
2,4982 days ago—
apify-actorization
Convert existing projects into Apify Actors - serverless cloud programs. Actorize JavaScript/TypeScript (SDK with Actor.init/exit), Python (async cont
SkillInstall · skills CLI
2,4982 days ago—
apify-generate-output-schema
Deprecated. Output schema generation moved to the apify-actor-development skill; prefer that skill whenever it is available.
SkillInstall · skills CLI
2,4982 days ago—
apify-integration-development
Design and build an official Apify integration for a company's product - workflow-automation apps (Zapier/n8n-style), AI agent plugins (coding-agent s
SkillInstall · skills CLI
2,4982 days ago—
apify-ultimate-scraper
Universal AI-powered web scraper for any platform. Scrape data from Instagram, Facebook, TikTok, YouTube, LinkedIn, X/Twitter, Google Maps, Google Sea
SkillInstall · skills CLI
2,4982 days ago—
webclaw
Web scraping, search, crawling, structured extraction and research for AI agents.
MCP serverGitHub-verified authorLocal · npm
2,4411 day agoAGPL-3.0
google-maps-scraper
Google Maps scraper for lead generation. Turns a business type and a place into a clean CSV of local businesses by driving the kit's own Google Maps e
SkillInstall · skills CLI
2,430todayMIT
requesthunt
Generate user demand research reports from real user feedback. Scrape and analyze feature requests, complaints, and questions from Reddit, X, GitHub,
SkillInstall · skills CLI
1,910todayApache-2.0
boss-zhipin-scraper
Scrape BOSS直聘 (job listing site) via Chrome CDP. Searches jobs by keyword/city/filters, fetches JD details, outputs structured JSON/CSV with plaintext
SkillInstall · skills CLI
1,75610 days agoMIT
wechat-article-ingest
微信公众号文章 → Markdown 提取 + A层观点提取 + B层问题链生成。 支持直接链接抓取和 PDF 提取两种方式。
SkillInstall · skills CLI
1,32430 days agoMIT
x-ingest
X(Twitter) 推文采集 → 统一 frontmatter Markdown。自动区分图文与视频: 图文下载图片本地嵌入,视频提取直链转成文字稿。无需登录(走官方嵌入端点)。
SkillInstall · skills CLI
1,32430 days agoMIT
xiaohongshu-ingest
小红书笔记采集 → 统一 frontmatter Markdown → 爆款拆解 + 衍生选题。 支持笔记链接和 xhslink 短链;爆款拆解按「人群×场景×痛点×情绪×钩子」生成可复用选题。
SkillInstall · skills CLI
1,32430 days agoMIT
zhihu-transcribe
知乎视频 → 下载 → 转录 → 存为 Markdown。 支持知乎视频链接、问答内嵌视频和专栏文章,无需登录。
SkillInstall · skills CLI
1,32430 days agoMIT
CRW Web Scraper
Open-source web scraper for AI agents with scrape, crawl, and map tools
MCP serverGitHub-verified authorLocal · Docker
1,2511 day agoAGPL-3.0
CRW Web Scraper
Open-source web scraper for AI agents with scrape, crawl, and map tools
MCP serverGitHub-verified authorLocal · Docker
1,2511 day agoAGPL-3.0
fastCRW
Scrape, crawl, map & search the web. Open-source, self-hostable Rust crawler & search for AI agents.
MCP serverGitHub-verified authorRemoteSign-in needed
1,2511 day agoAGPL-3.0
block-ai-scrapers
Block AI coding agents (Claude Code, Cursor, OpenCode, Grok, Codex, ChatGPT, Perplexity), WebFetch tools, CLI scrapers, and headless browsers from scr
SkillInstall · skills CLI
1,2202 days ago—
light-crawl
Build, debug, and operate reproducible web/app data acquisition, including research dataset handoffs. Use for repeated extraction, pagination, JS-rend
SkillInstall · skills CLI
9556 days agoMIT
daily-news-report
基于预设 URL 列表抓取内容,筛选高质量技术信息并生成每日 Markdown 报告。
SkillInstall · skills CLI
9433 months agoMIT
web-to-markdown
Convert a web URL into cleaned Markdown with deterministic routing. Use when Codex needs to read article-like content from links and should apply sour
SkillInstall · skills CLI
9433 months agoMIT
Unbrowse
Websites as APIs: read pages, run site tasks via learned APIs, cloud browser with saved logins.
MCP serverGitHub-verified authorLocal · npm
9221 day agoMIT
yao-chatgpt-crawler
Use when a user provides ChatGPT web AI-search keywords, repeat count, target entity, entity type, OpenCLI profile, and crawl interval preference, the
SkillInstall · skills CLI
91744 days agoMIT
yao-deepseek-crawler
Use when a user provides DeepSeek web AI-search keywords, repeat count, target entity, and entity type, then needs repeated fresh-window crawls aggreg
SkillInstall · skills CLI
91744 days agoMIT
yao-doubao-crawler
Use when a user needs repeated Doubao AI-search collection from web or Android Appium into compatible JSON plus Markdown/Excel/HTML GEO reports. Requi
SkillInstall · skills CLI
91744 days agoMIT
yao-geo-knowledge-base-builder
Build evidence-backed GEO brand knowledge bases from official sites, product pages, help centers, white papers, sales materials, media releases, certi
SkillInstall · skills CLI
91744 days agoMIT
yao-geo-page-audit
Diagnose a website page or small page set for GEO readiness with authoritative public evidence, systematic page analysis, code/content/schema fixes, a
SkillInstall · skills CLI
91744 days agoMIT
yao-geo-page-blueprint
Use when the user needs a GEO-friendly page blueprint for a specific product, topic, article, ranking, comparison, FAQ, knowledge-base, or case page,
SkillInstall · skills CLI
91744 days agoMIT
yao-geo-panorama-audit
当用户需要基于品牌官网抓取、公开事实交叉验证、内容资产诊断、站内站外 GEO 机会地图、项目启动诊断、季度复盘或投放前评估时使用;不用于问答平台采样监测、单页诊断、文章写作、标题生成、后端归因或执行路线图拆解。
SkillInstall · skills CLI
91744 days agoMIT
yao-geo-ranking-article-builder
当用户需要基于品牌 Brief、选题配置、关键词、竞品库和可信来源生成 GEO 榜单评测文章、best/top/alternatives/vs/persona/use-case 意图内容、评选方法、核心对比表、榜单正文、适合人群、FAQ、来源表和 Word/PDF/HTML/Markdown 四格式
SkillInstall · skills CLI
91744 days agoMIT
yao-geo-title-optimizer
Use when Chinese content teams need GEO title candidates, scoring, compliance review, or title-to-article mapping for articles, pages, FAQs, compariso
SkillInstall · skills CLI
91744 days agoMIT
yao-geo-tracking
Build a company-specific GEO backend tracking plan from a company name plus optional supporting information, using authoritative retrieval anchored on
SkillInstall · skills CLI
91744 days agoMIT
yao-geo-xiaohongshu
用浏览器采集小红书顶部搜索框的联想词,按词根和第一层联想词做两层扩展,逐次截图、记录下拉位置与来源路径,按行业转化目标评 1–10 分商业价值并生成 Excel。适用于小红书相关搜索词拓展、两层关键词采集包和截图留证;仅查笔记内容、话题热度或账号排名时不触发。
SkillInstall · skills CLI
91744 days agoMIT
yao-geoflow-cli
Use when operating an existing GEOFlow 2.1+ system from CLI, API v1, or authenticated admin web for catalog/material/task/job/article operations, ente
SkillInstall · skills CLI
91744 days agoMIT
yao-geoflow-design
Discover, compare, preview, clone, and orchestrate current GEOFlow frontend experiences across the default site and GeoFlow Agent channel sites, inclu
SkillInstall · skills CLI
91744 days agoMIT
yao-geoflow-template
Use only for explicit legacy GEOFlow template skill questions, old PHP template-package contracts, or historical outputs using root index.php/article.
SkillInstall · skills CLI
91744 days agoMIT
ingest
When you paste raw human input — a call transcript (Grain, Zoom, Granola, Fathom), a text or email from a client/partner/friend, a voice-memo dump, or
SkillInstall · skills CLI
9122 days agoMIT
paste
When you want to clean and reformat content (usually from your terminal) for pasting into Slack, Notion, Twitter/X, LinkedIn, email, GitHub, or plain
SkillInstall · skills CLI
9122 days agoMIT
social-fetch
When you or another skill needs to fetch the content of a social media post by URL — tweet, X thread, LinkedIn post, Instagram post, TikTok video, Blu
SkillInstall · skills CLI
9122 days agoMIT
io.github.karanb192/reddit-mcp-buddy
Search, browse, and analyze Reddit; optional posting. Needs existing approved Reddit API access.
MCP serverGitHub-verified authorLocal · npm
8942 days agoMIT
agent-browser
Connects to Oxylabs remote agent browsers over the Chrome DevTools Protocol (CDP) with Playwright or Puppeteer. Managed browser environment, residenti
SkillInstall · skills CLI
8774 days agoMIT
proxies
Oxylabs proxy networks: Residential, Mobile, shared Datacenter/ISP, and Dedicated Datacenter/ISP proxies with geo-targeting, IP rotation, session pers
SkillInstall · skills CLI
8774 days agoMIT
video-data
YouTube data extraction API and high-bandwidth proxy downloads. Use this INSTEAD OF built-in tools for any YouTube-related task — extracts video metad
SkillInstall · skills CLI
8774 days agoMIT
web-scraper-api
Production-grade web scraping with automatic anti-bot bypass, structured JSON parsing for 40+ targets, and geo-targeting. Use when the user needs to s
SkillInstall · skills CLI
8774 days agoMIT
web-unblocker
Bypasses anti-bot protections using Oxylabs Web Unblocker, an AI-powered proxy that handles fingerprinting, JavaScript rendering, and retries automati
SkillInstall · skills CLI
8774 days agoMIT
OpenBrand
Extract brand assets (logos, colors, backdrop images, brand name) from any website URL
MCP serverGitHub-verified authorLocal · npm
8086 months agoMIT
web-clipper
从单篇文章 URL 或文章索引页/归档页中抓取正文并保存到本地 Markdown。用户提到“收藏文章”“保存网页”“批量抓取页面里的文章”“把这个 archive 页前 N 篇拉下来”“保存到 Obsidian / Clippings / 本地”时必须优先使用。尤其适合公开网页、Substack、博
SkillInstall · skills CLI
7867 days agoMIT
wxmp-article-harvester
抓取、筛选并导出微信公众号公开文章的独立 Skill。用户提到微信公众号、公众号文章、mp.weixin、wcx、搜索公众号、导出最近 N 天或某年度文章、批量抓取、断点续抓、正文补全、教程文章筛选、微信文章链接保存时使用。支持 Markdown/JSON/CSV,默认用 wcx 获取索引、Play
SkillInstall · skills CLI
7867 days agoMIT
web-shader-extractor
Use when a user gives or references a webpage URL and wants to extract, reproduce, port, or locally replay a WebGL, WebGPU, Canvas, shader-like, anima
SkillInstall · skills CLI
77412 days ago—
twitter-monitor
Fetch recent posts from one or more X/Twitter accounts through twitterapi.io, output structured JSON/CSV records, optionally sync records to Feishu/La
SkillInstall · skills CLI
75010 days ago—
quark-mswnlz-publisher
Automate the full QuarkPanTool → mswnlz GitHub content publishing pipeline. Supports Quark / Baidu / Aliyun drives with multi-account rotation. Use wh
SkillInstall · skills CLI
69717 days agoMIT
wespy-fetcher
获取并转换微信公众号/网页文章为 Markdown 的封装 Skill,完整支持 WeSpy 的单篇抓取、微信专辑批量下载、专辑列表获取、HTML/JSON/Markdown 多格式输出。Use when user asks to 抓取微信公众号文章、公众号专辑批量下载、URL 转 Markdown
SkillInstall · skills CLI
69717 days agoMIT
x-fetcher
抓取 X (Twitter) 推文和长文章的命令行工具。支持普通推文(文字、图片、视频链接)和 X Article 长文章(完整正文,Markdown 格式),自动保存为 Markdown 文件。基于 Jane-xiaoer/x-fetcher 项目。Use when user mentions "
SkillInstall · skills CLI
69717 days agoMIT
youtube-downloader
Download YouTube videos with customizable quality and format options. Use this skill when the user asks to download, save, or grab YouTube videos. Sup
SkillInstall · skills CLI
69717 days agoMIT
firecrawl-agent
Autonomously navigate websites and extract structured data across pages. Use when the task requires navigation or no suitable ready-made workflow or d
SkillInstall · skills CLI
6831 day ago—
firecrawl-crawl
Bulk-extract many pages from one site or section. Use for "crawl", "everything under /docs", or content spanning linked pages.
SkillInstall · skills CLI
6831 day ago—
firecrawl-download
Save a site or section as local files (markdown, screenshots). Use for "download the site", offline docs, or a local copy for reference.
SkillInstall · skills CLI
6831 day ago—
firecrawl-interact
Drive a live browser on a scraped page: click, fill forms, log in, paginate, infinite-scroll. Use when content requires interaction or a scrape failed
SkillInstall · skills CLI
6831 day ago—
firecrawl-map
Discover and list a site's URLs, with search filtering. Use for "map the site" or "find the URL for" requests — when the user knows the site but not t
SkillInstall · skills CLI
6831 day ago—
XActions
X/Twitter automation MCP: scrape, post, schedule, analyze, engage. No API key required.
MCP serverGitHub-verified authorLocal · npm
6551 day agoApache-2.0
article-extractor
Extract clean article content from URLs (blog posts, articles, tutorials) and save as readable text. Use when user wants to download, extract, or save
SkillInstall · skills CLI
5808 months agoMIT
youtube-transcript
Download YouTube video transcripts when user provides a YouTube URL or asks to download/get/fetch a transcript from YouTube. Also use when user wants
SkillInstall · skills CLI
5808 months agoMIT
douyin-comments
抓取抖音单条视频的完整评论区(一级评论 + 全部楼中楼回复)和视频详情,可选下载视频,输出按点赞排序的「评论全文.md」和原始 JSON。在已登录抖音的真实浏览器里运行(Claude in Chrome,或 Grok Bot 等 Agent 自带、能执行页面脚本的浏览器),借页面自带 SDK 签名,
SkillInstall · skills CLI
5333 days agoMIT
EveryInfra
Structured data from 106 platforms (RedNote, Douyin, TikTok, Amazon), web search, CAPTCHA solving.
MCP serverGitHub-verified authorRemote● LiveAPI key needed
4711 day agoApache-2.0
reddit-insights
Search and analyze Reddit content using semantic AI search via reddit-insights.com MCP server. Use when you need to: (1) Find user pain points and fru
SkillInstall · skills CLI
4557 months ago—
xcrawl
Use this skill as the default XCrawl entry point for direct XCrawl requests, including single-URL fetch, format selection, sync or async execution, an
SkillInstall · skills CLI
4507 months ago—
xcrawl-crawl
Use this skill for XCrawl crawl tasks, including bulk site crawling, crawler rule design, async status polling, and delivery of crawl output for downs
SkillInstall · skills CLI
4507 months ago—
xcrawl-map
Use this skill for XCrawl map tasks, including site URL discovery, regex filtering, scope estimation, and crawl planning before full-site crawling.
SkillInstall · skills CLI
4507 months ago—
xcrawl-scrape
Use this skill for XCrawl scrape tasks, including single-URL fetch, format selection, sync or async execution, and JSON extraction with prompt or json
SkillInstall · skills CLI
4507 months ago—
content-extract
Robust URL-to-Markdown extraction for OpenClaw workflows. Use when the user wants to "extract/summarize/convert a webpage to markdown" (especially WeC
SkillInstall · skills CLI
43822 days agoMIT
mineru-extract
Use the official MinerU (mineru.net) parsing API to convert a URL (HTML pages like WeChat articles, or direct PDF/Office/image links) into clean Markd
SkillInstall · skills CLI
43822 days agoMIT
xhs
提取小红书帖子内容(文字、图片 OCR、视频字幕/转录),整理为 Markdown 并保存
SkillInstall · skills CLI
4343 months agoMIT
xhs-batch
批量提取小红书帖子,整理为本地 Markdown 知识库
SkillInstall · skills CLI
4343 months agoMIT
bili-cli
Operate a Bilibili (B站/哔哩哔哩) account through the `bili` CLI — watch and understand videos (subtitles, AI summary, frames, speech-to-text), browse reco
SkillInstall · skills CLI
3845 days agoMIT
web-fetch-advanced
Use when webfetch fails, need to bypass bot detection, scrape JS sites, download files, or use custom headers/proxies. Multi-method web content fetchi
SkillInstall · skills CLI
33013 days ago—
analyzing-brand
Analyzes a brand from its own website — its colours and fonts, the logo and imagery it uses, how it sounds, who it sells to, the claims it makes, and
SkillInstall · skills CLI
3091 day agoApache-2.0
analyzing-own-ads
Audits the ads a company is running itself — what's live now, what it has already stopped, and which have run longest. Watches the video ads and reads
SkillInstall · skills CLI
3091 day agoApache-2.0
analyzing-products
Normalizes a product into generation-ready facts — from an e-commerce URL (a clean description plus curated product images) or from a photo alone (cat
SkillInstall · skills CLI
3091 day agoApache-2.0
onboarding-user
Onboards a new user — sets up their brand for the first time from their website. Analyzes the brand, finds its competitors, and saves both to the comp
SkillInstall · skills CLI
3091 day agoApache-2.0
researching-competitor-ads
Analyzes the ads competitors are running — the ones live now, the ones they have already stopped, and which have run longest. Watches the video ads an
SkillInstall · skills CLI
3091 day agoApache-2.0
NoneCap
Solve hCaptcha and hCaptcha Enterprise challenges and get back a token, via the NoneCap API.
MCP serverGitHub-verified authorLocal · npm
3072 days agoMIT
reverse-engineering-saas
Use when studying a SaaS web product from the outside in order to rebuild, clone or copy it (ClickUp, Pipedrive, Notion, a CRM, a project tool), when
SkillInstall · skills CLI
29727 days agoMIT
apify-ashby-jobs-scraper
Scrape Ashby jobs or discover companies using Ashby with the Apify Ashby Job Board API Actor (johnvc/ashby-job-board-scraper). Job mode returns live j
SkillInstall · skills CLI
2951 day agoApache-2.0
apify-blocked-scrape-triage
Diagnose and recover a scrape that is blocked, throttled, or served empty or partial content, in cost order, before paying for a heavier Actor. Use wh
SkillInstall · skills CLI
2951 day agoApache-2.0
apify-booking-host-leads
Find and enrich B2B leads from Booking.com - hotels, apartments, and vacation rentals - and pull each host's or property manager's real contact detail
SkillInstall · skills CLI
2951 day agoApache-2.0
apify-buying-signal-detection
Set up a recurring buying-signal detection pipeline that finds companies showing buying intent across three signal types — job postings (hiring for th
SkillInstall · skills CLI
2951 day agoApache-2.0
apify-company-data-api
Pull structured B2B company data from Clutch.co with the Clutch.co Agency API Actor (johnvc/clutch-agency-api). Give it company profile URLs or bare s
SkillInstall · skills CLI
2951 day agoApache-2.0
apify-creator-emails
Find creators and their published contact emails in one run. Routes "find YouTube channels about <niche> with emails", "get the email for these TikTok
SkillInstall · skills CLI
2951 day agoApache-2.0
apify-easy-competitive-intelligence
This skill should be used when the user asks to "analyze a competitor", "compare pricing", "competitive landscape", "market research", "what do custom
SkillInstall · skills CLI
2951 day agoApache-2.0
apify-ecommerce
Scrape e-commerce data for pricing, reviews, bestsellers, and seller discovery across 30+ platforms including Amazon, Walmart, eBay, Shopify, WooComme
SkillInstall · skills CLI
2951 day agoApache-2.0
apify-google-maps-leads
Build a local-business lead database from Google Maps in one Apify pipeline: search by target audience + geography, enrich each place with company con
SkillInstall · skills CLI
2951 day agoApache-2.0
apify-influencer-brand-collabs
Discover Instagram brand–creator partnerships by chaining Apify Actors. Use when the user asks who collabs with a brand, which brands a creator has do
SkillInstall · skills CLI
2951 day agoApache-2.0
apify-instagram-niche-mapper
Map any Instagram Reels niche end to end with Apify Actors, then turn what works into hooks for your own content. Finds the reels that already won (Po
SkillInstall · skills CLI
2951 day agoApache-2.0
apify-job-boards
Pull job postings from many boards in one run and prepare one validated, deduplicated table. Routes "find jobs / scrape job postings / build a job lis
SkillInstall · skills CLI
2951 day agoApache-2.0
apify-jobs-data
Extract clean, de-noised job-posting data from LinkedIn, Indeed, Glassdoor, and 20+ boards in one Apify run — deduplicated across boards, with likely
SkillInstall · skills CLI
2951 day agoApache-2.0
apify-lead-scoring-enrichment
Score and enrich a CSV of B2B leads using Apify Actors. Takes a CSV with company URLs, free-text scoring rules, and an enrichment preference; runs Bui
SkillInstall · skills CLI
2951 day agoApache-2.0
apify-link-prospecting-outreach
Find sites ranking for target keywords, score every prospect with Ahrefs domain authority and page-level traffic, identify the strongest pitch angle p
SkillInstall · skills CLI
2951 day agoApache-2.0
apify-local-business-leads-osm
Build a local-business lead list without scraping Google Maps. Routes "find dentists / plumbers / salons / restaurants in <city> with emails", "busine
SkillInstall · skills CLI
2951 day agoApache-2.0
apify-marketing-agency-database
Build a marketing agency database from Clutch.co with the Clutch.co Agency API Actor (johnvc/clutch-agency-api). Point it at any Clutch directory or c
SkillInstall · skills CLI
2951 day agoApache-2.0
apify-orchestrator-actor-development
Build TypeScript Apify orchestrator Actors — coordinate a sequence of sub-Actors (optionally with an LLM step) using the apify-orchestrator library. U
SkillInstall · skills CLI
2951 day agoApache-2.0
apify-osint-threat-intel
Use this skill when the user asks to "find CVEs for", "check if my domain is breached", "threat intel on", "OSINT on", "security news about", "attack
SkillInstall · skills CLI
2951 day agoApache-2.0
apify-plan-travel
This skill should be used when the user asks to "find flights", "compare flights", "analyze flight search results", "plan a flight itinerary", "plan a
SkillInstall · skills CLI
2951 day agoApache-2.0
apify-product-data-setup
Wire an AI agent to live e-commerce product data using Apify's E-commerce Scraping Tool over MCP, either as runtime tool calls or as a scheduled refre
SkillInstall · skills CLI
2951 day agoApache-2.0
apify-reddit-scraper
Scrape Reddit with the harshmaur/reddit-scraper Apify Actor: keyword search across all of Reddit or inside one subreddit, full subreddit listings, pos
SkillInstall · skills CLI
2951 day agoApache-2.0
apify-verified-email-finder
Builds a list of verified business emails from Google Maps, Google SERPs, or a user-supplied URL list. Verification happens inside the same Apify run
SkillInstall · skills CLI
2951 day agoApache-2.0
apify-x402-agentic-wallet
Discover, pay for, and run any Apify Actor by paying USDC on Base over the x402 protocol with a Coinbase Agentic Wallet (awal) — no Apify account or A
SkillInstall · skills CLI
2951 day agoApache-2.0
apify-yandex-image-search-api
Search the Yandex Images vertical and get full-size image URLs as structured JSON with the Apify Yandex Search Scraper Actor (johnvc/Scrape-Yandex). A
SkillInstall · skills CLI
2951 day agoApache-2.0
apify-yandex-search-api
Get structured Yandex search results without an official API key using the Apify Yandex Search Scraper Actor (johnvc/Scrape-Yandex). One query returns
SkillInstall · skills CLI
2951 day agoApache-2.0
mirroir-onboard
Onboard a consumer web app to mirroir's .mirroir/ dotfile by EXPLORING the running app (chrome-devtools-mcp) — derive real selectors from the accessib
SkillInstall · skills CLI
2941 day agoApache-2.0
bilibili-page-reader
Get content from Bilibili videos: official subtitles, danmaku (density/peaks/sample), comments. When no subtitles exist (no 投稿字幕), fall back to downlo
SkillInstall · skills CLI
28853 days agoMIT
page-analysis
Analyze web page content, structure, and layout to understand what a page contains and how it is organized. Trigger when the user asks to: analyze a p
SkillInstall · skills CLI
28047 days agoMIT
web-scraping
Extract structured data from websites, scrape page content, and collect information across multiple pages. Trigger when the user asks to: extract data
SkillInstall · skills CLI
28047 days agoMIT
brightdata-plugin
Web scraping, Google search, structured data extraction, and MCP server integration powered by Bright Data. Includes 7 skills: scrape any webpage as m
PluginAnthropic marketplace
27115 days agoMIT
io.github.king-of-the-grackles/reddit-research-mcp
Turn Reddit's chaos into structured insights with full citations - MCP server for Reddit research
MCP serverGitHub-verified authorLocal · PyPI
26524 days agoMIT
PyScrappy
Web-scraping toolkit with 22 tools for structured web data as JSON for AI agents.
MCP serverGitHub-verified authorLocal · PyPI
26522 days agoMIT
io.github.sonpiaz/watch-cli
Hand any social video to your AI agent — frames + transcript bundled. MCP server for watch-cli.
MCP serverGitHub-verified authorLocal · npm
2602 months agoMIT
zach-listing-health-checker
以真实消费者视角检查亚马逊Listing健康状态。通过网页抓取模拟消费者浏览体验, 检查页面可见性、价格、卖家信息、购物车、配送、类目节点、排名、差评等关键指标, 并验证关键词搜索可见性。使用时机:新品上架后验收、日常巡检、排查Listing异常。 触发词:/zach-listing-health-
SkillInstall · skills CLI
26029 days agoMIT
firecrawl
Web scraping and crawling powered by Firecrawl. Turn any website into clean, LLM-ready markdown or structured data. Scrape single pages, crawl entire
PluginAnthropic marketplace
2592 days agoMIT
news-extractor
新闻站点内容提取。支持微信公众号、今日头条、网易新闻、搜狐新闻、腾讯新闻。当用户需要提取新闻内容、抓取公众号文章、爬取新闻、或获取新闻JSON/Markdown时激活。
SkillInstall · skills CLI
2566 months ago—
digcrawl
Read web and supported social-platform links through a locally installed DigCrawl MCP server, or analyze an explicitly requested local video path or d
SkillInstall · skills CLI
2525 days agoMIT
felo-web-fetch
Extract webpage content with Felo Web Extract API. Use for turning URLs into html/markdown/text, selecting specific page areas with CSS selectors, and
SkillInstall · skills CLI
2513 months ago—
reddit-skill
Reddit: чтение постов и комментариев без ключей через веб-инструмент агента, RSS и публичный JSON; API для пользователей, сабреддитов и поиска. OAuth2
SkillInstall · skills CLI
2348 days agoMIT
scrapedo-web-scraper
Веб-скрапинг через Scrape.do. Обходит блокировки и CAPTCHA. АВТОМАТИЧЕСКИ используй при ошибках WebFetch: 403, 401, 429, timeout, access denied, Cloud
SkillInstall · skills CLI
2348 days agoMIT
telegram-channel-parser
Парсинг публичных Telegram-каналов через веб-превью t.me/s/. Посты, метрики, аналитика, дайджесты, конкурентный анализ. Cache-first подход для гигиены
SkillInstall · skills CLI
2348 days agoMIT
douban-cli
Query Douban (豆瓣) movies, TV shows, books, doulists and user collections, and manage the signed-in account's marks, ratings, short comments and tags t
SkillInstall · skills CLI
2303 days agoMIT
x-twitter-scraper
Use Xquik to fetch X (Twitter) data or act through a connected account. It covers search, profiles, followers, replies, threads, timelines, media down
SkillInstall · skills CLI
2291 day agoMIT
xquik-social-research
Research X data with Xquik, the world's fastest and cheapest X Twitter scraper service with the most complete X data. Use only when the request or act
SkillInstall · skills CLI
2291 day agoMIT
jev-social
Run browser-grounded, read-only social research through Jev Social when a user wants posts, profiles, comments, video evidence, or a source-linked rep
SkillInstall · skills CLI
2126 days agoMIT
web-scraper
Browse websites and extract structured information. Use when the user needs data from a web page.
SkillInstall · skills CLI
21152 days agoMIT
browse-x
Reads public X (formerly Twitter) posts, threads, X Articles, profiles, followers, following, and search results as Markdown or JSON, with no X accoun
SkillInstall · skills CLI
1973 days agoMIT
import-x-history
Imports an X (Twitter) account's post history in bulk through mdfromx.com: hundreds to thousands of posts in one request, replies and reposts included
SkillInstall · skills CLI
1973 days agoMIT
Crawlberg
Scrape, crawl, and map websites to Markdown or JSON via local CLI.
MCP serverGitHub-verified authorLocal · Docker
1966 days agoMIT
Kreuzcrawl
Scrape, crawl, and map websites to Markdown or JSON via local CLI.
MCP serverGitHub-verified authorLocal · Docker
1966 days agoMIT
io.github.TickTockBent/charlotte
Renders web pages into structured, agent-readable representations using headless Chromium.
MCP serverGitHub-verified authorLocal · npm
18413 days agoMIT
twitter-crawler
Twitter 推文爬取器 - 指定用户名爬取推文,保存为 Markdown 格式,支持自定义数量和字段
SkillInstall · skills CLI
18332 days ago—
fetch-url-as-markdown
Fetch a web page (URL) and return clean Markdown via local trafilatura, with Exa MCP as a fallback for JS-rendered or anti-bot pages. Use when the use
SkillInstall · skills CLI
181todayMIT
io.github.scrapeless-ai/scrapeless-mcp-server
Web search, browser automation, scraping, crawling and CAPTCHA solving for AI agents.
MCP serverGitHub-verified authorLocal · npm
1702 months agoMIT
servo-fetch
Fetch and render web pages using the Servo browser engine — a single binary with JS execution, CSS layout, screenshots, and content extraction. Use wh
SkillInstall · skills CLI
1646 days agoApache-2.0
fetch-content
Fetch and normalize any content source into clean text with metadata — YouTube video transcripts, TikTok captions, web articles, PDFs, tweets/X posts,
SkillInstall · skills CLI
16345 days agoMIT
power-crawl
Playwright MCP 를 e2e 테스트가 아니라 고속 데이터 수집 엔진으로 쓰는 크롤링 스킬. 페이지 뒤에 숨은 JSON API 를 network 로그로 발굴하고, 단일 도구 호출 안에서 페이지네이션·무한스크롤을 루프로 돌리며, 수집한 데이터를 컨텍스트에 통과시키
SkillInstall · skills CLI
16332 days ago—
see
使用外部视觉服务或本地 OCR 分析本地图片、截图、视频及明确提供的媒体 URL,输出 Markdown。用户明确要求 see,或当前主模型缺少完成媒体分析所需的视觉能力时使用。不拦截普通文本、任意 URL 或已有原生视觉可以直接完成的任务;不用于生图、编辑图片或自动操作屏幕。使用外部服务前说明发送
SkillInstall · skills CLI
1622 months agoMIT
insta-audit
Audits an Instagram account through Treg. By default the creator's own account, free - installs Treg if needed, connects their Instagram, pulls the la
SkillInstall · skills CLI
1578 days agoMIT
outliers
Finds the outlier reels of Instagram accounts or videos of TikTok accounts (3x their own account's median views or more) through Treg and turns the 5
SkillInstall · skills CLI
1578 days agoMIT
WebReaper
AI-native web scraper: scrape, crawl and map any site to clean markdown over stdio. MIT-licensed.
MCP serverGitHub-verified authorLocal · NuGet
15240 days agoMIT
MediaWiki MCP Server
MCP server enabling AI clients to interact with any MediaWiki wiki through standard tools
MCP serverGitHub-verified authorLocal · MCPB
1472 days agoMIT
tracking-discover
Use when the user wants crawl coverage, platform detection, dataLayer discovery, or a fresh artifact directory before grouping and schema work.
SkillInstall · skills CLI
1456 months agoApache-2.0
verify
Build, launch and drive wayfinder-maps to verify a change end-to-end (server + headless browser).
SkillInstall · skills CLI
14538 days agoMIT
website-to-hyperframes
Capture a website and create a HyperFrames video from it. Use when: (1) a user provides a URL and wants a video, (2) someone says "capture this site",
SkillInstall · skills CLI
1431 day agoMIT
creator-research-tracker
把 X/Twitter 博主、YouTube 博主、newsletter、播客或类似个人信息源的持续更新转成 progressive-investment-research 研究工作区的可审计增量。适用于:跟踪博主更新、生成每日报告、通过 Chrome 登录态或本地 browser bridge 抓
SkillInstall · skills CLI
13351 days ago—
Fitter
Turn any website or API into structured JSON with LLM-authored declarative scraping configs.
MCP serverGitHub-verified authorLocal · MCPB
1332 months agoMIT
business-email-extractor
Extract verified business email addresses from Google Maps listings. Find contact emails for any industry and location — ready for cold outreach campa
SkillInstall · skills CLI
1325 months agoMIT
google-maps-export
Export Google Maps business data to CSV, JSON, or CRM format (HubSpot, Pipedrive, Salesforce). Bulk export with custom field mapping and filtering.
SkillInstall · skills CLI
1325 months agoMIT
google-maps-scraper
Scrape business data from Google Maps — names, phones, emails, websites, ratings, reviews. Extract leads by keyword and location with no coding requir
SkillInstall · skills CLI
1325 months agoMIT
local-business-finder
Find any local business by category and location on Google Maps. Get names, phone numbers, emails, websites, ratings, and hours. Search restaurants, d
SkillInstall · skills CLI
1325 months agoMIT
music-mv
用代码给一首歌做一支音乐 MV(不用视频生成模型):先把歌听懂(歌词时间轴、节拍、情绪起落、别人怎么理解这首歌),再定画风、画角色、写剧本和分镜、先出草图再做整片,最后照清单看片修改;也能先拆一支参考视频的风格再照着做。画面用 Canvas / p5.js / p5.brush 一帧一帧画,Hype
SkillInstall · skills CLI
13224 days agoMIT
capture-site
Crawl a live website, read-only and paced, into a capture/ folder that a rebuild is checked against — every page's HTML, text and head tags, redirects
SkillInstall · skills CLI
13113 days agoMIT
convert-site
Convert a live website (WordPress first; Drupal, Webflow, Squarespace, Wix and static sites too) into a static Astro site with the same URLs, content,
SkillInstall · skills CLI
13113 days agoMIT
parity-gates
Freeze a site capture into baseline/ and prove an Astro build matches it — every route, redirect (one hop, through a simulation of the host), SEO head
SkillInstall · skills CLI
13113 days agoMIT
visual-review
Prove an Astro rebuild looks like the live site it replaces — full-page screenshots of both sides with motion frozen, a pixel diff with a 0.5 % pass l
SkillInstall · skills CLI
13113 days agoMIT
capture-video-frames
Capture frames from a YouTube video at a regular interval, produce a manifest mapping filenames to timestamps, and describe each frame with an LLM. US
SkillInstall · skills CLI
1307 days agoMIT
extract-transcript
Extract a timestamped transcript from a YouTube video. Returns text with [MM:SS] or [HH:MM:SS] timestamps for each segment. USE FOR: get transcript, t
SkillInstall · skills CLI
1307 days agoMIT
youtube-live-chat
Download live chat transcripts from YouTube videos. Use when the user asks for live chat, chat messages, or chat replay from a YouTube video and provi
SkillInstall · skills CLI
1307 days agoMIT
ai.smithery/ScrapeGraphAI-scrapegraph-mcp
Enable language models to perform advanced AI-powered web scraping with enterprise-grade reliabili…
MCP serverBulk publisher · 213 entriesVerified domain · smithery.aiRemoteSign-in needed
1223 months agoMIT
io.github.ScrapeGraphAI/scrapegraph-mcp
AI-powered web scraping and data extraction capabilities through ScrapeGraph API
MCP serverGitHub-verified authorLocal · PyPI
1223 months agoMIT
12306-train-query
专业的12306火车票班次查询技能,支持准确的车站选择、日期指定和车次信息获取。使用已验证的浏览器操作SOP流程和URL参数直接查询策略,确保查询结果的准确性。适用于用户需要查询火车班次、余票信息、车次时间等12306相关查询场景。
SkillInstall · skills CLI
1217 months ago—
agentbox
Run web-scraping subagents inside isolated Docker sandboxes, one box per subagent. Each box has a terminal (curl, python), a persistent headless Chrom
SkillInstall · skills CLI
12111 days ago—
browsing-airbnb
Use when the user wants to interact with Airbnb — search public stays, extract listing details, extract visible reviews, or read availability and pric
SkillInstall · skills CLI
1215 months agoMIT
browsing-aliexpress
Use when the user wants to interact with AliExpress — search products, inspect product detail pages, read the shopping cart, or add explicitly request
SkillInstall · skills CLI
1215 months agoMIT
browsing-amazon
Use when the user wants to interact with Amazon.com — search products or groceries, inspect product detail pages, extract Amazon Fresh or Whole Foods
SkillInstall · skills CLI
1215 months agoMIT
browsing-booking
Use when the user wants to interact with Booking.com — search for accommodations with full filter support (property type, stars, score, meal plan, fac
SkillInstall · skills CLI
1215 months agoMIT
browsing-capterra
Use when the user wants to extract software product data from Capterra (capterra.com) — product overview with ratings, category breakdowns, pricing, a
SkillInstall · skills CLI
1215 months agoMIT
browsing-craigslist
Use when the user wants to search listings or extract posting details on Craigslist (craigslist.org) — the US classifieds network covering housing, jo
SkillInstall · skills CLI
1215 months agoMIT
browsing-facebook
Use when the user wants to interact with Facebook Marketplace — search visible listings, extract listing details, and summarize seller/profile informa
SkillInstall · skills CLI
1215 months agoMIT
browsing-g2
Use when the user wants to extract software product data from G2 (g2.com) — product overview with ratings, review counts, rating breakdowns, and G2 sc
SkillInstall · skills CLI
1215 months agoMIT
browsing-glassdoor
Use when the user wants to extract company data from Glassdoor — company overview details (rating, CEO approval, size, industry) or employee reviews w
SkillInstall · skills CLI
1215 months agoMIT
browsing-instagram
Use when the user wants to interact with Instagram — extract a user's profile data (bio, followers, following, post count, avatar) or scrape visible p
SkillInstall · skills CLI
1215 months agoMIT
browsing-linkedin
Use when the user wants to interact with LinkedIn — extract post data (content, author, reactions, comments), scrape a member profile (name, headline,
SkillInstall · skills CLI
1215 months agoMIT
browsing-madlan
Use when the user wants to search real estate listings or extract property details on Madlan (madlan.co.il) — Israel's leading property portal. Action
SkillInstall · skills CLI
1215 months agoMIT
browsing-skills
Umbrella skill for a library of website-specific browsing skills. Use when the user's request targets one of these specific websites: <!-- DOMAINS:STA
SkillInstall · skills CLI
1215 months agoMIT
ctrip-flight-search
基于浏览器自动化工具的携程航班查询技能,支持单程、往返航班查询,能够处理出发地、目的地、日期等参数输入,并具备错误恢复机制。适用于需要从携程网查询航班信息、获取航班价格和时刻表的场景。
SkillInstall · skills CLI
1217 months ago—
dianping-info-query
专业的大众点评网站信息查询技能,支持商户搜索、详情获取、评分信息提取、城市切换和深度信息查询等功能。当用户需要从大众点评网站查询商户信息、获取店铺详情、查看评分评论、切换城市等数据时使用。该技能包含完整的双状态登录检测机制(已登录/未登录)、用户引导机制和标准化操作流程,并支持包括食材评分在内的完整
SkillInstall · skills CLI
1217 months ago—
webscraping-expert
Expert data extraction guide. Starts with a structured intake to understand the target. Always tries the cheapest path first (HTTP requests → browser
SkillInstall · skills CLI
12111 days ago—
envoy
Read material the host cannot get itself: video or audio transcripts and frames, PDFs and Office documents, image posts, pages that need scrolling, co
SkillInstall · skills CLI
1151 day agoApache-2.0
authoritative-data-harvester
自动定位并获取权威公开数据(优先API/官方批量下载),输出可复现抓取与清洗方案。Invoke when用户需要权威数据、官方统计、API下载或数据源爬取。
SkillInstall · skills CLI
1136 months ago—
clone-anywebsite
Clone any website's landing page with pixel-perfect fidelity. Visual-first workflow: screenshot → sniper CSS extraction → deep DOM interrogation → ani
SkillInstall · skills CLI
11252 days ago—
customer-research
Mine online communities and analyze existing assets to understand what customers actually think, say, and struggle with. Use when the user wants to do
SkillInstall · skills CLI
1123 days agoMIT
web-scraping
This skill activates for web scraping and Actor development. It proactively discovers APIs via traffic interception, recommends optimal strategy (traf
SkillInstall · skills CLI
1108 months agoMIT
wp-static-clone
Clones a live WordPress (or other CMS-driven) site into a static HTML site deployable on any static host (Cloudflare Pages, Netlify, Vercel, S3+CloudF
SkillInstall · skills CLI
1104 months agoMIT
doc-scraper
Crawl documentation sites into local corpora agents can search, read, and diff fully offline.
MCP serverGitHub-verified authorLocal · MCPB
1091 day agoApache-2.0
seed-scout
Competitor Scout. Finds the weak points of your competitors in their own App Store reviews: searches the App Store for the apps people already use for
SkillInstall · skills CLI
10612 days agoMIT
ai.smithery/oxylabs-oxylabs-mcp
Fetch and process content from specified URLs using the Oxylabs Web Scraper API.
MCP serverBulk publisher · 213 entriesVerified domain · smithery.aiRemoteSign-in needed
1053 days agoMIT
io.oxylabs/oxylabs-mcp
Fetch and process content from specified URLs & sources using the Oxylabs Web Scraper API.
MCP serverVerified domain · oxylabs.ioLocal · PyPI
1053 days agoMIT
io.github.jlsookiki/secondhand-mcp
Search Facebook Marketplace, eBay, Depop, and Poshmark from AI — filters, photos, full listings.
MCP serverGitHub-verified authorLocal · npm
10239 days agoMIT
io.github.lukabudik/alza-mcp
Unofficial MCP server for Alza.cz: catalog search plus token-guarded account and checkout.
MCP serverGitHub-verified authorLocal · npm
1015 days ago—
OpenScreenShot
Capture website screenshots (viewport or full page) with local Chrome, or on OpenScreenShot Cloud.
MCP serverGitHub-verified authorLocal · npm
9319 days agoMIT
ai.smithery/yuna0x0-anilist-mcp
Access and interact with anime and manga data seamlessly. Retrieve detailed information about your…
MCP serverBulk publisher · 213 entriesVerified domain · smithery.aiRemoteDown
914 months agoMIT
proxy-scraper
Free proxies that actually work: checked HTTP/SOCKS proxies, and pages fetched through them
MCP serverGitHub-verified authorLocal · PyPI
90todayMIT
com.pulsemcp/good-eggs
MCP server for Good Eggs grocery shopping automation using Playwright.
MCP serverVerified domain · pulsemcp.comLocal · npm
8135 days agoMIT
com.pulsemcp/pulse-fetch
MCP server for fetching web resources with content extraction and anti-bot bypass.
MCP serverVerified domain · pulsemcp.comLocal · npm
8135 days agoMIT
CN Scraper MCP
MCP server for AI agents to search major Chinese internet platforms with local-first login support.
MCP serverGitHub-verified authorLocal · PyPI
783 months agoMIT
ShadowCrawl
Rust MCP stealth scraper: anti-bot search/scrape with CDP fallback + HITL non-robot.
MCP serverGitHub-verified author
7255 days agoMIT
ShadowCrawl
Stealth scraping & search. Bypasses Cloudflare, DataDome & LinkedIn via Cyborg HITL approach.
MCP serverGitHub-verified authorRemoteSign-in needed
7255 days agoMIT
Token Enhancer
Cuts AI web-fetching costs up to 99.9% by stripping page junk before it reaches your LLM.
MCP serverGitHub-verified authorLocal · PyPI
687 months agoMIT
io.globalping/mcp
Interact with a global network measurement platform.Run network commands from any point in the world
MCP serverVerified domain · globalping.ioRemoteDown
6615 days ago—
nimble
Nimble web data toolkit — search, extract, map, crawl the web and work with structured data agents
PluginAnthropic marketplace
633 days agoMIT
Supadata
Video transcripts, metadata and structured data from YouTube, TikTok, Instagram, X; web scraping.
MCP serverGitHub-verified authorRemoteSign-in needed
639 days agoMIT
io.github.ytkoka/impersonate-mcp
Switch impersonate-proxy's TLS/HTTP2 fingerprint, UA, client IP and upstream; verify and fetch.
MCP serverGitHub-verified authorLocal · MCPB
475 days agoMIT
dittu
Clone any website's frontend into Next.js or Astro and verify it with pixel diffs.
MCP serverGitHub-verified authorLocal · npm
4615 days agoMIT
WebScraping.AI
Web scraping tools with Chromium JS rendering, rotating proxies, and AI question answering.
MCP serverGitHub-verified authorLocal · npm
4518 days ago—
io.github.Decodo/mcp-server
Enable your AI agents to scrape and parse web content dynamically, including geo-restricted sites
MCP serverGitHub-verified authorLocal · npm
413 days ago—
PageMap
Structured web intelligence for AI agents. 5x fewer tokens than Playwright/Firecrawl, 84.7% accuracy
MCP serverGitHub-verified authorLocal · PyPI
365 months ago—
zyte-web-data
Web scraping skills for Claude Code powered by the Zyte API — scrape sites, generate and run Scrapy spiders, define extraction schemas, and ship to Sc
PluginAnthropic marketplace
3318 days ago—
com.mcparmory/agentql
Query webpages and extract structured data using natural language
MCP serverVerified domain · mcparmory.comLocal · PyPI
326 months ago—
com.mcparmory/apify
Build, deploy, and run web scraping and automation actors in the cloud
MCP serverVerified domain · mcparmory.comLocal · PyPI
326 months ago—
com.mcparmory/builtwith
Detect technologies and tech stacks used on any website
MCP serverVerified domain · mcparmory.comLocal · PyPI
326 months ago—
com.mcparmory/firecrawl
Scrape, crawl, and extract structured data from websites at scale
MCP serverVerified domain · mcparmory.comLocal · PyPI
326 months ago—
com.mcparmory/linkly
Create short links, manage domains, and track click analytics
MCP serverVerified domain · mcparmory.comLocal · PyPI
326 months ago—
com.mcparmory/parallel
Search the web, extract content, and run distributed tasks with AI-powered automation
MCP serverVerified domain · mcparmory.comLocal · PyPI
326 months ago—
com.mcparmory/scrapingant
Scrape webpages, handle JavaScript and CAPTCHA, extract structured data
MCP serverVerified domain · mcparmory.comLocal · PyPI
326 months ago—
DocPull
Sync public web sources into cited context packs for AI agents, RAG, and MCP clients.
MCP serverGitHub-verified authorLocal · PyPI
291 day agoMIT
io.github.Dudude-bit/yandex-lavka-mcp
Unofficial MCP server for ordering Yandex Lavka groceries: search, cart, checkout.
MCP serverGitHub-verified authorLocal · PyPI
2639 days agoMIT
io.github.habedi/omni-lpr
An MCP server for automatic license plate recognition
MCP serverGitHub-verified authorRemoteDown
2611 days agoMIT
jev-ultrafast-mcp
Hand browser work off to a server-side agent: read the page as a table, act, then verify.
MCP serverGitHub-verified authorLocal · PyPI
2551 days agoMIT
Olostep MCP Server
Live web search, scraping and crawling API for AI. Get structured, LLM-ready data from any site.
MCP serverGitHub-verified authorLocal · npm
251 day agoMIT
PyreCrawl
Web scraping + research toolkit for AI agents: scrape, crawl, monitor URLs with anti-bot bypass.
MCP serverGitHub-verified authorLocal · PyPI
2553 days agoMIT
io.github.ZenRows/zenrows-mcp
Zenrows MCP server: Fetch, Extract, Batch, and Browser Sessions for AI agents
MCP serverGitHub-verified authorLocal · npm
212 days agoMIT
io.github.cardmagic/messages
Fuzzy search and browse Apple Messages/iMessage from CLI or MCP server
MCP serverGitHub-verified authorLocal · npm
202 days agoMIT
io.github.cmpxchg16/mcp-ethical-hacking
An MCP server that provides LinkedIn & Reddit data
MCP serverGitHub-verified authorLocal · MCPB
2014 months ago—
Svipall
Read any page past its anti-bot wall, crawl sites, search without an API key, solve captchas locally
MCP serverVerified domain · svipall.ilien.devLocal · npm
201 day agoAGPL-3.0
pline.ai
Scrape, crawl, batch-scrape, map, and search the web through the hosted pline.ai API.
MCP serverGitHub-verified authorLocal · npm
191 day agoMIT
nab
Token-optimized HTTP client for LLMs: fetches any URL as clean markdown. CLI and MCP server.
MCP serverGitHub-verified authorLocal · Cargo
184 days agoMIT
HasData
All HasData scraping tools in one MCP server: Google, TikTok, Instagram, maps, e-commerce and more.
MCP serverVerified domain · hasdata.comRemote● LiveAPI key needed
174 days agoMIT
io.github.emirmrkaljevic/usb-rea
Reverse engineer USB gadgets: capture traffic, infer the protocol, generate a pyusb driver.
MCP serverGitHub-verified authorLocal · PyPI
171 day agoMIT
Xtracticle
Read public X (Twitter) posts, threads and X Articles as clean Markdown. Read-only, no auth.
MCP serverVerified domain · xtracticle.comRemote● Live
172 days ago—
acrawl
Autonomous web crawler. 17 browser tools + goal-driven run_goal agent. Single binary, stealth.
MCP serverGitHub-verified authorLocal · MCPB
162 days agoMIT
io.scrapfly.mcp/mcp
Scrape any website, extract structured data, and collect web content at scale with AI agents
MCP serverVerified domain · mcp.scrapfly.ioLocal · npm
152 days ago—
Webcrawl Anything
Scrape, map, crawl, search and monitor the web. Runs locally with no API key, cites every source.
MCP serverGitHub-verified authorLocal · npm
142 days agoMIT
webEmbedding
Clone any web page from a URL into a verified offline HTML copy, embed, or rebuild.
MCP serverGitHub-verified authorLocal · npm
145 days agoMIT
Browser Scraper
Stealth Chrome for AI agents: bot-protected sites, Turnstile, closed Shadow DOM, clean Markdown.
MCP serverGitHub-verified authorLocal · npm
1317 days agoMIT
DeepScout
Scrape any e-shop and match products across shops without EAN. API & MCP for AI agents.
MCP serverVerified domain · deepscout.aiRemoteSign-in needed
1218 days ago—
HasData Instagram
Public Instagram profiles and post feeds by handle, with hashtags and mentions parsed.
MCP serverVerified domain · hasdata.comLocal · npm
124 days agoMIT
io.github.devag7/linkedin-mcp
Unofficial local LinkedIn research and opt-in alpha writes; live compatibility is unverified.
MCP serverGitHub-verified authorLocal · npm
121 day agoMIT
ai.smithery/222wcnm-bilistalkermcp
Track Bilibili creators and get the latest updates on videos, dynamics, and articles. Fetch user p…
MCP serverBulk publisher · 213 entriesVerified domain · smithery.aiRemoteDown
117 days agoMIT
HasData TikTok
Public TikTok profiles, videos, comments and keyword search as JSON. No developer account.
MCP serverVerified domain · hasdata.comLocal · npm
1115 days agoMIT
io.github.Crawleo/Crawleo-MCP
Hosted Crawleo MCP (remote streamable HTTP endpoint).
MCP serverGitHub-verified authorRemoteSign-in needed
1110 months agoMIT
WordPress MCP Server
MCP server for WordPress. Manage posts, users, comments, terms, metadata, and settings.
MCP serverGitHub-verified authorLocal · npm
103 months ago—
com.superagnt/web-scraping
superagnt: marketing plugin for Claude and ChatGPT. Know your market: scrape and search the web.
MCP serverVerified domain · superagnt.comRemoteSign-in needed
99 days agoMIT
io.github.Digilac/simap-mcp
MCP server for simap.ch - Swiss public procurement platform
MCP serverGitHub-verified authorLocal · npm
91 day agoMIT
io.github.gander-tools/osm-tagging-schema-mcp
MCP server for querying and validating OpenStreetMap tags
MCP serverGitHub-verified authorLocal · npm
94 days agoGPL-3.0
io.github.johnisanerd/us-congress-trades
US Congress members' disclosed stock trades. Paid, on Apify's hosted MCP.
MCP serverGitHub-verified authorRemoteSign-in needed
917 days agoMIT
KrabiClaw
Manage and publish restaurant and local business websites through MCP.
MCP serverGitHub-verified authorRemoteSign-in needed
91 day agoAGPL-3.0
ReadGZH
Read WeChat public account articles via MCP. 99.89% anti-scraping success, 50-87% token compression.
MCP serverGitHub-verified authorRemote● LiveFree to try
91 day agoAGPL-3.0
Defuddle Fetch
Fetch content from the web, cleaned up nicely for LLMs (using Defuddle).
MCP serverGitHub-verified authorLocal · npm
85 days agoMIT
EnConvert
Unified web ingestion for AI agents: perceive, discover, search, extract, ingest, watch, convert.
MCP serverVerified domain · enconvert.comLocal · npm
757 days agoMIT
io.github.baixianger/camoufox-mcp
Anti-detection browser automation with Camoufox - stealth Firefox for web scraping
MCP serverGitHub-verified authorLocal · npm
78 months ago—
io.github.Huzy85/fantoma
Accessibility-tree browser for AI agents: read pages, log in, extract data, run tasks.
MCP serverGitHub-verified authorLocal · PyPI
77 days agoMIT
io.github.latent-9/reddit-growth-mcp
Find where to post on Reddit and score your draft before posting — no API keys needed.
MCP serverGitHub-verified authorLocal · PyPI
73 months agoMIT
io.github.xcodethink/pixelcheck
Real eyes and hands on the web for AI agents. MCP-first. Local-first. Vendor-agnostic.
MCP serverGitHub-verified authorLocal · npm
733 days agoMIT
io.github.zezeron/tweetsave-mcp
Twitter/X analysis without token waste. Fetch tweets, download media. No API key.
MCP serverGitHub-verified authorLocal · npm
77 months agoMIT
String Web Access
Search the web, fetch any URL and map a site as clean, LLM-ready Markdown.
MCP serverVerified domain · usestring.aiLocal · npm
72 days agoMIT
torproxy
Tor HTTP and SOCKS5 proxy with REST API and built-in MCP server.
MCP serverGitHub-verified authorLocal · Docker
71 day agoMIT
web-shooter
Fast, low-token web reader and focused crawler. Returns ranked passages, not whole pages.
MCP serverGitHub-verified authorLocal · Cargo
710 days agoApache-2.0
Webcake Landing
Build, validate, and persist Webcake landing-page source JSON: element schemas plus AI usage hints.
MCP serverGitHub-verified authorLocal · npm
79 days agoMIT
Aha.io
Search, read and update Aha.io ideas, features, epics, releases, goals and comments
MCP serverGitHub-verified authorLocal · npm
64 days agoMIT
HasData Web Scraping
Fetch any public web page through managed proxies, with optional JS rendering and extraction rules.
MCP serverVerified domain · hasdata.comLocal · npm
615 days agoMIT
io.github.jacksenechal/scan-mcp
MCP server for scanner discovery and batch capture via SANE
MCP serverGitHub-verified authorLocal · npm
618 days agoMIT
io.github.mysleekdesigns/crawlforge-mcp-server
Web scraping, crawling, deep research & autonomous extraction — 31 MCP tools, clean Markdown/JSON
MCP serverGitHub-verified authorLocal · npm
61 day agoMIT
io.github.ofershap/scraper
Web scraping MCP — extract clean markdown, links, and metadata from any URL.
MCP serverGitHub-verified authorLocal · npm
63 months agoMIT
Octocrawl
Pages, crawls and URL batches as clean Markdown and JSON for AI agents, with an Evidence Record.
MCP serverGitHub-verified authorLocal · npm
61 day agoAGPL-3.0
PreClick — An MCP-native URL preflight scanning service for autonomous agents (formerly URLCheck).
PreClick scans links for threats and confirms intent match with high accuracy before agents click.
MCP serverVerified domain · urlcheck.aiRemote● Live
67 months agoApache-2.0
Rendex: Rendering API for Images, PDFs & Content Extraction
Render HTML, Markdown, or URLs to images, PDF, or branded artifacts; extract and watch pages.
MCP serverGitHub-verified authorLocal · npm
66 days agoMIT
Reverse Engineer Anything (Docker)
REA reverse-engineering MCP server in Docker, with JADX, Apktool and adb for APKs.
MCP serverGitHub-verified authorLocal · Docker
63 days agoWTFPL
YouTube MCP
Interact with YouTube data via the official Data API v3
MCP serverGitHub-verified authorLocal · npm
63 months agoMIT
2Captcha MCP
Full 2Captcha API (43 tools) for Claude Code: 31 captcha solvers + management + webhook.
MCP serverGitHub-verified authorLocal · PyPI
53 months agoMIT
FaviconDL
Extract a website's favicon URL (any size 16-512) via the free FaviconDL API. No API key.
MCP serverGitHub-verified authorLocal · MCPB
51 day agoMIT
HasData Shopify
The public product catalogue and collections of any Shopify storefront, as structured JSON.
MCP serverVerified domain · hasdata.comLocal · npm
515 days agoMIT
HasData Walmart
Walmart search, product pages and customer reviews on walmart.com and walmart.ca, as JSON.
MCP serverVerified domain · hasdata.comLocal · npm
515 days agoMIT

Filters apply to the top 400 of 1,772 tools by stars. Full list for agents: web-scrape.json