web-scout
给 AI Agent 一键装上全网采集能力。基于 Agent Reach,支持 Twitter/X、Reddit、YouTube、B站、小红书、抖音、GitHub、LinkedIn、Boss直聘、RSS、全网搜索等平台。一条命令安装,零 API 费用。
Best use case
web-scout is best used when you need a repeatable AI agent workflow instead of a one-off prompt.
给 AI Agent 一键装上全网采集能力。基于 Agent Reach,支持 Twitter/X、Reddit、YouTube、B站、小红书、抖音、GitHub、LinkedIn、Boss直聘、RSS、全网搜索等平台。一条命令安装,零 API 费用。
Teams using web-scout should expect a more consistent output, faster repeated execution, less prompt rewriting.
When to use this skill
- You want a reusable workflow that can be run more than once with consistent structure.
When not to use this skill
- You only need a quick one-off answer and do not need a reusable workflow.
- You cannot install or maintain the underlying files, dependencies, or repository context.
Installation
Claude Code / Cursor / Codex
Manual Installation
- Download SKILL.md from GitHub
- Place it in
.claude/skills/web-scout/SKILL.mdinside your project - Restart your AI agent — it will auto-discover the skill
How web-scout Compares
| Feature / Agent | web-scout | Standard Approach |
|---|---|---|
| Platform Support | Not specified | Limited / Varies |
| Context Awareness | High | Baseline |
| Installation Complexity | Unknown | N/A |
Frequently Asked Questions
What does this skill do?
给 AI Agent 一键装上全网采集能力。基于 Agent Reach,支持 Twitter/X、Reddit、YouTube、B站、小红书、抖音、GitHub、LinkedIn、Boss直聘、RSS、全网搜索等平台。一条命令安装,零 API 费用。
Where can I find the source code?
You can find the source code on GitHub using the link provided at the top of the page.
Related Guides
AI Agents for Marketing
Discover AI agents for marketing workflows, from SEO and content production to campaign research, outreach, and analytics.
Best AI Skills for Claude
Explore the best AI skills for Claude and Claude Code across coding, research, workflow automation, documentation, and agent operations.
AI Agent for YouTube Script Writing
Find AI agent skills for YouTube script writing, video research, content outlining, and repeatable channel production workflows.
SKILL.md Source
# Web Scout — AI Agent 全网采集工具箱
基于 [Agent Reach](https://github.com/Panniantong/Agent-Reach) 封装,让你的 AI Agent 一键获得全网信息采集能力。
## 支持平台
| 平台 | 工具 | 免费 | 需要配置 |
|------|------|------|---------|
| 🌐 网页 | Jina Reader | ✅ | 无 |
| 📺 YouTube | yt-dlp | ✅ | 无 |
| 📺 B站 | yt-dlp | ✅ | 服务器需代理 |
| 📡 RSS | feedparser | ✅ | 无 |
| 🔍 全网搜索 | Exa (MCP) | ✅ | 自动配置 |
| 📦 GitHub | gh CLI | ✅ | 需登录 |
| 🐦 Twitter/X | xreach (bird) | ✅ | 需 Cookie |
| 📖 Reddit | JSON API + Exa | ✅ | 服务器需代理 |
| 📕 小红书 | xiaohongshu-mcp | ✅ | 需 Docker + Cookie |
| 🎵 抖音 | douyin-mcp-server | ✅ | 需 MCP 服务 |
| 💼 LinkedIn | linkedin-mcp | ✅ | 需浏览器登录 |
| 🏢 Boss直聘 | mcp-bosszp | ✅ | 需扫码登录 |
## 安装
### 第一步:安装 Agent Reach CLI
```bash
pip install https://github.com/Panniantong/agent-reach/archive/main.zip
```
### 第二步:自动安装依赖
默认模式(自动安装所有依赖):
```bash
agent-reach install --env=auto
```
安全模式(只检查不安装,适合生产环境):
```bash
agent-reach install --env=auto --safe
```
预览模式(只看会做什么):
```bash
agent-reach install --env=auto --dry-run
```
### 第三步:检查状态
```bash
agent-reach doctor
```
### 第四步:按需配置平台
需要 Cookie 的平台建议使用小号,避免封号风险。
Cookie 导出方法:浏览器登录平台 → 安装 [Cookie-Editor](https://chromewebstore.google.com/detail/cookie-editor/hlkenndednhfkekhgcdicdfddnkalmdm) 插件 → Export → Header String → 发给 Agent。
配置 Twitter:
```bash
agent-reach configure twitter-cookies "COOKIE_STRING"
```
配置代理(服务器访问 Reddit/B站):
```bash
agent-reach configure proxy http://user:pass@ip:port
```
配置小红书(需要 Docker):
```bash
docker run -d --name xiaohongshu-mcp -p 18060:18060 xpzouying/xiaohongshu-mcp
mcporter config add xiaohongshu http://localhost:18060/mcp
```
## 常用命令速查
### 读网页
```bash
curl -s "https://r.jina.ai/URL"
```
### 搜索 Twitter/X
```bash
xreach search "关键词" --json
```
### YouTube/B站 字幕提取
```bash
yt-dlp --dump-json "VIDEO_URL" # 视频信息
yt-dlp --write-sub --skip-download "URL" # 提取字幕
```
### 全网搜索(Exa)
```bash
mcporter call 'exa.search(query: "关键词", numResults: 10)'
```
### GitHub
```bash
gh repo view owner/repo # 查看仓库
gh search repos "关键词" # 搜索仓库
gh issue list -R owner/repo # 查看 Issue
```
### RSS
```bash
python3 -c "import feedparser; f=feedparser.parse('RSS_URL'); [print(e.title) for e in f.entries[:10]]"
```
### 小红书
```bash
mcporter call 'xiaohongshu.search_feeds(keyword: "关键词")'
mcporter call 'xiaohongshu.get_feed_detail(note_id: "ID")'
```
### 抖音
```bash
mcporter call 'douyin.parse_douyin_video_info(share_link: "分享链接")'
```
### Reddit
```bash
mcporter call 'exa.search(query: "site:reddit.com 关键词")'
```
## 维护
检查更新:
```bash
agent-reach check-update
```
升级:
```bash
pip install --upgrade https://github.com/Panniantong/agent-reach/archive/main.zip
```
健康检查(适合定时任务):
```bash
agent-reach watch
```
卸载:
```bash
agent-reach uninstall # 完整卸载
agent-reach uninstall --keep-config # 保留配置
pip uninstall agent-reach # 卸载 Python 包
```
## 安全说明
- Cookie 只存本地 `~/.agent-reach/config.yaml`,文件权限 600
- 代码完全开源,可审查
- 需要 Cookie 的平台(Twitter、小红书)建议用小号
- 支持 `--safe` 和 `--dry-run` 模式
## 致谢
基于 [Agent Reach](https://github.com/Panniantong/Agent-Reach) by Panniantong,MIT 协议。Related Skills
talent-scout
Steal your competitors' best people — scrape LinkedIn, AI-rank candidates, and generate personalized outreach DMs in one command
opportunity-scout
Find profitable business opportunities in any niche by scanning Twitter, web, Reddit, and Product Hunt for unmet needs and pain points. Scores each opportunity on Demand, Competition, Feasibility, and Monetization (1-5 each, max 20). Generates a ranked report with actionable recommendations. Use when asked to find business ideas, market gaps, product opportunities, or "what should I build" questions. Also triggers on: market research, niche analysis, opportunity hunting, trend scouting, competitive analysis for new products.
agentscout
Discover trending AI Agent projects on GitHub, auto-generate Xiaohongshu (Little Red Book) publish-ready content including tutorials, copywriting, and cover images.
blockscout-analysis
MANDATORY — invoke this skill BEFORE making any Blockscout MCP tool calls or writing any blockchain data scripts, even when the Blockscout MCP server is already configured. Provides architectural rules, execution-strategy decisions, MCP REST API conventions for scripts, endpoint reference files, response transformation requirements, and output conventions that are not available from MCP tool descriptions alone. Use when the user asks about on-chain data, blockchain analysis, wallet balances, token transfers, contract interactions, on-chain metrics, wants to use the Blockscout API, or needs to build software that retrieves blockchain data via Blockscout. Covers all EVM chains.
outreach-scout
Find and engage warm leads on Reddit, X/Twitter, and forums. Monitors platforms for people asking questions your product solves, drafts helpful replies that naturally mention your offering, and tracks all activity. Use when you need marketing, lead generation, audience building, finding potential customers, or growing product awareness. Works with heartbeats for automated daily scouting.
grant-funding-scout
NIH funding trend analysis to identify high-priority research areas
emerging-topic-scout
Monitor bioRxiv/medRxiv preprints and academic discussions to identify emerging research hotspots before they appear in mainstream journals
ai-topic-scout
AI短视频选题追踪系统。自动抓取指定YouTube博主视频和Twitter博主推文,分析内容,聚合跨平台热点主题,生成带热度评分和选题建议的分析报告,结果写入钉钉AI表格。适用于:定时抓取AI领域博主内容、分析短视频选题热度、跨平台话题聚合、生成选题建议。触发词:"抓取选题"、"分析选题"、"选题scout"、"topic scout"、"抓取博主内容"、"选题分析"。
---
name: article-factory-wechat
humanizer
Remove signs of AI-generated writing from text. Use when editing or reviewing text to make it sound more natural and human-written. Based on Wikipedia's comprehensive "Signs of AI writing" guide. Detects and fixes patterns including: inflated symbolism, promotional language, superficial -ing analyses, vague attributions, em dash overuse, rule of three, AI vocabulary words, negative parallelisms, and excessive conjunctive phrases.
find-skills
Helps users discover and install agent skills when they ask questions like "how do I do X", "find a skill for X", "is there a skill that can...", or express interest in extending capabilities. This skill should be used when the user is looking for functionality that might exist as an installable skill.
tavily-search
Use Tavily API for real-time web search and content extraction. Use when: user needs real-time web search results, research, or current information from the web. Requires Tavily API key.