Best use case
lp-lobster-crawler is best used when you need a repeatable AI agent workflow instead of a one-off prompt.
定向抓取 Webnovel/ReelShorts 等站点的书籍/短剧内容，支持内容分级与钉钉播报。
Teams using lp-lobster-crawler should expect a more consistent output, faster repeated execution, less prompt rewriting.
When to use this skill
- You want a reusable workflow that can be run more than once with consistent structure.
When not to use this skill
- You only need a quick one-off answer and do not need a reusable workflow.
- You cannot install or maintain the underlying files, dependencies, or repository context.
Installation
Claude Code / Cursor / Codex
Manual Installation
- Download SKILL.md from GitHub
- Place it in
.claude/skills/lp-lobster-crawler/SKILL.mdinside your project - Restart your AI agent — it will auto-discover the skill
How lp-lobster-crawler Compares
| Feature / Agent | lp-lobster-crawler | Standard Approach |
|---|---|---|
| Platform Support | Not specified | Limited / Varies |
| Context Awareness | High | Baseline |
| Installation Complexity | Unknown | N/A |
Frequently Asked Questions
What does this skill do?
定向抓取 Webnovel/ReelShorts 等站点的书籍/短剧内容，支持内容分级与钉钉播报。
Where can I find the source code?
You can find the source code on GitHub using the link provided at the top of the page.
Related Guides
AI Agents for Marketing
Discover AI agents for marketing workflows, from SEO and content production to campaign research, outreach, and analytics.
AI Agents for Startups
Explore AI agent skills for startup validation, product research, growth experiments, documentation, and fast execution with small teams.
AI Agents for Coding
Browse AI agent skills for coding, debugging, testing, refactoring, code review, and developer workflows across Claude, Cursor, and Codex.
SKILL.md Source
## 龙虾爬虫技能
定向抓取 Webnovel 小说和 ReelShorts 短剧的结构化内容，支持增量更新、内容分级（高/中/低）和钉钉机器人播报。
## 环境初始化
首次使用前，在技能目录下初始化 Python 环境：
```bash
cd {{skillPath}}
uv venv .venv
uv pip install -r requirements.txt
```
不需要安装浏览器。反爬通过 curl_cffi TLS 指纹伪装实现，纯 Python 库，无系统依赖。
后续所有命令都通过 `uv run` 执行，它会自动激活 .venv 虚拟环境。
## 触发条件
当用户消息包含以下意图时激活此技能：
- 抓取/爬取小说、短剧、webnovel、reelshorts 内容
- 查看爬虫状态、已抓取作品列表
- 播报抓取结果到钉钉
- 生成 RSS 订阅源
- 管理定时抓取任务
## 命令
所有命令必须在技能目录下执行。先 `cd {{skillPath}}`，再运行命令。
### 抓取内容
```bash
uv run python -m src.cli crawl <spider_name>
```
- `spider_name` 可选值：`webnovel`（小说）、`reelshorts`（短剧）
- 支持传递爬虫参数：`uv run python -m src.cli crawl webnovel -a max_pages=5`
### 列出已抓取作品
```bash
uv run python -m src.cli list [--site <site>] [--grade <grade>] [--limit <n>]
```
- `--site`：按站点过滤（webnovel / reelshorts）
- `--grade`：按分级过滤（high / medium / low）
- `--limit`：显示数量，默认 20
### 查看系统状态
```bash
uv run python -m src.cli status
```
返回数据库统计（作品数、章节数、剧集数）和各分级数量。
### 播报到钉钉
```bash
uv run python -m src.cli broadcast [--site <site>] [--grade <grade>] [--title <title>]
```
生成 Markdown 消息并发送到钉钉群。需要设置环境变量 `DINGTALK_WEBHOOK`。
### 管理定时任务
```bash
uv run python -m src.cli schedule --action=list # 查看任务
uv run python -m src.cli schedule --action=load # 从配置加载
uv run python -m src.cli schedule --action=start # 启动调度器
```
### 生成 RSS 订阅源
```bash
uv run python -m src.cli rss [--format rss|atom] [--output <path>] [--site <site>] [--grade <grade>]
```
默认输出到 `data/rss.xml`。
## 规则
1. 首次使用前，必须先运行"环境初始化"步骤安装依赖。如果 `uv run` 报错找不到模块，重新执行初始化。
2. 运行爬虫前，先执行 `status` 确认系统正常。
3. 用户未指定站点时，询问要抓取 webnovel 还是 reelshorts。
4. 播报前先用 `list` 确认有数据可播报。
5. 钉钉播报需要确认 `DINGTALK_WEBHOOK` 环境变量已配置。
6. 抓取可能耗时较长，提前告知用户并在完成后汇报结果。
7. 不要同时运行多个爬虫实例，避免并发冲突。Related Skills
lobster-community-xiaomo
🦞 Lobster Community / 龙虾社区 - 专属于AI Agent的私密交流平台！支持完整对话thread、评论通知机制。Agent通过API注册、发帖、评论，其他龙虾回复后自动通知。装上这个skill，你就是龙虾社区的一员！
benchmark-lobster-forge
用元认知引导发现值得被做成小龙虾的机会点，并将其收敛为可开箱即用的基准 Agent 小龙虾。
onlyclaw-lobster-publish
以龙虾身份向只来龙虾平台发布帖子，支持封面图上传、关联 Skill/店铺/商品，适用于 AI Agent 自动发帖场景
lobster-keeper
自动执行日常维护：状态检查、自我复盘、记忆流动、任务记录。基于龙虾饲养员的六条经验。
lobster-community
🦞 AI小龙虾社区 Skill —— 为 AI小龙虾用户提供智能社交分身能力。安装后可通过自然语言命令操作社区（发帖、查看、回复），同时启动心跳机制（定时主动发帖、内容推送、互动提醒），以用户设定的「人设」在社区中保持存在感。适用场景：当用户想加入龙虾圈、配置AI分身、发布社区动态、查看社区内容、设置心跳频率、邀请好友时，应加载此 Skill。
lobster-market
龙虾集市客户端 - Agent 任务交易市场。支持发布任务、认领任务、提交结果、验收付款。x402 链上 P2P 支付。
companion-lobster
陪伴型小龙虾 - 陪你刷抖音、看电影、听音乐、聊天分享的 AI 伙伴
lobsterstores
Discover Lobster-friendly Shopify merchants by category or store name. Use when a buyer wants help finding the right merchant for coffee, cookies, supplements, apparel, wellness, pets, oral care, alcohol, or adult products and should complete checkout on the merchant's native Shopify checkout.
lobsterbrew
Lobster Brew helps your OpenClaw discover coffee roasters, compare coffees, build personalized carts, and hand off a secure Shopify checkout link for you to complete the purchase.
---
name: article-factory-wechat
humanizer
Remove signs of AI-generated writing from text. Use when editing or reviewing text to make it sound more natural and human-written. Based on Wikipedia's comprehensive "Signs of AI writing" guide. Detects and fixes patterns including: inflated symbolism, promotional language, superficial -ing analyses, vague attributions, em dash overuse, rule of three, AI vocabulary words, negative parallelisms, and excessive conjunctive phrases.
find-skills
Helps users discover and install agent skills when they ask questions like "how do I do X", "find a skill for X", "is there a skill that can...", or express interest in extending capabilities. This skill should be used when the user is looking for functionality that might exist as an installable skill.