fetch-url

渲染网页 URL,去噪提取正文并输出为 Markdown(默认)或其他格式/原始 HTML,以减少 Token。

25 stars

Best use case

fetch-url is best used when you need a repeatable AI agent workflow instead of a one-off prompt.

渲染网页 URL,去噪提取正文并输出为 Markdown(默认)或其他格式/原始 HTML,以减少 Token。

Teams using fetch-url should expect a more consistent output, faster repeated execution, less prompt rewriting.

When to use this skill

  • You want a reusable workflow that can be run more than once with consistent structure.

When not to use this skill

  • You only need a quick one-off answer and do not need a reusable workflow.
  • You cannot install or maintain the underlying files, dependencies, or repository context.

Installation

Claude Code / Cursor / Codex

$curl -o ~/.claude/skills/fetch-url/SKILL.md --create-dirs "https://raw.githubusercontent.com/ComeOnOliver/skillshub/main/skills/aiskillstore/marketplace/dcjanus/fetch-url/SKILL.md"

Manual Installation

  1. Download SKILL.md from GitHub
  2. Place it in .claude/skills/fetch-url/SKILL.md inside your project
  3. Restart your AI agent — it will auto-discover the skill

How fetch-url Compares

Feature / Agentfetch-urlStandard Approach
Platform SupportNot specifiedLimited / Varies
Context Awareness High Baseline
Installation ComplexityUnknownN/A

Frequently Asked Questions

What does this skill do?

渲染网页 URL,去噪提取正文并输出为 Markdown(默认)或其他格式/原始 HTML,以减少 Token。

Where can I find the source code?

You can find the source code on GitHub using the link provided at the top of the page.

SKILL.md Source

在当前文件所在目录运行:`./scripts/fetch_url.py URL`(仅支持 `http` / `https`)。  
说明:必须直接当作可执行文件执行。

默认自动探测本地 Chromium 系浏览器路径;未探测到时需安装 Playwright 浏览器:

```bash
uv run playwright install chromium
```

参数:
- `--output`:将输出写入文件(默认 stdout)。
- `--timeout-ms`:Playwright 导航超时(毫秒,默认 60000)。
- `--browser-path`:指定本地 Chromium 系浏览器路径(默认自动探测)。
- `--output-format`:输出格式(默认 `markdown`),支持 `csv`、`html`、`json`、`markdown`、`raw-html`、`txt`、`xml`、`xmltei`;`raw-html` 直接输出渲染后的 HTML(不经 trafilatura)。

示例:

```bash
./scripts/fetch_url.py https://example.com --output ./page.md --timeout-ms 60000
```

Reference:[`scripts/fetch_url.py`](scripts/fetch_url.py)

Related Skills

defold-examples-fetch

25
from ComeOnOliver/skillshub

Fetches Defold code examples by topic. Use when looking for practical implementation patterns, sample code, or how to do something specific in Defold.

defold-docs-fetch

25
from ComeOnOliver/skillshub

Fetches Defold manuals and documentation. Use when looking up how Defold features work, understanding concepts, components, workflows, platform setup, or needing guidance beyond API reference.

fetching-dbt-docs

25
from ComeOnOliver/skillshub

Retrieves and searches dbt documentation pages in LLM-friendly markdown format. Use when fetching dbt documentation, looking up dbt features, or answering questions about dbt Cloud, dbt Core, or the dbt Semantic Layer.

native-data-fetching

25
from ComeOnOliver/skillshub

Use when implementing or debugging ANY network request, API call, or data fetching. Covers fetch API, axios, React Query, SWR, error handling, caching strategies, offline support.

fetching-library-docs

25
from ComeOnOliver/skillshub

Token-efficient library API documentation fetcher using Context7 MCP with 77% token savings. Fetches code examples, API references, and usage patterns for published libraries (React, Next.js, Prisma, etc). Use when users ask "how do I use X library", need code examples, want API syntax, or are learning a framework's official API. Triggers: "Show me React hooks", "Prisma query syntax", "Next.js routing API". NOT for exploring repo internals/source code (use researching-with-deepwiki) or local files.

web-fetch

25
from ComeOnOliver/skillshub

Fetches web content with intelligent content extraction, converting HTML to clean markdown. Use for documentation, articles, and reference pages http/https URLs.

DuckDuckGo Search via web_fetch

25
from ComeOnOliver/skillshub

Search the web using DuckDuckGo Lite's HTML interface, parsed via `web_fetch`. No API key or package install required.

Scrapling Web Fetch

25
from ComeOnOliver/skillshub

当用户要获取网页内容、正文提取、把网页转成 markdown/text、抓取文章主体时,优先使用此技能。

nextjs-data-fetching

25
from ComeOnOliver/skillshub

Fetch API, Caching, and Revalidation strategies. Use when fetching data, configuring cache behavior, or implementing revalidation in Next.js. (triggers: **/*.tsx, **/service.ts, fetch, revalidate, no-store, force-cache)

langsmith-fetch

25
from ComeOnOliver/skillshub

Debug LangChain and LangGraph agents by fetching execution traces from LangSmith Studio. Use when debugging agent behavior, investigating errors, analyzing tool calls, checking memory operations, or examining agent performance. Automatically fetches recent traces and analyzes execution patterns. Requires langsmith-fetch CLI installed.

brandfetch-automation

25
from ComeOnOliver/skillshub

Automate Brandfetch tasks via Rube MCP (Composio). Always search tools first for current schemas.

coreweave-local-dev-loop

25
from ComeOnOliver/skillshub

Set up local development workflow for CoreWeave GPU deployments. Use when building containers locally, testing YAML manifests, or iterating on model serving configurations before deploying. Trigger with phrases like "coreweave dev setup", "coreweave local testing", "develop for coreweave", "coreweave container build".