fetch

Public web retrieval and clean extraction engine. Use whenever the user wants to fetch, download, inspect, clean, or save content from a public URL. Supports safe fetching of public web pages, extracts title/text/links, stores results locally, and keeps a job history. No credentials, no login flows, no cloud sync.

3,880 stars

byopenclaw

View on GitHub Installation ↓

Best use case

fetch is best used when you need a repeatable AI agent workflow instead of a one-off prompt.

Teams using fetch should expect a more consistent output, faster repeated execution, less prompt rewriting.

When to use this skill

You want a reusable workflow that can be run more than once with consistent structure.

When not to use this skill

You only need a quick one-off answer and do not need a reusable workflow.
You cannot install or maintain the underlying files, dependencies, or repository context.

Installation

Claude Code / Cursor / Codex

$curl -o ~/.claude/skills/fetch/SKILL.md --create-dirs "https://raw.githubusercontent.com/openclaw/skills/main/skills/agistack/fetch/SKILL.md"

Manual Installation

Download SKILL.md from GitHub
Place it in .claude/skills/fetch/SKILL.md inside your project
Restart your AI agent — it will auto-discover the skill

How fetch Compares

Feature / Agent	fetch	Standard Approach
Platform Support	Not specified	Limited / Varies
Context Awareness	High	Baseline
Installation Complexity	Unknown	N/A

Frequently Asked Questions

What does this skill do?

Where can I find the source code?

You can find the source code on GitHub using the link provided at the top of the page.

Related Guides

AI Agents for Marketing

Discover AI agents for marketing workflows, from SEO and content production to campaign research, outreach, and analytics.

Best AI Agents for Marketing

A curated list of the best AI agents and skills for marketing teams focused on SEO, content systems, outreach, and campaign execution.

Best AI Skills for ChatGPT

Find the best AI skills to adapt into ChatGPT workflows for research, writing, summarization, planning, and repeatable assistant tasks.

SKILL.md Source

# Fetch

Turn public URLs into usable local content.

## Core Philosophy
1. Fetch only public web content.
2. Prefer clean extracted text over noisy raw HTML.
3. Save both the raw response and structured extraction locally.
4. Keep a simple local job history so previous fetches are easy to inspect.

## Runtime Requirements
- Python 3 must be available as `python3`
- No external packages required

## Safety Boundaries
- Public URLs only
- No login flows
- No cookies or browser automation
- No API keys or credentials
- No external uploads or cloud sync
- All fetched data is stored locally only

## Local Storage
All data is stored under:
- `~/.openclaw/workspace/memory/fetch/jobs.json`
- `~/.openclaw/workspace/memory/fetch/pages/`

## Key Workflows
- **Fetch URL**: `fetch_url.py --url "https://example.com"`
- **Save cleaned output**: `save_output.py --url "https://example.com" --title "Example"`
- **List history**: `list_jobs.py`
- **Show job details**: `show_job.py --id JOB-XXXX`

## Scripts
| Script | Purpose |
|---|---|
| `init_storage.py` | Initialize local storage |
| `fetch_url.py` | Fetch a public URL and extract content |
| `save_output.py` | Save cleaned output with a custom title |
| `list_jobs.py` | List previous fetch jobs |
| `show_job.py` | Show one saved fetch job |

Related Skills

solax-summary-fetch

3891

from openclaw/skills

Fetch inverter summary data from the Solax Cloud API using the npm package solax-cloud-api. Use when the user provides (or has configured) a Solax tokenId and inverter serial number (sn) and wants current/summary energy data returned as JSON (typed as SolaxSummary) for dashboards/automation.

web-fetcher

3891

from openclaw/skills

Fetch web pages and extract readable content for AI use. Use when reading, summarizing, or crawling a specific URL or small set of URLs. Prefer low-friction URL-to-Markdown services first, then fall back to browser-based retrieval, search snippets, or cached/indexed copies when sites are protected by Cloudflare or similar bot checks.

fetch-archive-to-lexiang

3891

from openclaw/skills

通用文章抓取与归档工具。抓取任意 URL（免费/付费/登录墙）的文章全文，转换为结构化 Markdown，并可选转存到乐享知识库。支持 Substack、Medium、知识星球等付费平台的登录态管理。支持 YouTube 视频下载（yt-dlp）、播客音频下载（小宇宙FM等）、音频转录（Whisper）、翻译（中英对照格式），并将音视频和文字稿上传乐享知识库（文字稿使用在线文档格式，支持按块编辑）。关键词触发：抓取文章、获取全文、付费文章、转存知识库、乐享、保存原文、fetch article、归档、YouTube、视频转录、字幕提取、视频下载、播客、podcast、小宇宙、xiaoyuzhou。

ClawFeed Digest Fetcher

3891

from openclaw/skills

> 抓取 ClawFeed AI 新闻简报，写入 Obsidian 知识库

WeChat Article Fetcher - 微信文章抓取技能

3891

from openclaw/skills

微信公众号文章链接处理。当用户发送微信公众号文章链接时，自动获取并提取文章内容。触发条件：(1) 用户发送 http(s)://mp.weixin.qq.com/s/ 开头的链接 (2) 用户请求获取公众号文章内容

Binance Event Contract Full Data Fetcher

3891

from openclaw/skills

## 1. Scenario Definition

---

3891

from openclaw/skills

name: article-factory-wechat

Content & Documentation

humanizer

3891

from openclaw/skills

Remove signs of AI-generated writing from text. Use when editing or reviewing text to make it sound more natural and human-written. Based on Wikipedia's comprehensive "Signs of AI writing" guide. Detects and fixes patterns including: inflated symbolism, promotional language, superficial -ing analyses, vague attributions, em dash overuse, rule of three, AI vocabulary words, negative parallelisms, and excessive conjunctive phrases.

Content & Documentation

find-skills

3891

from openclaw/skills

Helps users discover and install agent skills when they ask questions like "how do I do X", "find a skill for X", "is there a skill that can...", or express interest in extending capabilities. This skill should be used when the user is looking for functionality that might exist as an installable skill.

General Utilities

tavily-search

3891

from openclaw/skills

Use Tavily API for real-time web search and content extraction. Use when: user needs real-time web search results, research, or current information from the web. Requires Tavily API key.

Data & Research