firecrawl-crawl
Crawl an entire website and extract content.
Best use case
firecrawl-crawl is best used when you need a repeatable AI agent workflow instead of a one-off prompt.
Crawl an entire website and extract content.
Teams using firecrawl-crawl should expect a more consistent output, faster repeated execution, less prompt rewriting.
When to use this skill
- You want a reusable workflow that can be run more than once with consistent structure.
When not to use this skill
- You only need a quick one-off answer and do not need a reusable workflow.
- You cannot install or maintain the underlying files, dependencies, or repository context.
Installation
Claude Code / Cursor / Codex
Manual Installation
- Download SKILL.md from GitHub
- Place it in
.claude/skills/firecrawl-crawl/SKILL.mdinside your project - Restart your AI agent — it will auto-discover the skill
How firecrawl-crawl Compares
| Feature / Agent | firecrawl-crawl | Standard Approach |
|---|---|---|
| Platform Support | Not specified | Limited / Varies |
| Context Awareness | High | Baseline |
| Installation Complexity | Unknown | N/A |
Frequently Asked Questions
What does this skill do?
Crawl an entire website and extract content.
Where can I find the source code?
You can find the source code on GitHub using the link provided at the top of the page.
SKILL.md Source
# firecrawl-crawl Crawl an entire website and extract content.
Related Skills
firecrawl-scrape
Scrape and parse a web page into structured markdown.
zendesk-reply
Add a reply to an existing Zendesk ticket.
zendesk-list-tickets
List open support tickets from Zendesk.
zendesk-create-ticket
Create a new support ticket in Zendesk.
youtube-upload
Upload a video to YouTube.
youtube-fetch
Fetch video metadata from YouTube Data API.
youtube-dl
Download audio from a YouTube video using yt-dlp.
xero-report
Fetch a financial report from Xero.
wordpress-publish
Publish a new blog post on WordPress.
woocommerce-list-orders
List recent orders from a WooCommerce store.
wise-convert
Get exchange rates and convert currency via Wise.
wikipedia-search
Fetch article summaries from Wikipedia.