product-hunt-scraper

Scrape Product Hunt trending products using Apify. Use when you need to discover new product launches, track competitors on Product Hunt, or monitor the startup ecosystem for relevant launches.

380 stars

Best use case

product-hunt-scraper is best used when you need a repeatable AI agent workflow instead of a one-off prompt.

Scrape Product Hunt trending products using Apify. Use when you need to discover new product launches, track competitors on Product Hunt, or monitor the startup ecosystem for relevant launches.

Teams using product-hunt-scraper should expect a more consistent output, faster repeated execution, less prompt rewriting.

When to use this skill

  • You want a reusable workflow that can be run more than once with consistent structure.

When not to use this skill

  • You only need a quick one-off answer and do not need a reusable workflow.
  • You cannot install or maintain the underlying files, dependencies, or repository context.

Installation

Claude Code / Cursor / Codex

$curl -o ~/.claude/skills/product-hunt-scraper/SKILL.md --create-dirs "https://raw.githubusercontent.com/gooseworks-ai/goose-skills/main/skills/capabilities/product-hunt-scraper/SKILL.md"

Manual Installation

  1. Download SKILL.md from GitHub
  2. Place it in .claude/skills/product-hunt-scraper/SKILL.md inside your project
  3. Restart your AI agent — it will auto-discover the skill

How product-hunt-scraper Compares

Feature / Agentproduct-hunt-scraperStandard Approach
Platform SupportNot specifiedLimited / Varies
Context Awareness High Baseline
Installation ComplexityUnknownN/A

Frequently Asked Questions

What does this skill do?

Scrape Product Hunt trending products using Apify. Use when you need to discover new product launches, track competitors on Product Hunt, or monitor the startup ecosystem for relevant launches.

Where can I find the source code?

You can find the source code on GitHub using the link provided at the top of the page.

Related Guides

SKILL.md Source

# Product Hunt Scraper

Scrape trending products from Product Hunt using the Apify `maximedupre/product-hunt-scraper` actor.

**Output fields:** Each product has `name`, `tagline`, `description`, `url` (Product Hunt URL), and additional fields depending on the actor's output.

## Quick Start

Requires `APIFY_API_TOKEN` env var (or `--token` flag).

```bash
# Today's top products
python3 skills/product-hunt-scraper/scripts/scrape_producthunt.py \
  --time-period daily --max-products 10 --output summary

# This week's products filtered by keyword
python3 skills/product-hunt-scraper/scripts/scrape_producthunt.py \
  --time-period weekly --keywords "AI,marketing" --output summary

# Monthly top products as JSON
python3 skills/product-hunt-scraper/scripts/scrape_producthunt.py \
  --time-period monthly --max-products 50
```

## CLI Reference

| Flag | Default | Description |
|------|---------|-------------|
| `--time-period` | weekly | `daily`, `weekly`, or `monthly` |
| `--max-products` | 50 | Max products to scrape |
| `--keywords` | none | Keywords to filter (comma-separated, OR logic) |
| `--output` | json | Output format: `json` or `summary` |
| `--token` | env var | Apify token (prefer `APIFY_API_TOKEN` env var) |
| `--timeout` | 300 | Max seconds to wait for the Apify run |

## Notes

- Keyword filtering is client-side on product name + tagline + description
- Results are sorted by upvote count (descending)

Related Skills

twitter-scraper

381
from gooseworks-ai/goose-skills

Search and scrape Twitter/X posts using Apify. Use when you need to find tweets, track brand mentions, monitor competitors on Twitter, or analyze Twitter discussions. Uses Twitter native search syntax (since:/until:) for reliable date filtering.

review-scraper

381
from gooseworks-ai/goose-skills

Scrape product reviews from G2, Capterra, and Trustpilot using Apify. Single script with platform dispatch. Use when you need to monitor competitor reviews, track product sentiment, or gather customer feedback from review sites.

reddit-scraper

381
from gooseworks-ai/goose-skills

Scrape and search Reddit posts using Apify. Use when you need to find Reddit discussions, track competitor mentions, monitor product feedback, discover pain points, or analyze subreddit content. Supports keyword filtering, time-based searches, and subreddit-specific queries.

meta-ad-scraper

381
from gooseworks-ai/goose-skills

Scrape competitor ads from Meta's Ad Library (Facebook, Instagram, Messenger, Threads, WhatsApp). Search by company name, Facebook Page URL, or keyword. Returns ad creatives, spend estimates, reach, impressions, and campaign details. Use for competitive ad research, messaging analysis, and creative inspiration.

blog-scraper

381
from gooseworks-ai/goose-skills

Scrape blog posts via RSS feeds (free, no API key) with Apify fallback for JS-heavy sites. Use when you need to monitor competitor blogs, track industry content, or aggregate blog posts by keyword.

web-archive-scraper

380
from gooseworks-ai/goose-skills

Search the Wayback Machine for archived versions of websites. Extract cached pages, customer lists, testimonials, and partner directories from sites that have changed or gone offline. Uses the free CDX API — no API key needed.

review-site-scraper

380
from gooseworks-ai/goose-skills

Scrape product reviews from G2, Capterra, and Trustpilot using Apify. Single script with platform dispatch. Use when you need to monitor competitor reviews, track product sentiment, or gather customer feedback from review sites.

orthogonal-linkedin-scraper

380
from gooseworks-ai/goose-skills

Get LinkedIn profiles, company pages, and posts

orthogonal-hunter

380
from gooseworks-ai/goose-skills

Email finder and verifier - find emails, verify deliverability, discover companies

linkedin-profile-post-scraper

380
from gooseworks-ai/goose-skills

Scrape recent posts from LinkedIn profiles using Apify. Use when you need to monitor what specific people are posting on LinkedIn, track founder/exec activity, or gather LinkedIn content for competitive intelligence.

linkedin-job-scraper

380
from gooseworks-ai/goose-skills

Scrapes LinkedIn job postings using the JobSpy library (python-jobspy). Use this skill whenever the user wants to find jobs on LinkedIn, search for open roles, pull job listings, build a job pipeline, source job targets for GTM research, or monitor hiring signals. Even if the user just says "find me some jobs" or "what roles is [company] hiring for", use this skill. It runs a local Python script that outputs a CSV of job postings with title, company, location, salary, job type, description, and direct URLs.

job-scraper

380
from gooseworks-ai/goose-skills

Search for job postings across LinkedIn and Indeed. Use when users want to find open roles, monitor hiring signals, identify companies hiring for specific positions, or research competitor hiring activity. Returns job title, company, location, salary, description, seniority level, and direct apply URLs. No login or cookies required.