notion-hf-curator

End-to-end Notion-to-Hugging Face dataset and model curation workflow for SCBE repositories (export, QA, comparison, GitHub Actions, publishing).

6 stars

Best use case

notion-hf-curator is best used when you need a repeatable AI agent workflow instead of a one-off prompt.

End-to-end Notion-to-Hugging Face dataset and model curation workflow for SCBE repositories (export, QA, comparison, GitHub Actions, publishing).

Teams using notion-hf-curator should expect a more consistent output, faster repeated execution, less prompt rewriting.

When to use this skill

  • You want a reusable workflow that can be run more than once with consistent structure.

When not to use this skill

  • You only need a quick one-off answer and do not need a reusable workflow.
  • You cannot install or maintain the underlying files, dependencies, or repository context.

Installation

Claude Code / Cursor / Codex

$curl -o ~/.claude/skills/notion-hf-curator/SKILL.md --create-dirs "https://raw.githubusercontent.com/issdandavis/SCBE-AETHERMOORE/main/external/codex-skills-live/notion-hf-curator/SKILL.md"

Manual Installation

  1. Download SKILL.md from GitHub
  2. Place it in .claude/skills/notion-hf-curator/SKILL.md inside your project
  3. Restart your AI agent — it will auto-discover the skill

How notion-hf-curator Compares

Feature / Agentnotion-hf-curatorStandard Approach
Platform SupportNot specifiedLimited / Varies
Context Awareness High Baseline
Installation ComplexityUnknownN/A

Frequently Asked Questions

What does this skill do?

End-to-end Notion-to-Hugging Face dataset and model curation workflow for SCBE repositories (export, QA, comparison, GitHub Actions, publishing).

Where can I find the source code?

You can find the source code on GitHub using the link provided at the top of the page.

SKILL.md Source

# Notion-to-HF Curator

Use when a user asks to turn Notion content into an AI-ready dataset and sync to Hugging Face.

## Prereqs

- `NOTION_TOKEN` or `NOTION_API_KEY` (Notion integration token).
- `HF_TOKEN` and `HF` CLI installed (for publishing/validation).
- In a clone of `SCBE-AETHERMOORE`, run from repository root.

## Pipeline workflow

1. Export Notion pages to dataset JSONL.
   - `python scripts/notion_to_dataset.py --category all --output training-data/`
   - Output files include `training-data/notion_export_<cat>_<yyyymmdd>.jsonl` and `training-data/metadata.json`.

2. Push dataset to Hugging Face.
   - `python scripts/push_to_hf.py --data-path training-data/notion_export_all_$(Get-Date -Format yyyyMMdd).jsonl --repo-id <owner>/scbe-aethermoore-training-data --token $env:HF_TOKEN`
   - For repository-level updates, use `HF_TOKEN` or pass `hf upload` directly.

3. Run pipeline health checks.
   - `python scripts/notion_pipeline_gap_review.py --output artifacts/notion_pipeline_gap_review.json --summary-path artifacts/notion_pipeline_gap_review.md`
   - `python scripts/compare_notion_to_codebase.py --notion-jsonl training-data/notion_raw_clean.jsonl`

4. Trigger GitHub Actions for repeatable runs.
   - `gh workflow run notion-to-dataset`
   - `gh workflow run cloud-kernel-data-pipeline -f ship_targets=hf,github`

5. Optional browser validation (Playwright).
   - Open target HF dataset/model pages and verify cards/metadata before/after publish.

## Notes

- If dataset export records are 0, check Notion token scope and `scripts/sync-config.json` entries.
- Use `artifacts/notion_pipeline_gap_review.json` and `.md` for the highest-priority remediation list.
- Use `training/NOTION_CODEBASE_COMPARISON.md` to compare Notion coverage against repository code/docs.

Related Skills

notion-research-documentation

6
from issdandavis/SCBE-AETHERMOORE

Research across Notion and synthesize into structured documentation; use when gathering info from multiple Notion sources to produce briefs, comparisons, or reports with citations.

notion-meeting-intelligence

6
from issdandavis/SCBE-AETHERMOORE

Prepare meeting materials with Notion context and Codex research; use when gathering context, drafting agendas/pre-reads, and tailoring materials to attendees.

notion-knowledge-capture

6
from issdandavis/SCBE-AETHERMOORE

Capture conversations and decisions into structured Notion pages; use when turning chats/notes into wiki entries, how-tos, decisions, or FAQs with proper linking.

aetherbrowser-notion-nav

6
from issdandavis/SCBE-AETHERMOORE

Navigate Notion workspace pages in AetherBrowser for knowledge retrieval and workspace coordination tasks. Use when locating pages, databases, or section paths in browser mode before API operations.

scbe-training-pair-authoring

6
from issdandavis/SCBE-AETHERMOORE

Create prompt and response and metadata training pairs from SCBE documents, repair traces, terminal sessions, and operational workflows using the repository's canonical dataset contract and provenance rules.

scbe-spin-conversation-engine

6
from issdandavis/SCBE-AETHERMOORE

Generate SFT training data via radial matrix conversation pivots with D&D-style combat research mode. Produces diverse, cost-effective training pairs with Sacred Tongue encoding, golden spiral problem distribution, and harmonic re-attunement.

scbe-research-training-bridge

6
from issdandavis/SCBE-AETHERMOORE

Stage arXiv evidence and Obsidian markdown into source-grounded Hugging Face training bundles for research, review, and later SFT runs.

scbe-document-management

6
from issdandavis/SCBE-AETHERMOORE

Consolidate overlapping docs, classify files by authority, and keep SCBE repo documents aligned with runtime truth. Use when the repo has drift between canonical docs, public docs, proposal notes, research branches, and generated evidence.

scbe-colab-bridge

6
from issdandavis/SCBE-AETHERMOORE

Control Google Colab notebooks from Claude Code via Chrome extension. Execute cells, run terminal commands, read outputs, and manage GPU compute remotely.

scbe-claim-to-code-evidence

6
from issdandavis/SCBE-AETHERMOORE

Map SCBE Notion technical claims, proof pages, and patent-facing architecture notes to concrete repository evidence such as code paths, tests, demos, and docs. Use when Codex needs to build a due-diligence packet, claim-to-code audit, implementation crosswalk, patent support note, or proof summary from local Notion exports and repo artifacts.

scbe-autonomous-worker-productizer

6
from issdandavis/SCBE-AETHERMOORE

Turn SCBE automation, autonomous worker, and revenue-system notes into concrete offers, workflow packs, pilot plans, or SaaS-facing product packets. Use when Codex needs to package Notion automation pages into buyer-ready offerings, n8n/Zapier workflow designs, flock-backed worker systems, or implementation roadmaps tied to existing SCBE repo surfaces.

multi-agent-cloud-offload

6
from issdandavis/SCBE-AETHERMOORE

Deterministically sort, bundle, verify, and offshore local files through multiple AI/model lanes while capturing training rows and method evidence. Use when Codex needs to inventory folders, batch-process files, upload them to cloud targets such as rclone-backed Google Drive, Hugging Face, or GitHub, and only delete sources after the configured number of verified targets succeed.