Skip to content

AI Dataset Generator

Tool-native dataset generation skill for Codex, Claude Code, and Antigravity with SFT/DPO pipelines, verification, deduplication, and flexible export.

Install

$pip install playwright && playwright install chromium

Install command taken from the project's README or registry entry. Always review code before running it.

AI Dataset Generator Skill (Claude / Codex / Antigravity / Cursor / Windsurf / Copilot)

An LLM-first dataset generation skill for agent IDEs and AI coding assistants, with 14 specialized sub-skills, 19 pipeline entry scripts, and 15 shared utility modules that turn topics, URLs, or raw files into SFT and DPO training datasets.

For detailed installation guidance, example prompts, command reference, generation workflow, reports, and the full script inventory, see the Wiki.

IDE Compatibility

The installer ships native formats for each tool — not just a generic copy:

Tool Install location Native format
Claude Code ~/.claude/skills/dataset-generator Skill directory
Codex CLI ~/.codex/skills/dataset-generator Skill directory
Antigravity IDE /.agent/skills/dataset-generator Skill directory
Claude Cowork /.claude/skills/dataset-generator Project-scoped skill (commit to git)
Cursor /.cursor/rules/dataset-generator.mdc + .cursor/skills/dataset-generator/ MDC rule
Windsurf /.windsurf/rules/dataset-generator.md + .windsurf/skills/dataset-generator/ Windsurf rule
Continue.dev /.continue/prompts/dataset-generator.prompt + .continue/skills/dataset-generator/ Slash command
GitHub Copilot /.github/copilot-instructions.md + .github/skills/dataset-generator/ Repo instructions
Cline /.clinerules + .cline/skills/dataset-generator/ Project rules

📦 Current Inventory

  • Specialized sub-skills: 14
  • Pipeline entry scripts in scripts/: 19 (audit.py, augment.py, browser_collect.py, build_loop.py, collect.py, coverage.py, dedup.py, draft_self_check.py, export.py, generate.py, grounding.py, judge_insights.py, quality_report.py, record_history.py, research.py, review_batch.py, status.py, verify.py)
  • Shared utility modules in scripts/utils/: 15
  • Internal canonical schema: 1 (resources/internal-schema/canonical_schema.json)
  • Preset export schemas: 3 (in resources/target-schemas/: OpenAI messages, HuggingFace dataset, CSV columns)

Key Script Inventory

The README only highlights the scripts most users reach for first. See the full inventory with purpose notes in the Script Inventory wiki.

Similar plugs

Turn any codebase, with its docs, SQL schemas, configs, and PDFs, into a queryable knowledge graph. A /graphify skill for Claude Code, Cursor, Codex, and Gemini CLI: local…

Why use many token when few token do trick. Viral skill + proxy for coding agents that cuts 65% of tokens by talking like a caveman.

The 1st Collaborative AI Design Agent Workspace. Local-first and open source. Create prototypes, websites, apps, dashboards, presentations, images, and videos with your team…

Explore related