Data Engineering
Real file from a public repo · synced Sep 3, 2026
spark-training-gotchas
Preflight and diagnose the ten known failure modes for ML training on NVIDIA DGX Spark. Use when a training run on DGX Spark fails to start, OOMs below the 128GB limit, slows down mid-run, or before any multi-hour training job on GB10.
Works with
Claude CodeCursorCodex CLIGitHub CopilotGemini CLI
Install in three steps
- 1
Download the ZIP
One file per agent, plus INSTALL.md with the exact paths below.
- 2
Claude Code: copy SKILL.md into your skills folder
.claude/skills/spark-training-gotchas/SKILL.md # this project ~/.claude/skills/spark-training-gotchas/SKILL.md # every project
- 3
Other agents: use the matching file
skill.mdc goes in Cursor’s .cursor/rules/. AGENTS.md works as GitHub Copilot instructions, a legacy .cursorrules, or a Codex / Gemini CLI instructions file.
More Data Engineering skills
All Data Engineering skills
data-pipelineclaude-office-skills/skillsData pipeline and ETL automation - extract, transform, load workflows for data integration and analyticsData Engineering4.1kETL Pipelineclaude-office-skills/skillsDesign and automate Extract, Transform, Load data pipelines for data integration and analyticsData Engineering4.0k
data-throughput-acceleratoraffaan-m/eccUse when large data ingestion, backfill, export, ETL, warehouse loading, manifest catch-up, or table synchronization needs to become much faster while preserving data correctness.Data Engineering3.8k
