yaooqinn logo
Data Engineering

Real file from a public repo · synced Aug 22, 2026

spark-advisor

Diagnose, compare, and optimize Apache Spark applications and SQL queries using Spark History Server data. Use this skill whenever the user wants to understand why a Spark app is slow, compare two benchmark runs or TPC-DS results, find performance bottlenecks (skew, GC pressure, shuffle spill, straggler tasks), get tuning recommendations, or optimize Spark/Gluten configurations. Also trigger when the user mentions 'diagnose', 'compare runs', 'why is this query slow', 'tune my Spark job', 'benchmark comparison', 'performance regression', or asks about executor skew, shuffle overhead, AQE effectiveness, or Gluten offloading issues.

yaooqinn/spark-history-cli19 installsApache-2.0

Works with

Claude CodeCursorCodex CLIGitHub CopilotGemini CLI

Install in three steps

  1. 1

    Download the ZIP

    One file per agent, plus INSTALL.md with the exact paths below.

  2. 2

    Claude Code: copy SKILL.md into your skills folder

    .claude/skills/spark-advisor/SKILL.md    # this project
    ~/.claude/skills/spark-advisor/SKILL.md   # every project
  3. 3

    Other agents: use the matching file

    skill.mdc goes in Cursor’s .cursor/rules/. AGENTS.md works as GitHub Copilot instructions, a legacy .cursorrules, or a Codex / Gemini CLI instructions file.

More Data Engineering skills

All Data Engineering skills

Check your AI visibility

One URL in, a 0–100 score and the exact fixes out.

RUN THE CHECK

Browse all the tools

15 tools across six categories
13 of them never send your data anywhere

Free · No signup · No trial clock

SEE THE DIRECTORY