499 free skills
Data Engineering skills
Skills for data engineering — ETL pipelines, Airflow DAGs, Spark jobs, and data warehouse modeling.
Sourced from real, public repositories — synced daily, never invented.
499 free skills
Skills for data engineering — ETL pipelines, Airflow DAGs, Spark jobs, and data warehouse modeling.
Sourced from real, public repositories — synced daily, never invented.
15 tools across six categories
13 of them never send your data anywhere
Free · No signup · No trial clock
SEE THE DIRECTORY
spark
11vated/nexus
Apache Spark - use when working on related tasks
spark-me
mindwrapper/claude-skills
>
spark-sql-optimizer
nivkazdan/skills-agents-catalog
|
use-spark
jeffhuen/baileys_ex
Generic tooling for building DSLs.
gpt-engineer-spark
symbaiex/gpt-orchestration
Lead end-to-end engineering work with a capable main agent and a parallel fleet of model-pinned GPT-5.3-Codex-Spark subagents. Use when the user asks for a Spark fleet, ultra-fast parallel coding agents, rapid repository exploration, many bounded implementation shards, or low-latency independent verification while retaining architecture, integration, and final acceptance with the main agent.
analyze-project
jrjsmrtn/project-orchestration-skills
Conduct SPARK methodology analysis for new project inception. Use at the beginning of a new project, when evaluating significant features, before bootstrap-project to validate viability, or when pivoting an existing project.
airflow
11vated/nexus
Airflow DAGs - use when working on related tasks
airflow-translations
raphcodec/airflow
>
cip-diagnose-dag
mindwanders1993/cricket_intelligence_platform
Diagnose a failed Cricket Intelligence Platform Airflow DAG run: fetch task logs, inspect control-schema audit row, look for landing artifacts, and propose a root cause + retry strategy. Use when the user says 'why did the DAG fail', 'check error logs <run_id>', or names a DAG that errored.
migrating-airflow-2-to-3
miptah21/skills
Guide for migrating Apache Airflow 2.x projects to Airflow 3.x. Use when the user mentions Airflow 3 migration, upgrade, compatibility issues, breaking changes, or wants to modernize their Airflow codebase. If you detect Airflow 2.x code that needs migration, prompt the user and ask if they want you to help upgrade. Always load this skill as the first step for any migration-related request.
cosmos-dbt-core
420company/artemis
Use when turning a dbt Core project into an Airflow DAG/TaskGroup using Astronomer Cosmos. Does not cover dbt Fusion. Before implementing, verify dbt engine, warehouse, Airflow version, execution environment, DAG vs TaskGroup, and manifest availability.
verify-schedule-deployed
ferlab-ste-justine/unic-dag
After a schedule-change PR is merged and deployed, verify that prod Airflow has re-parsed each DAG and that `schedule_interval` + `next_dagrun_create_after` match the new target. Flags the known gotcha where Python DAGs using `schedule_interval=timedelta(...)` keep the old anchor and need DAG-history clearing. Use right after merging a schedule-update PR.
airflow-project-convention
iamhoonse-dev/hoonse-claude-plugins
Airflow v3 프로젝트의 디렉토리 구조, 파일 명명 규칙, Python 코딩 규약, 식별자 명명 규칙, 설정 관리 기준을 정의합니다. Airflow 프로젝트 작업 시 이 지침을 따릅니다.
blueprint
miptah21/skills
Define reusable Airflow task group templates with Pydantic validation and compose DAGs from YAML. Use when creating blueprint templates, composing DAGs from YAML, validating configurations, or enabling no-code DAG authoring for non-engineers.
dbt-helper
imre-kerr-sb1/dbt-skills
Expert dbt assistant for running models, tests, SQL compilation, docs, and source freshness. Use when working with dbt projects, workflows, or data pipeline management.
interserve
mistakeknot/sylveste
Interserve — Codex spark classifier and context compression via MCP
fx-dashboard-widgets
nusantara-ventures/exchangerate-skills
Build live currency/FX rate displays — a rate ticker, dashboard card, rate table, sparkline/chart, currency converter widget, Slack/CLI rate bot, or watch-a-pair alert. Use whenever the user wants to show exchange rates in a UI, even something as simple as "show the EUR/USD rate on my dashboard" — this skill covers the poller architecture, session-aware refresh, and truthful "as of" labeling so the widget doesn't burn API quota or lie about freshness. Powered by exchangerate.dev (keyless base https://api.exchangerate.dev).
great-expectations
testland/qa
Authors Great Expectations (GX Core) ExpectationSuites, builds ValidationDefinitions and Checkpoints, runs validation against tabular batches, and parses the JSON result for CI gating. Use when the user works with Great Expectations on Pandas, SQL, or Spark data.
data-quality-gate
testland/qa
Builds a release-readiness gate for a data pipeline by gathering check results from one or more engines (dbt, Great Expectations, Soda), applying severity-aware pass/fail thresholds, and emitting a single go / no-go decision with per-check rationale. Use when authoring a CI step that must fail the build when data quality drops below thresholds.