airflow-dag-design
Design small, maintainable Airflow DAGs with clear task boundaries, retry policy, and runtime assumptions.
Works with
Claude CodeCursorCodex CLIGitHub CopilotGemini CLI
--- name: airflow-dag-design description: Design small, maintainable Airflow DAGs with clear task boundaries, retry policy, and runtime assumptions. license: MIT --- ## What I do - Break a pipeline into task-sized Airflow steps. - Recommend schedules, retries, ownership, and tags. - Keep shared logic in `src/` and DAG wiring in `dags/`. - Highlight idempotency and backfill concerns. ## Design rules - DAG files should stay thin. - Business logic should not be embedded directly inside operators when it can live in shared Python modules. - Document retries, timeout assumptions, and expected outputs.
More Data Engineering skills
data-pipeline
claude-office-skills/skills
Data pipeline and ETL automation - extract, transform, load workflows for data integration and analytics
4.1k
ETL Pipeline
claude-office-skills/skills
Design and automate Extract, Transform, Load data pipelines for data integration and analytics
3.9k
data-throughput-accelerator
affaan-m/ecc
Use when large data ingestion, backfill, export, ETL, warehouse loading, manifest catch-up, or table synchronization needs to become much faster while preserving data correctness.
3.6k
