250 free skills · page 1 of 5
Data Engineering skills
Skills for data engineering — ETL pipelines, Airflow DAGs, Spark jobs, and data warehouse modeling.
Real files from public repositories — hand-curated, never invented. Sorted by installs.
data-pipelineclaude-office-skills/skillsData pipeline and ETL automation - extract, transform, load workflows for data integration and analyticsData Engineering4.1kETL Pipelineclaude-office-skills/skillsDesign and automate Extract, Transform, Load data pipelines for data integration and analyticsData Engineering4.0k
data-throughput-acceleratoraffaan-m/eccUse when large data ingestion, backfill, export, ETL, warehouse loading, manifest catch-up, or table synchronization needs to become much faster while preserving data correctness.Data Engineering3.8k
scoping-changesriekelt/principal-engineerUse when deciding how big a fix should be, when scope is drifting mid-task, when a plan is being quietly trimmed to fit, or when "while you're at it" appears in any form. Encodes size-to-trigger, decompose-not-descope, and drive-to-completion. Use whenever the work is about to grow past its cause or shrink below its promise.Data Engineering3.4k
ads-tiktokagricidaniel/claude-adsAudit TikTok Ads measurement, Pixel and Events API, mobile-first creative, audiences, Smart+, Shop and commerce campaigns, bidding, budgets, pacing, attribution, and policy. Use for TikTok Ads, TikTok Pixel, Events API, Smart+, TikTok Shop Ads, GMV Max, Spark Ads, or TikTok campaign optimization.Data Engineering3.3k
data-analyticsmarkdown-viewer/skillsCreate data pipeline and analytics architecture diagrams using PlantUML syntax with database/analytics stencil icons. Best for ETL pipelines, data lakes, real-time streaming, data warehousing, and BI dashboard design.Data Engineering3.1k
accelerated-computing-cudfnvidia/skillsOfficial NVIDIA-authored guidance for NVIDIA cuDF GPU DataFrames, pandas acceleration, dask-cuDF, ETL, joins, groupby, CSV/Parquet I/O, nullable semantics, and multi-GPU DataFrame workloads.Data Engineering2.7k
netlify-deployopenai/skillsDeploy web projects to Netlify using the Netlify CLI (npx netlify). Use when the user asks to deploy, host, publish, or link a site/repo on Netlify, including preview and production deploys.Data Engineering2.7k
google-cloud-solution-agentic-analytics-spark-knowledge-cataloggoogle/skillsThis skill provides a workflow to design and implement a governed, secure pipeline for agentic analytics solution across structured and unstructured data that's distributed across Google Cloud, on-premises systems, and other cloud providers.Data Engineering2.2k
netlify-blobsnetlify/context-and-toolsStore and retrieve unstructured objects, file uploads, and cache-like state on Netlify using the @netlify/blobs key/value API from Functions, Edge Functions, and Build Plugins. Use when a task involves saving user file or image uploads, persisting form or contact-form submissions, storing generated output from Background Functions (sitemaps/processed media/bulk-email results), building read-only asset stores, adding client-side blob expiration, or wiring file-based blob uploads at deploy time. Not for per-user, transactional, or relational data (counters/balances/sessions) — reach for Netlify DB there instead.Data Engineering2.0kmanaged-airflow-migrationsgoogle/skillsProvides guidance for migrating Apache Airflow DAGs in Managed Service for Apache Airflow (MSAA; formerly Cloud Composer). Covers migration to Airflow 2.11.1 (MSAA Gen 2 and 3) and Airflow 3 (MSAA Gen 3), including environment inspection, GCS download/upload and scanning patterns for breaking changes. Use when migrating the DAG code to newer Airflow version. Don't use when checking DAG run failures unrelated to code migration.Data Engineering1.5k
pytorch-lightningk-dense-ai/scientific-agent-skillsDeep learning framework (PyTorch Lightning / lightning package). Organize PyTorch code into LightningModules, configure Trainers for multi-GPU/TPU, implement data pipelines, callbacks, logging (W&B, TensorBoard, MLflow), distributed training (DDP, FSDP, DeepSpeed), for scalable neural network training.Data Engineering1.4k
analyzing-dataastronomer/agentsQueries the data warehouse with SQL and answers business questions about data. Use when answering anything that needs warehouse data - counts, metrics, trends, aggregations, joins across tables, data lookups, or ad-hoc SQL analysis (for example "who uses X", "how many Y", "show me Z", "find customers", "what is the count").Data Engineering1.3k
creator-ugc-marketingeronred/aso-skillsWhen the user wants to plan, brief, source, or measure organic creator / influencer / UGC marketing for their app — including TikTok creators, Instagram Reels, YouTube Shorts, micro-influencers, paid creator briefs, UGC ad creative for Meta/TikTok, affiliate programs, and seeding strategy. Use when the user mentions "creators", "influencers", "TikTok marketing", "UGC", "user-generated content", "creator briefs", "creator outreach", "influencer marketing", "Reels", "Shorts", "creator gifting", "seeding", "affiliate", "Whop", "TikTok Spark Ads", "Instagram collab posts", or "I want my app to go viral on TikTok". For paid social ad campaigns (Meta/TikTok ad accounts), see ua-campaign. For PR / press, see press-and-pr. For viral in-app loops, see referral-program.Data Engineering1.3kmanaged-airflow-dag-authoringgoogle/skillsThis skill guides you through authoring and validating Apache Airflow DAGs for Managed Service for Apache Airflow (MSAA; formerly Cloud Composer) environments.Data Engineering1.2k
tiktok-adskostja94/marketing-skillsWhen the user wants to set up, optimize, or manage TikTok Ads. Also use when the user mentions "TikTok Ads," "TikTok for Business," "TikTok Pixel," "Events API," "TikTok Spark Ads," or "TikTok video ads." For organic TikTok, use tiktok-captions.Data Engineering1.2k
spark-training-gotchaswshobson/agentsPreflight and diagnose the ten known failure modes for ML training on NVIDIA DGX Spark. Use when a training run on DGX Spark fails to start, OOMs below the 128GB limit, slows down mid-run, or before any multi-hour training job on GB10.Data Engineering1.2k
parallel-task-sparkam-will/codex-skillsYou are an Orchestrator for subagents. Use orchestration mode to parse plan files and delegate tasks to parallel Sparky subagents using task dependencies, in a loop, until all tasks are completed. Your role is to ensure that subagents are launched in the correct order (in waves), and that they…Data Engineering1.1ksuper-swarm-sparkam-will/codex-skillsYou are an Orchestrator for subagents. Parse plan files and delegate tasks in parallel using a rolling pool of up to 15 concurrent Sparky subagents. Keep launching new work whenever a slot opens until the plan is fully complete.Data Engineering1.1k
grow-appwondelai/skillsGuided journey from an app people sign up for and then quietly abandon to a sealed retention engine with a habit loop, an activated first run, and one metric the whole team trusts. Orchestrates eight skills phase by phase - hooked-ux, improve-retention, continuous-discovery, lean-ux, inspired-product, lean-analytics, microinteractions, drive-motivation - asking the user questions at every decision point and recording results in the project docs/ folder (PRODUCT.md, METRICS.md, GROW-APP-PLAN.md) so the journey resumes across sessions. Use when the user wants to lift activation and retention, design a habit loop, fix a leaky onboarding funnel, or says ''users sign up then disappear''. Do not use to fix broken UX or performance that no engagement mechanic can paper over - run improve-app first; if there is no app yet, use create-app. For one framework in isolation, invoke that skill directly.Data Engineering1.0kmigrating-airflow-2-to-3astronomer/agentsGuide for migrating Apache Airflow 2.x projects to Airflow 3.x. Use when the user mentions Airflow 3 migration, upgrade, compatibility issues, breaking changes, or wants to modernize their Airflow codebase. If you detect Airflow 2.x code that needs migration, prompt the user and ask if they want you to help upgrade. Always load this skill as the first step for any migration-related request.Data Engineering1.0k
analytics-data-analysismindrally/skillsBest practices for analytics, data analysis, and visualization using Python, pandas, matplotlib, seaborn, and Jupyter notebooks. Use when performing exploratory data analysis, building data pipelines, creating statistical visualizations, writing Jupyter notebooks, cleaning and transforming datasets, or implementing analytics dashboards.Data Engineering985
databricks-pipelinesdatabricks/databricks-agent-skillsDevelop Lakeflow Spark Declarative Pipelines (formerly Delta Live Tables) on Databricks. Use when building batch or streaming data pipelines with Python or SQL. Invoke BEFORE starting implementation.Data Engineering775
data-engineersickn33/agentic-awesome-skillsBuild scalable data pipelines, modern data warehouses, and real-time streaming architectures. Implements Apache Spark, dbt, Airflow, and cloud-native data platforms.Data Engineering763
warehouse-optimizationnexscope-ai/ecommerce-skillsE-commerce warehouse and inventory optimization advisor. Analyzes inventory health, calculates safety stock and reorder points, performs ABC analysis, evaluates fulfillment costs, and provides actionable recommendations for improving efficiency. Supports all major fulfillment models: Self-fulfillment, Amazon FBA/FBM, Walmart WFS, 3PL, Shopify Fulfillment, TikTok Shop, Dropshipping, and Hybrid setups. No API key required. Use when: (1) reducing stockouts or overstock, (2) calculating safety stock levels, (3) optimizing warehouse costs, (4) improving Amazon IPI score, (5) analyzing inventory KPIs.Data Engineering702
ui-craft-dense-dashboardeduclopez/ui-craftDense dashboard / admin / Bloomberg / Retool / data-heavy internal tools. Locked knobs: CRAFT=7, MOTION=3, DENSITY=9. IBM Plex + mono numbers, semantic palette, 4/8px grid, sparklines, tabular-nums. Trigger on: dashboard, admin panel, data-dense, analytics, Bloomberg-like, Retool-like.Data Engineering657annotating-task-lineageastronomer/agentsAnnotate Airflow tasks with data lineage using inlets and outlets. Use when the user wants to add lineage metadata to tasks, specify input/output datasets, or enable lineage tracking for operators without built-in OpenLineage extraction.Data Engineering626
content-amplifieraaron-he-zhu/aaron-marketing-skillsUse when the user asks to "amplify influencer content with paid media", "set up whitelisting or Spark Ads", "decide which posts to boost", "repurpose influencer content", "turn one video into multiple ads", or "build a UGC asset library"; produces (paid mode) a content-selection scorecard, a paid amplification strategy (whitelisting/boosting/dark posts), audience targeting, and a budget+optimization plan, or (repurpose mode) a rights-tracked content inventory, a 1-video-to-10+-asset repurposing map, per-format transformation specs, and a 30-day distribution plan. Not for gating whether a deliverable is publishable or FTC-compliant — use creator-content-auditor; not for the always-on brand posting calendar — use social-calendar-builder; not for drafting a net-new idea into platform-native packages — use social-creative-builder. 复用达人内容 / 内容放量.Data Engineering610creating-openlineage-extractorsastronomer/agentsCreate custom OpenLineage extractors for Airflow operators. Use when the user needs lineage from unsupported or third-party operators, wants column-level lineage, or needs complex extraction logic beyond what inlets/outlets provide.Data Engineering606cosmos-dbt-coreastronomer/agentsTurns a dbt Core project into an Airflow DAG/TaskGroup using Astronomer Cosmos. Use turning a dbt Core project into an Airflow DAG or TaskGroup with Astronomer Cosmos. Before implementing, verify dbt engine, warehouse, Airflow version, execution environment, DAG vs TaskGroup, and manifest availability.Data Engineering582
Data Cleaning Pipelineaj-geddes/useful-ai-promptsBuild robust processes for data cleaning, missing value imputation, outlier handling, and data transformation for data preprocessing, data quality, and data pipeline automationData Engineering549
sparkwishworldbetter/seedex-skillsUse when the user wants to brainstorm an idea or design a feature/spec. Explores intent and requirements through dialogue, then writes a spec document to docs/spark/ and STOPS. Does not auto-chain to implementation planning or any other skill.Data Engineering541warehouse-initastronomer/agentsInitialize warehouse schema discovery. Generates .astro/warehouse.md with all table metadata for instant lookups. Run once per project, refresh when schema changes. Use when user says "/astronomer-data:warehouse-init" or asks to set up data discovery.Data Engineering437
sap-dataspheresecondsky/sap-skillsSAP Datasphere development skill with 3 specialized agents, 5 slash commands, and validation hooks. Use when building data warehouses on SAP BTP, creating analytic models, configuring data flows and replication flows, setting up connections, managing spaces and users, implementing data access controls, using the datasphere CLI, or inspecting authenticated Datasphere browser UI state with Microsoft Edge CDP. Covers Data Builder, Business Builder, analytic models, 40+ connection types, real-time replication, task chains, content transport, and data marketplace.Data Engineering435
neo4j-spark-skillneo4j-contrib/neo4j-skillsUse when reading from or writing to Neo4j with Apache Spark or Databricks using theData Engineering401deploying-airflowastronomer/agentsDeploys Airflow DAGs and projects. Use when deploying Airflow or answering anything about deployment - deploying DAGs/projects, pushing code, setting up CI/CD, deploying to production or deployment strategies for Airflow.Data Engineering385
developing-in-lightdashlightdash/lightdashUse when working with Lightdash YAML files, dbt models with Lightdash metadata, the lightdash CLI (deploy, upload, download, preview, lint, warehouse-catalog, sql, set-warehouse, apps create/preview/validate), or managing charts, dashboards, spaces and access, AI agents, scheduled content, data apps, organization Data App themes, data-app external connections, users, groups, custom roles, metrics, and dimensions as codeData Engineering370ml-pipeline-automationsecondsky/claude-skillsAutomate ML workflows with Airflow, Kubeflow, MLflow. Use for reproducible pipelines, retraining schedules, MLOps, or encountering task failures, dependency errors, experiment tracking issues.Data Engineering335
particle-systemiart-ai/webgl-animation-skillsThis skill should be used when the user asks to "build a particle system", "make confetti/snow/smoke/sparks", "create a connected-dot/constellation network background", "add a flow-field or curl-noise particle effect", "render thousands of GPU particles with Three.js Points", or "animate emitters with forces". Covers per-particle integration, forces, flow fields, burst/continuous emission, spatial-grid connected dots, and GPU points + shaders.Data Engineering320
motherduck-build-data-pipelinemotherduckdb/agent-skillsDesign an end-to-end MotherDuck data pipeline. Use for ETL/ELT workflows -- choosing raw, staging, and analytics boundaries, bulk ingestion paths, transformation sequencing, dlt/dbt integration, publication targets, or whether DuckLake is actually required.Data Engineering300airflow-dag-patternssickn33/agentic-awesome-skillsBuild production Apache Airflow DAGs with best practices for operators, sensors, testing, and deployment. Use when creating data pipelines, orchestrating workflows, or scheduling batch jobs.Data Engineering298
ae-dataopsthinkingaiagenticengine/ae-cliAE Data Development and Operations: Data warehouse management, flow orchestration, IDE queries, and data integrationData Engineering298
omxakillness/jeo-skillsUse when you need multi-agent orchestration for OpenAI Codex CLI, especially Codex equivalents of Claude /team, /autopilot, /ultrawork, and /ultraqa. Triggers on: omx, $plan, $ralph, $team, $ulw, $ultraqa, $autopilot, $deep-interview, $prometheus-strict. v0.18.14 — 30+ agents, 35+ workflow skills, tmux team runtime, sparkshell, explore, ralplan, prometheus-strict, best-practice-research, autoresearch-goal.Data Engineering286
use-sparkreaddle/spark-cli-skillsspark is a CLI for the Spark email client. Use it to query the user's mailbox, calendar, contacts, meetings, and team data.Data Engineering275
kafka-engineer404kidwiz/claude-supercode-skillsExpert in Apache Kafka, Event Streaming, and Real-time Data Pipelines. Specializes in Kafka Connect, KSQL, and Schema Registry.Data Engineering273airflow-pluginsastronomer/agentsBuilds Airflow 3.1+ plugins that embed FastAPI apps, custom UI pages, React components, middleware, macros, and operator links directly into the Airflow UI. Use when building anything custom inside Airflow 3.1+ that involves Python and a browser-facing interface - creating an Airflow plugin, adding a custom UI page or nav entry, building FastAPI-backed endpoints inside Airflow, serving static assets from a plugin, embedding a React app, adding middleware to the API server, creating custom operator extra links, or calling the Airflow REST API from inside a plugin; also when AirflowPlugin, fastapi_apps, external_views, react_apps, or plugin registration come up.Data Engineering265
spark-prairie-firehughyau/qiushi-skill从小处着手不等于没有前途。关键是建立稳固的"根据地"（基础），而不是四处游击（散乱行动）。在正确的条件下，星星之火完全可以发展为燎原之势。Data Engineering251
python-data-pipeline-designerjorgealves/agent_skillsDesign ETL workflows with data validation using tools like Pandas, Dask, or PySpark. Use when building robust data processing systems in Python.Data Engineering247
snowflake-expertpersonamanagmentlayer/pclExpert-level Snowflake data warehouse platform, virtual warehouses, data sharing, streams, tasks, and SQL optimizationData Engineering228
etl-sync-job-builderpatricio0312rev/skillsDesigns reliable ETL and data synchronization jobs with incremental updates, idempotency guarantees, watermark tracking, error handling, and retry logic. Use for "ETL jobs", "data sync", "incremental sync", or "data pipeline".Data Engineering223databricks-expertpersonamanagmentlayer/pclExpert-level Databricks platform, Apache Spark, Delta Lake, MLflow, notebooks, and cluster managementData Engineering206spark-recipe-inbox-by-categoryreaddle/spark-cli-skillsProcess the inbox in priority order using Spark's smart categories. This ensures the most important messages get attention first.Data Engineering189spark-recipe-end-of-dayreaddle/spark-cli-skillsClose out the workday by reviewing loose ends, checking pinned items, and previewing tomorrow's schedule.Data Engineering188
data-quality-auditnimrodfisher/data-analytics-skillsComprehensive data quality assessment against business rules, schema constraints, and freshness expectations. Activate when validating data pipeline outputs before production use, auditing a dataset against defined business rules, or producing a quality scorecard for a data asset.Data Engineering188spark-recipe-morning-standupreaddle/spark-cli-skillsStart the day with a structured briefing: today's calendar, unread mail by category, and team assignment status.Data Engineering187
data-pipeline-engineercuriositech/some_claude_skillsExpert data engineer for ETL/ELT pipelines, streaming, data warehousing. Activate on: data pipeline, ETL, ELT, data warehouse, Spark, Kafka, Airflow, dbt, data modeling, star schema, streamingData Engineering185spark-recipe-multi-account-reviewreaddle/spark-cli-skillsFor users with multiple email accounts, review each account's inbox status and present a unified summary with per-account breakdown.Data Engineering180spark-recipe-weekly-digestreaddle/spark-cli-skillsGenerate a weekly summary covering calendar events, unread email by category, and team status.Data Engineering179spark-recipe-meeting-prepreaddle/spark-cli-skillsPrepare for an upcoming meeting by gathering calendar context, relevant email threads, and attendee information. Optionally, run a gap analysis after the meeting to flag verbal commitments without a written trail and open threads that weren't raised.Data Engineering177blueprintastronomer/agentsDefine reusable Airflow task group templates with Pydantic validation and compose DAGs from YAML. Use when creating blueprint templates, composing DAGs from YAML, validating configurations, or enabling no-code DAG authoring for non-engineers.Data Engineering174Other tasks
same rules, different job
