Real file from a public repo · synced Aug 26, 2026
databricks-spark-structured-streaming
Comprehensive guide to Spark Structured Streaming for production workloads. Use when building streaming pipelines, working with Kafka ingestion, implementing Real-Time Mode (RTM), configuring triggers (processingTime, availableNow), handling stateful operations with watermarks, optimizing checkpoints, performing stream-stream or stream-static joins, writing to multiple sinks, or tuning streaming cost and performance.
Works with
Install in three steps
- 1
Download the ZIP
One file per agent, plus INSTALL.md with the exact paths below.
- 2
Claude Code: copy SKILL.md into your skills folder
.claude/skills/databricks-spark-structured-streaming-1cood5/SKILL.md # this project ~/.claude/skills/databricks-spark-structured-streaming-1cood5/SKILL.md # every project
- 3
Other agents: use the matching file
skill.mdc goes in Cursor’s .cursor/rules/. AGENTS.md works as GitHub Copilot instructions, a legacy .cursorrules, or a Codex / Gemini CLI instructions file.
More Data Engineering skills
All Data Engineering skills
data-pipelineclaude-office-skills/skillsData pipeline and ETL automation - extract, transform, load workflows for data integration and analyticsData Engineering4.1kETL Pipelineclaude-office-skills/skillsDesign and automate Extract, Transform, Load data pipelines for data integration and analyticsData Engineering4.0k
data-throughput-acceleratoraffaan-m/eccUse when large data ingestion, backfill, export, ETL, warehouse loading, manifest catch-up, or table synchronization needs to become much faster while preserving data correctness.Data Engineering3.8k
