Data Pipeline Builder
Designs and implements ETL/ELT pipelines with schema validation and error handling.
About
The Data Pipeline Builder skill creates robust data pipelines from source to destination. It supports batch and streaming architectures using Apache Beam, Spark, dbt, and Airflow. The skill handles schema evolution, data quality checks, dead letter queues, and monitoring dashboards. It produces pipeline code with proper retry logic and idempotency guarantees.
Installation
git clone https://github.com/brycewang-stanford/Auto-Empirical-Research-Skills ~/.gemini/skills/data-pipeline-builderOr install to ~/.antigravity/skills/data-pipeline-builder for Antigravity CLI.