Module 6 · Git + Jenkins for Data Pipelines
This is the shortest module in the course for a reason: you are the target hire for this skill area. The module exists only to cover what's different about CI/CD for data pipelines versus app deployment.
Required skill · s4 (paraphrased)
Version control and CI/CD: Git, Jenkins.
Your coverage: Strong
What we're assuming
- Deep CI/CD experience: pipeline authoring, GitOps, container-image maintenance, runner infrastructure, policy-driven release flows.
- IaC discipline: Terraform + config-management tooling + environment automation.
- Observability/ops maturity: logging pipelines, automated patching, monitoring.
- Operated Jenkins and similar tools at regulated-industry scale. This is a refresher, not a new topic.
What we modify for your background
- Skip entirely: Git basics, Jenkins basics, pipeline-as-code, agent setup, credential management.
- Focus: DE's special cases — schema change management (the database is state), CDC state, data tests, warehouse-as-environment.
- Mental model shift: in app deployment, "env" is a Kubernetes namespace. In DE, "env" is often a Snowflake database; branches use zero-copy clones, not feature-flagged deploys.
Want more depth?
See Credits → Module 6. schemachange, dbt, the Liquibase-for-Snowflake patterns.
Lessons
- Lesson 6.1 — What's Different About CI/CD for DE (vs app deployment) crash deep
- Lesson 6.2 — schemachange + Jenkins for Snowflake DDL deep