Skip to main content
SOURCE CHANGE FEED ACTIVATEDENH-2026-007
CRITICAL ENHANCEMENT

Change Data Capture (CDC) Integration

The enterprise CRM and Core Billing databases have activated continuous change data capture via Debezium and Apache Kafka. The existing nightly batch ingestion pipeline suffers from a 24-hour data staleness lag, blinding fraud prevention and customer support operations. Engineering must enhance the lakehouse ingestion architecture to ingest, deduplicate, order, and merge continuous INSERT, UPDATE, and DELETE change streams into Databricks Delta Lake and downstream Snowflake tables.

Current Data Lag
24 Hours
Critical LatencyNightly JDBC pull
Target CDC SLA
< 60 Sec
-99.9% LagEnd-to-end sync
Source Stream Volume
1.8M / Day
CRUD events
Tombstone Handling
Zero Data Loss
Full DELETE tracking