What is Change Data Capture (CDC)? The Secret of Real-Time Data Transfer
The Difficulty of Capturing Changing Data
Classical batch synchronization (ETL jobs running at night) in data systems usually creates a large load on the source systems and delays the updating of the data. Change Data Capture (CDC), a more modern, reactive and resource-friendly approach, listens to database transaction logs and delivers only INSERT, UPDATE and DELETE operations to the target instantly.
Zero Load, Maximum Speed
Microsoft SQL Server's built-in CDC structure or streaming technologies such as Debezium/Kafka enable updating data warehouses without tiring production systems. In evolving Enterprise DWH strategies, CDC together with gradually changing dimensions (SCD Type 2) designs are an inseparable duo. It is critical to keep the past and photograph the change.
As DVision Technology, we offer CDC-based architectures to our corporate customers in the most reliable way by adding Soft Delete algorithms and Source Audit systems to our integration processes.
