#CONDUKTOR GUI APACHE KAFKA SERIES UPDATE#
#CONDUKTOR GUI APACHE KAFKA SERIES SERIES#

#CONDUKTOR GUI APACHE KAFKA SERIES UPDATE#

Ultimately, Debezium lets you track data changes, replicate data, update caches, sync data between microservices, and create audit logs among much more. He goes into more detail on the plans for Debezium going forward in this talk.

Debezium Use CasesĪccording to Gunnar Morling from Redhat, tech lead for Debezium, CDC means 'liberation for your data'. The processed data can then be streamed out to a sink database such as ElasticSearch or a data warehouse.

#CONDUKTOR GUI APACHE KAFKA SERIES SERIES#

The changelog itself can be stored in Kafka, where a series of deployed programs are able to transform, aggregate, and join the data together. As your database has a change occur you can track that directly in Kafka.Īs illustrated in figure 2, one method of achieving this is by capturing the changelogs of a database upstream in either a Postgres or MySql database using the Debezium Kafka connectors.

Thanks to Kafka Connect and Debezium, change data capture, or CDC is now a common pattern that allows you to expose database changes as events into Kafka.

Conduktor gui apache kafka series