Unifying Kafka & Relational Databases for Event Streaming (Oracle) | Current 2025

Описание: This talk describes how to close the gap between Apache Kafka® topics and database tables by providing a customized queuing abstraction inside the database that can be accessed via both SQL and Kafka’s Java APIs.

Kafka and relational databases have long been part of event-driven architectures and streaming applications. However, Kafka topics and database tables have historically been separate abstractions with independent storage and transaction mechanisms. Making them work together seamlessly can be challenging, especially because queuing has been viewed as an anti-pattern in a stock database.

Since topics are directly supported by the database engine, applications can easily leverage ACID properties of local database transactions allowing exactly-once event processing. Patterns such as Transactional Outbox (writing a data value and sending an event) or any atomicity required across many discrete database and streaming operations can be supported out of the box.

In addition, the full power of SQL queries can be used to view records in topics and also to join records in topics with rows in database tables. In this talk we cover the synergy between Kafka's Java APIs, SQL, and the transactional capabilities of the Oracle Database.

We describe the implementation, which uses a transactional event queue (TxEventQ) to implement a Kafka topic and a modified Kafka client that provides a single, unified JDBC connection to the database for event processing and traditional database access.

–

CONNECT
Subscribe, if you dare:    / @confluentdeveloper  
Community Slack: https://confluentcommunity.slack.com
X: https://x.com/confluentinc
Linkedin:   / confluent  
GitHub: https://github.com/confluentinc
Site: https://developer.confluent.io

ABOUT CONFLUENT DEVELOPER
Confluent Developer provides comprehensive resources for developers looking to learn about Apache Kafka®, Apache Flink®, Confluent Cloud, Confluent Platform, and any other technology related to the broader Data Streaming Platform. Content on Confluent Developer includes courses, getting started guides, topical deep-dives, patterns, tutorials, and listings of community events. Learn more at https://developer.confluent.io.

#current2025 #apachekafka #apacheflink #confluent