Event-Driven Architecture Live
Welcome
Explore a complete Change Data Capture (CDC) pipeline running on Red Hat OpenShift with Streams for Apache Kafka, Debezium, Apache Camel, SonataFlow, and Apicurio Registry.
What You’ll Learn
-
Deploy a Kafka cluster in KRaft mode (without Zookeeper) using AMQ Streams
-
Configure Debezium to capture changes in PostgreSQL in real time
-
Use Apicurio Registry as a Schema Registry for event validation
-
Design integration routes visually with Kaoto inside DevSpaces
-
Monitor the pipeline with Grafana dashboards and Service Mesh (Kiali)
-
Manage Kafka from Developer Hub with the Kafka plugin
-
Use Lightspeed (MCP) for pipeline troubleshooting
Pipeline Components
| Component | What it is | Role in this demo |
|---|---|---|
Streams for Apache Kafka |
Enterprise distribution of Apache Kafka (Strimzi-based) for distributed event streaming |
KRaft cluster with 3 brokers that stores and distributes CDC events with replication, topics, HTTP bridge, and metrics exporter |
Debezium |
Open source Change Data Capture (CDC) platform that captures database changes |
PostgreSQL connector that reads the WAL and publishes each INSERT/UPDATE/DELETE as an event to Kafka topics in real time |
Apicurio Registry |
Open source Schema Registry that manages and validates data schemas (Avro, JSON Schema, Protobuf) |
Registers and versions CDC event schemas, ensuring compatibility between producers and consumers |
Apache Camel + Kaoto |
Integration framework implementing Enterprise Integration Patterns, with a low-code visual designer |
Consumes CDC events from Kafka, applies content-based routing, and sends email notifications via Mailpit |
SonataFlow |
Serverless workflow engine (evolution of Kogito/jBPM) that runs cloud-native business processes |
Orchestrates customer onboarding: validation, classification, approvals with SLA, and parallel provisioning |
Red Hat Developer Hub |
Self-service developer portal based on Backstage, with a component catalog and plugins |
Kafka plugin to visualize consumer group offsets and lag directly on entity pages |
Grafana + Service Mesh |
Observability stack: metric dashboards (Grafana), automatic mTLS, and traffic visualization (Kiali) |
"Kafka CDC Pipeline" dashboard with throughput, lag, and latency; Istio ambient mode for mTLS without sidecars |
OpenShift DevSpaces |
Cloud-native IDE based on Eclipse Che, with ephemeral workspaces and pre-configured extensions |
Workspace with Kaoto pre-installed to visually design Apache Camel routes and SonataFlow workflows |
OpenShift Lightspeed |
AI assistant integrated into the OpenShift console with MCP tools for diagnostics |
55+ MCP tools for pipeline troubleshooting: query Kafka, Debezium, connector, and pod status |
Keycloak |
Enterprise Identity and Access Management (IAM) based on OAuth 2.0 / OIDC standards |
SSO authentication for all demo services (Console, Developer Hub, Grafana, etc.) |
NeuroFace (Computer Vision) |
Facial recognition application with LBPH + OpenVINO Model Server (face-detection-retail-0005) |
Registers faces via webcam, detects people, and publishes events to the Kafka topic |
OpenVINO Model Server (OVMS) |
Intel inference server deployed as a KServe InferenceService on OpenShift AI |
Serves the |
CV Processor (Python) |
Python microservice that polls OVMS and NeuroFace, producing and consuming Kafka events |
Publishes |
Environment access
-
Kafka Console:
https://kafka-console-kafka-cdc. -
Apicurio Registry:
https://apicurio-registry-kafka-cdc. -
Kafka Bridge (REST):
https://kafka-bridge-kafka-cdc. -
Grafana:
https://grafana-observability. -
Developer Hub:
https://backstage-developer-hub-developer-hub. -
DevSpaces (Kaoto):
https://devspaces. -
NeuroFace:
https://neuroface-neuroface. -
OpenShift AI:
https://data-science-gateway. -
Mailpit:
https://n8n-mailpit-openshift-lightspeed.
Required Red Hat subscriptions
| Product / Subscription | Documentation |
|---|---|
Red Hat OpenShift Container Platform |
|
Red Hat Streams for Apache Kafka |
|
Red Hat build of Debezium |
|
Red Hat build of Apicurio Registry |
|
Red Hat build of Apache Camel |
|
Red Hat Developer Hub |
|
Red Hat OpenShift Dev Spaces |
|
Red Hat OpenShift Service Mesh |
|
Red Hat OpenShift Lightspeed |
|
Red Hat OpenShift Serverless Logic |
|
Red Hat build of Keycloak |
|
Red Hat OpenShift GitOps |
|
Red Hat OpenShift Pipelines |
|
Red Hat OpenShift Serverless |
|
Cluster Observability Operator |
|
Red Hat OpenShift distributed tracing |
|
Grafana Operator |
|
Red Hat OpenShift AI |