Event-Driven Architecture Live
Welcome
Explore a complete Change Data Capture (CDC) pipeline running on Red Hat OpenShift with Streams for Apache Kafka, Debezium, Apache Camel, SonataFlow, and Apicurio Registry.
This published guide follows the full Validated Pattern (values-global.yaml + values-hub.yaml, userCount: 30). Do not apply values-lite.yaml for this lab — that overlay turns off DevSpaces, Grafana, Lightspeed, BPM, Industrial Edge, and NeuroFace.
What You’ll Learn
-
Deploy a Kafka cluster in KRaft mode (without Zookeeper) using AMQ Streams
-
Configure Debezium to capture changes in PostgreSQL in real time
-
Use Apicurio Registry as a Schema Registry for event validation
-
Design integration routes visually with Kaoto inside DevSpaces
-
Try Camel routes in the OpenShift console with OpenShift Integration Operator (
IntegrationFlow, Quick Try) -
Monitor the pipeline with Grafana dashboards and Service Mesh (Kiali)
-
Manage Kafka from Developer Hub with the Kafka plugin
-
Use Lightspeed (MCP) for pipeline troubleshooting
Pipeline Components
| Component | What it is | Role in this demo |
|---|---|---|
Streams for Apache Kafka |
Enterprise distribution of Apache Kafka (Strimzi-based) for distributed event streaming |
KRaft cluster with 3 brokers that stores and distributes CDC events with replication, topics, HTTP bridge, and metrics exporter |
Debezium |
Open source Change Data Capture (CDC) platform that captures database changes |
PostgreSQL connector that reads the WAL and publishes each INSERT/UPDATE/DELETE as an event to Kafka topics in real time |
Apicurio Registry |
Open source Schema Registry that manages and validates data schemas (Avro, JSON Schema, Protobuf) |
Registers and versions CDC event schemas, ensuring compatibility between producers and consumers |
Apache Camel + Kaoto |
Integration framework implementing Enterprise Integration Patterns, with a low-code visual designer |
Consumes CDC events from Kafka, applies content-based routing, and sends email notifications via Mailpit |
OpenShift Integration Operator |
Community OperatorHub operator: Kaoto in the OpenShift console, ephemeral Quick Try, GitOps promote, MCP/AI |
Installs in |
SonataFlow |
Serverless workflow engine (evolution of Kogito/jBPM) that runs cloud-native business processes |
Orchestrates customer onboarding: validation, classification, approvals with SLA, and parallel provisioning |
Red Hat Developer Hub |
Self-service developer portal based on Backstage, with a component catalog and plugins |
Kafka plugin to visualize consumer group offsets and lag directly on entity pages |
Grafana + Service Mesh |
Observability stack: metric dashboards (Grafana), automatic mTLS, and traffic visualization (Kiali) |
"Kafka CDC Pipeline" dashboard with throughput, lag, and latency; Istio ambient mode for mTLS without sidecars |
OpenShift DevSpaces |
Cloud-native IDE based on Eclipse Che, with ephemeral workspaces and pre-configured extensions |
Workspace with Kaoto pre-installed to visually design Apache Camel routes and SonataFlow workflows |
OpenShift Lightspeed |
AI assistant integrated into the OpenShift console with MCP tools for diagnostics |
55+ MCP tools for pipeline troubleshooting: query Kafka, Debezium, connector, and pod status |
Keycloak |
Enterprise Identity and Access Management (IAM) based on OAuth 2.0 / OIDC standards |
SSO authentication for all demo services (Console, Developer Hub, Grafana, etc.) |
NeuroFace (Computer Vision) |
Facial recognition application with LBPH + OpenVINO Model Server (face-detection-retail-0005) |
Registers faces via webcam, detects people, and publishes events to the Kafka topic |
OpenVINO Model Server (OVMS) |
Intel inference server deployed as a KServe InferenceService on OpenShift AI |
Serves the |
CV Processor (Python) |
Python microservice that polls OVMS and NeuroFace, producing and consuming Kafka events |
Publishes |
Environment access
-
Kafka Console:
https://kafka-console-kafka-cdc. -
Apicurio Registry:
https://apicurio-registry-kafka-cdc. -
Kafka Bridge (REST):
https://kafka-bridge-kafka-cdc. -
Grafana:
https://grafana-observability. -
Developer Hub:
https://backstage-developer-hub-developer-hub. -
DevSpaces (Kaoto):
https://devspaces. -
NeuroFace:
https://neuroface-neuroface. -
OpenShift AI:
https://data-science-gateway. -
Mailpit:
https://n8n-mailpit-openshift-lightspeed.
Required Red Hat subscriptions
| Product / Subscription | Documentation |
|---|---|
Red Hat OpenShift Container Platform |
|
Red Hat Streams for Apache Kafka |
|
Red Hat build of Debezium |
|
Red Hat build of Apicurio Registry |
|
Red Hat build of Apache Camel |
|
Red Hat Developer Hub |
|
Red Hat OpenShift Dev Spaces |
|
Red Hat OpenShift Service Mesh |
|
Red Hat OpenShift Lightspeed |
|
Red Hat OpenShift Serverless Logic |
|
Red Hat build of Keycloak |
|
Red Hat OpenShift GitOps |
|
Red Hat OpenShift Pipelines |
|
Red Hat OpenShift Serverless |
|
Cluster Observability Operator |
|
Red Hat OpenShift distributed tracing |
|
Grafana Operator |
|
Red Hat OpenShift AI |
Community operators in this lab
| Operator | Why it is here |
|---|---|
OpenShift Integration Operator |
OperatorHub community catalog ( |