Event-Driven Architecture Live

Welcome

Explore a complete Change Data Capture (CDC) pipeline running on Red Hat OpenShift with Streams for Apache Kafka, Debezium, Apache Camel, SonataFlow, and Apicurio Registry.

What You’ll Learn

  • Deploy a Kafka cluster in KRaft mode (without Zookeeper) using AMQ Streams

  • Configure Debezium to capture changes in PostgreSQL in real time

  • Use Apicurio Registry as a Schema Registry for event validation

  • Design integration routes visually with Kaoto inside DevSpaces

  • Monitor the pipeline with Grafana dashboards and Service Mesh (Kiali)

  • Manage Kafka from Developer Hub with the Kafka plugin

  • Use Lightspeed (MCP) for pipeline troubleshooting

Pipeline Components

Component What it is Role in this demo

Streams for Apache Kafka

Enterprise distribution of Apache Kafka (Strimzi-based) for distributed event streaming

KRaft cluster with 3 brokers that stores and distributes CDC events with replication, topics, HTTP bridge, and metrics exporter

Debezium

Open source Change Data Capture (CDC) platform that captures database changes

PostgreSQL connector that reads the WAL and publishes each INSERT/UPDATE/DELETE as an event to Kafka topics in real time

Apicurio Registry

Open source Schema Registry that manages and validates data schemas (Avro, JSON Schema, Protobuf)

Registers and versions CDC event schemas, ensuring compatibility between producers and consumers

Apache Camel + Kaoto

Integration framework implementing Enterprise Integration Patterns, with a low-code visual designer

Consumes CDC events from Kafka, applies content-based routing, and sends email notifications via Mailpit

SonataFlow

Serverless workflow engine (evolution of Kogito/jBPM) that runs cloud-native business processes

Orchestrates customer onboarding: validation, classification, approvals with SLA, and parallel provisioning

Red Hat Developer Hub

Self-service developer portal based on Backstage, with a component catalog and plugins

Kafka plugin to visualize consumer group offsets and lag directly on entity pages

Grafana + Service Mesh

Observability stack: metric dashboards (Grafana), automatic mTLS, and traffic visualization (Kiali)

"Kafka CDC Pipeline" dashboard with throughput, lag, and latency; Istio ambient mode for mTLS without sidecars

OpenShift DevSpaces

Cloud-native IDE based on Eclipse Che, with ephemeral workspaces and pre-configured extensions

Workspace with Kaoto pre-installed to visually design Apache Camel routes and SonataFlow workflows

OpenShift Lightspeed

AI assistant integrated into the OpenShift console with MCP tools for diagnostics

55+ MCP tools for pipeline troubleshooting: query Kafka, Debezium, connector, and pod status

Keycloak

Enterprise Identity and Access Management (IAM) based on OAuth 2.0 / OIDC standards

SSO authentication for all demo services (Console, Developer Hub, Grafana, etc.)

NeuroFace (Computer Vision)

Facial recognition application with LBPH + OpenVINO Model Server (face-detection-retail-0005)

Registers faces via webcam, detects people, and publishes events to the Kafka topic cv.face.detections

OpenVINO Model Server (OVMS)

Intel inference server deployed as a KServe InferenceService on OpenShift AI

Serves the face-detection-retail-0005 model (FP16) via REST/gRPC for face detection

CV Processor (Python)

Python microservice that polls OVMS and NeuroFace, producing and consuming Kafka events

Publishes person_registered and ovms_model_status events, sends email alerts via Mailpit

Required Red Hat subscriptions

Product / Subscription Documentation

Red Hat OpenShift Container Platform

OpenShift Container Platform 4.20

Red Hat Streams for Apache Kafka

Streams for Apache Kafka

Red Hat build of Debezium

Red Hat build of Debezium

Red Hat build of Apicurio Registry

Apicurio Registry

Red Hat build of Apache Camel

Apache Camel

Red Hat Developer Hub

Developer Hub

Red Hat OpenShift Dev Spaces

OpenShift Dev Spaces

Red Hat OpenShift Service Mesh

OpenShift Service Mesh

Red Hat OpenShift Lightspeed

OpenShift Lightspeed

Red Hat OpenShift Serverless Logic

OpenShift Serverless

Red Hat build of Keycloak

Red Hat build of Keycloak

Red Hat OpenShift GitOps

OpenShift GitOps (ArgoCD)

Red Hat OpenShift Pipelines

OpenShift Pipelines (Tekton)

Red Hat OpenShift Serverless

OpenShift Serverless (Knative)

Cluster Observability Operator

Cluster Observability Operator

Red Hat OpenShift distributed tracing

OpenShift distributed tracing (OpenTelemetry)

Grafana Operator

Grafana via Cluster Observability

Red Hat OpenShift AI

OpenShift AI