Enabling CDC (Change Data Capture)

In Orkes Conductor, Change Data Capture (CDC) allows you to send workflow state changes to external eventing systems such as Kafka. This enables downstream systems to react to workflow state changes in real time, making it easier to build responsive and decoupled architectures.

Configuring CDC parameters

Prerequisites

Before configuring CDC, make sure the required message broker is integrated with the Conductor cluster.

You can configure CDC using the workflow JSON definition or Conductor UI.

Using workflow JSON

To enable CDC:

1. Go to Definitions > Workflow from the left navigation menu on your Conductor cluster.
2. Create a new workflow or select an existing one.
3. Add the following parameters to the workflow definition code:

Parameter	Description
workflowStatusListenerEnabled	Set to true to enable CDC.
workflowStatusListenerSink	The event sink in the format: message-broker-type:integration-name:topic/queue-name where, message-broker-type–The message broker type where the payloads are sent. Supported types: amqp sqs azure kafka nats gcppubsub Ibm_mq integration-name–The message broker integration name added to the cluster. topic/queue-name–The queue name or topic name where the payloads are sent.

Example

// workflow definition

"workflowStatusListenerEnabled": true,
"workflowStatusListenerSink": "message-broker-type:integration-name:topic/queue-name" // event sink

4. Save the workflow.

Using Conductor UI

To enable CDC:

1. Go to Definitions > Workflow from the left navigation menu on your Conductor cluster.
2. Create a new workflow or select an existing one.
3. In Workflow tab, switch on Workflow status listener enabled.

4. In Workflow listener sink, select the required integration already added to the cluster.
5. Enter the topic or queue name manually into the sink.

For example, if you have added an AMQP integration named amqp-test, it appears in the drop-down list of available integrations as follows:

Select the integration and enter the queue name to update the workflow listener sink as follows:

"workflowStatusListenerSink": "amqp:amqp-test:queue-name"

6. Save the workflow.

Verifying CDC events

When the workflow starts, Conductor emits an event each time its state changes—for example, when it transitions from the RUNNING state to any other state. These events are delivered in real time to the configured eventing system. Verify the message delivery under the configured topic or queue name.