๐๏ธ Quickstart - AI Orchestration
Orkes Conductor provides you the ability to build applications that leverage generative AI models and vector databases easily. In this quickstart guide we will show you how you can build such an application and we will demonstrate how you can do it using command line or with the UI that comes with Orkes Conductor. For more information about the AI Orchestration capabilities in Orkes Conductor, please refer to the announcement blog.
๐๏ธ Passing Inputs to Tasks in Conductor
When you start a Conductor workflow, you can pass inputs to the workflow - which can be used as parameters for various steps in the workflow. As the tasks progress in a workflow - each task will create its own outputs. So how can this data from previous tasks be used in the steps succeeding it? In Conductor, data can be passed to a task in different ways, such as from workflow inputs/outputs, prior task inputs/outputs, variables, and secrets.
๐๏ธ Using LLMs in your Orkes Conductor Workflows
In this guide, weโll provide an overview of Generative AI, Large Language Models (LLMs), and how Orkes makes it easy to leverage the power of LLMs natively in their applications. Whether youโre a developer, product manager, or anyone interested in Gen-AI powering your business logic, this guide will help you understand the concepts and get started with AI-powered tasks in Orkes Conductor.
๐๏ธ Using Vector Databases in your Orkes Conductor Workflows
In this guide, weโll provide an overview of Vector Databases and how Orkes makes it easy for developers to use Vector DBs for AI tasks in their applications. We will go through the concepts, where and how vector DBs add capabilities for your AI-powered applications, and how to get started.
๐๏ธ Creating & Managing Gen-AI Prompt Templates
In this guide, weโll provide a quick overview of Generative AI Prompt Templates and how Orkes makes it easy to leverage the power of Large Language Models (LLMs) natively in their applications.
๐๏ธ Unit and Regression Testing Workflows
Unit Tests
๐๏ธ Integration with CI/CD
Conductor workflows are the core part of your application and should be versioned, controlled, and released similarly to the code.
๐๏ธ Scheduling Workflows
Often we want to trigger a workflow at a specific schedule. Orkes Conductor platform supports this natively. The workflows can be configured to be triggered at any cadence as required using the crontab expression.
๐๏ธ Webhook Integration
Webhooks are user-driven HTTP callback functions that facilitate the connection between Orkes Conductor and other third-party systems. Webhook sends data from one system to another when an event occurs. By leveraging Webhooks, workflows can be built to act on events outside the Conductor environment. You can also trigger other workflows in Conductor based on the received Webhook events.
๐๏ธ Write Workflows Using Code
Workflows can be written in code, allowing the creation of dynamic workflows that can't be pre-defined. Support for defining workflows using code is part of all the supported SDKs.
๐๏ธ Human Task
Human tasks are used when you need to pause your workflow for an interaction with a human. When your workflow reaches the human task, it waits for a manual interaction to proceed with the workflow.
๐๏ธ Debugging Workflows
Orkes Conductor provides a visual representation of workflows that aids in quickly troubleshooting issues. Conductor UI provides us with the ability to look into workflow executions which helps in quickly spotting and resolving issues.
๐๏ธ Routing Tasks (Task to Domain)
Typically, for each configured task type - Conductor server will maintain a queue and will distribute task work to all the
๐๏ธ Using Secrets in Conductor
Often, we have requirements where sensitive values are used in workflows. In such situations, secrets can be
๐๏ธ Guide to Scaling Workers
Workers are responsible for executing business logic in the workflow applications. Scaling and performance tuning workers are dependent on the following metrics:
๐๏ธ Azure Service Bus Integration
This document describes how to configure an instance of Azure Service Bus to talk to Conductor for publishing and consuming events.
๐๏ธ Event Handler
An event handler is a way for us to receive messages into the Conductor. An event can be directed to do one of the following things:
๐๏ธ Orkes Conductor Dashboard - Metrics & Observability
The Orkes Conductor Dashboard gives a quick overview of the metrics & alerts on your Conductor console. It provides a centralized intuitive interface to track and get insights on the behavior and performance of tasks and workflows that can aid in troubleshooting errors.
๐๏ธ Monitoring Task Queues
The task queues are the collection of tasks waiting to be executed. It is useful for viewing the details, such as the number of workers polling and monitoring the queue backlog.
๐๏ธ Workflow Versions at Runtime
The Conductor workflow can be versioned, which means you can have multiple versions of the same workflow.
๐๏ธ Task and Workflow Status in Conductor
The status of the task and workflow is crucial while debugging a workflow from UI. You can look into the workflow and task status to understand the current state of the workflow to identify any potential issues or errors.
๐๏ธ Orkes Template Explorer
Orkes Template Explorer offers a versatile collection of pre-designed templates designed to streamline your enterprise's processes. These templates are not only ready to use right out of the box but also highly customizable to align seamlessly with your specific enterprise needs.
๐๏ธ Sending Signals to Workflows
In certain scenarios, there might arise a need to transmit signals to workflows for purposes such as pausing, terminating, or restarting them. There are different ways through which you can achieve this.
๐๏ธ Event Streaming with Azure Event Hub
Streamlining the monitoring and management of tasks and workflows is vital in orchestration. With Orkes Conductor, you can publish and consume task and workflow status change stream events by integrating with the powerful event streaming platform Azure Event Hub.