Cohere Integration with Orkes Conductor

To use system AI tasks in Orkes Conductor, you must integrate your Conductor cluster with the necessary AI/LLM providers. This guide explains how to integrate Cohere with Orkes Conductor. Here’s an overview:

1. Get the required credentials from Cohere.
2. Configure a new Cohere integration in Orkes Conductor.
3. Add models to the integration.
4. Set access limits to the AI model to govern which applications or groups can use them.

Step 1: Get the Cohere credentials

To integrate Cohere with Orkes Conductor, retrieve the API key and endpoint from the Cohere console. You can choose between Trial or Production keys, depending on your environment.

note

A production key requires a paid subscription.

To get the Trial API key:

1. Sign in to the Cohere console.
2. Go to Platform > API Keys from the left menu.
3. In Trial keys, select + New Trial key.

4. Enter a Key Name, and select Generate Trial key.

5. Copy and store the generated key.

To get the Production API key:

1. Sign in to the Cohere console.
2. Go to Platform > API Keys from the left menu.
3. In Production keys, select + New Production key.

4. Enter a Key Name, and select Generate Production key.

5. Copy and store the generated key.

The default API endpoint for Cohere is https://api.cohere.ai/v1. Use this as the API endpoint when configuring the integration.

Step 2: Add an integration for Cohere

After obtaining the credentials, add a Cohere integration to your Conductor cluster.

To create a Cohere integration:

1. Go to Integrations from the left navigation menu on your Conductor cluster.
2. Select + New integration.
3. In the AI/LLM section, choose Cohere.
4. Select + Add and enter the following parameters:

Parameters	Description
Integration name	A name for the integration.
API Key	The trial or production API key copied previously from the Cohere console.
API Endpoint	Use the default API endpoint for Cohere, which is https://api.cohere.ai/v1.
Description	A description of the integration.

5. (Optional) Toggle the Active button off if you don’t want to activate the integration instantly.
6. Select Save.

Step 3: Add Cohere models

Once you’ve integrated Cohere, the next step is to configure specific models.

Cohere has different models, such as command, command-r, embed, and more, each designed for various use cases. Choose the model that best fits your use case.

To add a model to the Cohere integration:

1. Go to the Integrations page and select the + button next to the integration created.

2. Select + New model.
3. Enter the Model name and a Description. Get the complete list of Cohere models.

4. (Optional) Toggle the Active button off if you don’t want to activate the model instantly.
5. Select Save.

This saves the model for future use in AI tasks within Orkes Conductor.

Step 4: Set access limits to integration

Once the integration is configured, set access controls to manage which applications or groups can use the models.

To provide access to an application or group:

1. Go to Access Control > Applications or Groups from the left navigation menu on your Conductor cluster.
2. Create a new group/application or select an existing one.
3. In the Permissions section, select + Add Permission.
4. In the Integration tab, select the required AI models and toggle the necessary permissions.
5. Select Add Permissions.

The group or application can now access the AI model according to the configured permissions.

With the integration in place, you can now create workflows using AI/LLM tasks.

More resources

• Using AI Models or LLMs
• Using Vector Databases
• Using AI Prompts
• AI Orchestration Tutorials