Skip to main content

Integrating with Pinecone in Orkes Conductor

To effectively utilize AI and LLM tasks in Orkes Conductor, it's essential to integrate your Orkes Conductor cluster with the necessary Vector Database models.

Pinecone is a popular vector database known for its efficiency and versatility in handling large-scale vector data. This integration empowers you to access, query, and manipulate vector data effectively, enhancing the capabilities of Orkes Conductor in various natural language processing and artificial intelligence applications.

This guide will provide the steps for integrating Pinecone with Orkes Conductor.

Steps to integrate with Pinecone Database​

Before beginning to integrate with Pinecone, you need to get specific configuration parameters from the Pinecone console.

Get Configuration Credentials from Pinecone​

  1. Navigate to the Pinecone console.
  2. Create a project and note the project ID generated.

Getting Project ID from Pinecone console

  1. Navigate to API Keys and click + Create API Key.

API Key creation from Pinecone Console

  1. Provide a name for the key and click Create Key. Copy the API key generated.
  2. Next, from Indexes on the left menu, create a new index and note the environment.

Get environment name from Pinecone console

Check out Pinecone's official documentation for more details.

Integrating with Pinecone as a provider​

Now, you have the API key. Let’s integrate this with Orkes Conductor.

  1. Navigate to Integrations from the left menu on your Orkes Conductor cluster.
  2. Click +New integration button from the top-right corner.
  3. Under the Vector Databases section, choose Pinecone.
  4. Click +Add and provide the following parameters:

Create Pinecone Integration

ParametersDescription
Integration nameA name for the integration.
API KeyThe API key copied previously.
Project NameThe project ID copied previously.
EnvironmentThe environment name. Refer to the previous section on how to get the environment name.
DescriptionA description of your integration.
  1. Toggle-on the Active button to enable the model immediately.
  2. Click Save.

Adding Indexes to Pinecone Integration​

Now, you have integrated your Orkes Conductor cluster with the Pinecone provider. The next step is integrating with the specific indexes.

To add a new index to the Pinecone integration:

  1. Navigate to the integrations page and click the '+' button next to the integration you created.

Create Indexes for Pinecone Integration

  1. Click +New Index.
  2. Provide the index name and an optional description. In case your account hasn’t configured any indexes yet, check out the Pinecone documentation on how to configure indexes within your Pinecone console.

Create Indexes for Pinecone Integration Model

  1. Toggle-on the Active button to enable immediately.
  2. Click Save.

This ensures the integration model is saved for future use in LLM tasks within Orkes Conductor.

RBAC - Governance on who can use Integrations​

Now, the integration with the required models is ready. Next, we should determine the access control to these models.

The permission can be granted to applications/groups within the Orkes Conductor cluster.

To provide explicit permission to Groups:

  1. Navigate to Access Control > Groups from the left menu on your Orkes Conductor cluster.
  2. Create a new group or choose an existing group.
  3. Under the Permissions section, click +Add Permission.
  4. Under the Integrations tab, select the required integrations with the required permissions.

Add Permissions for Vector Database Integration

  1. Click Add Permissions. This ensures that all the group members can access these integration models in their workflows.

Similarly, you can also provide permissions to applications.