Model connections

Motific Model connections page enables you to configure model connections.

What is a model connection?

Large language models are the backbone of any Generative AI project. Motific provides standardized interfaces that integrate with our approved LLM provider.

Initially, models from the following providers are supported:

  • Azure OpenAI models
  • Mistral
  • Amazon Bedrock models

In the model connections page you can:

Create a new model conection

  1. Navigate to the Model connections page to create a new model connection.

  2. To add a new model connection, click on the Create a new model connection button.

    add model

  3. To start creating a model connection, provide a connection name.

  4. Select which LLM provider to connect to and provide the necessary credentials for Motific to connect to it from the drop-down.

    add llm

  5. Provide the respective model provider API key. This is necessary for motific to connect to the provider.

    • AWS Bedrock- To connect to a AWS bedrock model, Provide Access key and Secret key. Both the credentials are required to connect to the AWS Bedrock provider.The access key and secret key can be found on your AWS IAM portal.

      add model

      • Follow the steps below to choose models for this AWS Bedrock connection will have access to:

      • To add a model, click the Add model button.

        add model

      • Select a model from the drop-down list.

        add model

      • Enter the Access URL. The Access URL of your Bedrock model. This can be found on your Bedrock dashboard. For example: https://bedrock.us-east-1.amazonaws.com

      • To add the model, click Add model.

    • Mistral- Provide API key to connect to the Mistral models.

      • For Mistral model the models are displayed automatically
      • Here you can select the model that you want the connection to have access to.
    • Azure OpenAI- Provide API key to connect to the Azure OpenAI models.

      • Follow the steps below to add the deployments and choose that models will have access to the Azure OpenAI connection:

      • To add a deployments, click the Add deployment button.

        alt text

      • Select a model from the drop-down list.

        alt text

      • Enter the deployment URL for your Azure OpenAI model.

      • To add the deployment, click Add deployment.

  6. To test the connection, click the Test connection button.

  7. Once you are done adding the details, click the Add connection button.

Update model connections

The model connections that you created can be viewed in the model connections page, you can see the existing model connections alreadt listed (if any).

  1. To update a model connection, click on the overflow menu (three dots) at the end of the model connection card view or in the Actions column.
  2. Select the Edit option. Or alternatively click the model connection name.
  3. Here you can view the previously selected model provider details. You cannot change the previously configured LLM provider, but you can choose different models from the Models list.
  4. Here you can view the previously configured connection name.
    • Edit connection name- Click on the Edit button to edit a connection name.
    • Once you are done editing the name, click the Save button.
  5. The models or deployments are displayed based on the LLM provider selected.
    • Edit model/deployment- Click on the Edit button to edit the models/deployments.
    • You can select or unselect the models/deployments from the list or add other deployments. Click the Save button to save the updates.

Delete a model connection

  1. To delete model connection, click on the overflow menu (three dots) at the end of the model connection card view or in the Actions column.

  2. Select the Delete option.

  3. A confirmation screen opens up cautioning you that deleting an model connection is irreversible, and asks you to type in the word DELETE in the field provided for confirmation. The word should match the word presented for the delete button to be active.

  4. To delete an model connection, click Delete. Once you delete a model connection you cannot view it in the list or grid view.