This is the multi-page printable view of this section. Click here to print.

Return to the regular view of this page.

Motifs

What is a Motif?

A Motif is an aggregation of configurations specifically designed for Generative AI (GenAI) applications. These settings include connection details for Large Language Model (LLM) providers, knowledge base connections, policy information, and user access control details.

Organizations can create Motifs to establish comprehensive policy controls for security, trust, compliance, and cost management across its GenAI applications or abstracted APIs.

Once a Motif is created, the following features are available:

  • An API definition is provided that can be used to integrate your GenAI application with Motific.ai. This enables the application to apply the policies set within the Motif to each inference.
  • You can also set cost controls by setting a token budget for your Motif. With this token budget you can define a percentage warning threshold for token usage by a Motif, which will provide a warning when the budget is exceeded.
  • You can also get information and patterns related to the prompts sent via a Motif to the LLMs. With Motific.ai, you can now accurately measure the time saved by users when they utilize the Gen AI assistant for a task. Time-saving is demonstrated through various tasks that users typically engage in, such as reading, writing, searching, or reviewing for specific details. These metrics allow you to discover how Gen AI assistants enable productivity within your organization. Moreover, Motific.ai offers model optimization options, allowing you to compare the performance of your chosen AI model with other providers based on parameters like delay, cost, and quality of replies.

Pre-requisites

  1. Sign up with Motific.ai.

  2. Log in to your Motific.ai account using your credentials. Or add a user with Admin credentials.

Before creating a Motif

To get started with Motific.ai you need to provision Motifs, which enable developers to use AI models with applied policies. Before creating a Motif, it is a recommended you set up the following as per your requirement:

Features

In the Motifs menu, you can perform the following actions:

1 - Create Motifs

Create a Motif

In this section, we show you how to create a Motif and configure the advanced Motif options like KB’s, policies, and access control, that can get you one step closer to provisioning GenAI apps for your users.

To create a new Motif, follow the steps below:

Required steps

Motif options

Step 1: Motif details

  1. To create a Motif, click on the Motifs menu on the left navigation bar.

  2. Next, click on the Create a new Motif button on the upper-right side corner.

    Create Motif

  3. Enter a Motif name. This field is mandatory.


Step 2: Model connection

Select a model connection

The existing model connections can be viewed in the dropdown. If you do not have a model connection, then create a new model connection. Once you have created a new model connection or have existing model connections, it’s time to select a model for your Motif.

  • To choose a model connection, click on the drop-down. The newly added and previously configured model connections are displayed in the drop-down.

  • Select the connection you want to add.

  • Next, choose a model connection from the drop-down that can connect to the Motif. Depending on the model provider, different models are listed in the drop down.

    add llm

Add a new model connection

If you do not wish to use existing model connections or want to connect to a new LLM provider, then you can create a new model connection.

add model

  1. To add a new model connection, click on the Create a new model connection link.

  2. A new browser tab with the page to add a model connection open. add model

  3. To start creating a model connection, provide a connection name.

  4. Select an LLM provider to connect to from the drop-down. Provide the necessary credentials for Motific.ai to connect to it.

  5. Provide the respective model provider API key. This is necessary for motific to connect to the provider.

    • AWS Bedrock- To connect to an AWS bedrock model, Provide Access key and Secret key. Both the credentials are required to connect to the AWS Bedrock provider. The access key and secret key can be found on your AWS IAM portal.

      add model

      • Follow the steps below to choose models for this AWS Bedrock connection will have access to:

      • To add a model, click the Add model button.

        add model

      • Select a model from the drop-down list.

        add model

      • Enter the Access URL. The Access URL of your Bedrock model. This can be found on your Bedrock dashboard. For example: https://bedrock.us-east-1.amazonaws.com

      • To add the model, click Add model.

    • Mistral- Provide API key to connect to the Mistral models.

      • For Mistral model the models are displayed automatically
      • Here you can select the model that you want the connection to have access to.
    • Azure OpenAI- Provide API key to connect to the Azure OpenAI models.

      • Follow the steps below to add the deployments and choose that models will have access to the Azure OpenAI connection:

      • To add a deployment, click the Add deployment button.

        alt text

      • Select a model from the drop-down list.

        alt text

      • Enter the deployment URL for your Azure OpenAI model.

      • To add the deployment, click Add deployment.

  6. To test the connection, click the Test connection button.

  7. Once you are done adding the details, click the Add connection button.


Step 3: Knowledge base (KB)

Selecting a KB

The existing KB connections can be viewed in the dropdown. If you do not have a KB connection, then create a new KB connection. Once you have created a new KB connection or have existing KB connections, it’s time to select a KB for your Motif.

  • To choose a knowledge base, click on the drop-down. The newly added and the existing knowledge base connections are displayed in the drop-down.

  • Select the knowledge base you want to add.

Add a new KB

If you have not already created a knowledge base, then follow the steps below to create a knowledgebase:

  1. To create a new knowledge base (KB) connection, click on the Create new knowledge base link. add KB

  2. A new browser window with the page to create a new KB opens. add KB

  3. Enter a unique name for your KB. Optionally, provide a description for your KB.

  1. Next, add data sources for your KB. You have the option of adding one or multiple of the following two data sources:
    • Add SharePoint: SharePoint sites where you have different files and folders that can be the data source for the knowledgebase.
    • Add website: Public websites are the websites available on the general internet. These websites can be added as data sources to a KB.
Add SharePoint

A SharePoint can be a website or a secure place to store, organize, share, and access information from any device. It can also consist of folders with various files.

  • To add a SharePoint as a data source, click the Add SharePoint option.

  • Provide the URL for the SharePoint site that you want to add.

  • Enter the source path- the path to the folder or document library you want to index.

  • Provide a Data source name for your SharePoint data source. add KB

  • Enter the Azure app ID for the site.

  • Enter the Azure tenant ID for the site.

  • Enter the Certificate thumbprint for the SharePoint site.

  • Provide Certificate PEM (Privacy Enhanced Mail). Drag and drop or click on the drop area to upload the PEM certificate. add KB

  • Define a schedule of how often the data source should be updated by selecting an option from the drop-down. You have the following options:

    • One-Time - The data source sync begins as soon the KB is created.
    • Weekly- Specify the day of the week and time of the day when the data source should be updated with any new content.
    • Monthly- Specify the day of the month and time of the day when the data source should be updated with any new content.
    • Daily- Specify the time of the day when the data source should be updated with any new content.
  • Verify all the details, then to add the data source, click the Add SharePoint button.

  • When you are done adding the data source(s), you can view the details of the data source added in the knowledge base summary section. You can also delete the data sources in the summary section by clicking the red delete icon.
Add public website

Public websites are the websites available on the general internet. These websites can be added as data sources to a KB.

  • To add a website as a data source, click the Add Website button. add ws
  • Provide the source URL for the website that you want to add.
  • Provide a name and description for your website.
  • Verify all the details, then to add the data source, click the Add public website button.
  • When you are done adding the data source(s), you can view the details of the data source added in the knowledge base summary section. You can also delete the data sources in the summary section by clicking the red delete icon.

  • Click the Create Knowledgebase button to add the data sources to the knowledge base.


Step 4: Policies

Choose policies

The existing policy can be viewed in the dropdown. If you do not have a KB connection then create a new KB connection Once you have created a new policy or have existing policy, it’s time to select a policy for your Motif.

  • To choose a policy, click on the drop-down. The newly added and existing policies are displayed in the drop-down.

  • Select the policy base you want to add. add policy

Add a policy

  1. To define a policy, click on the Create a new policy link. add ws

  2. A new browser tab with the page to create a new policy opens. add ws

  3. Provide identification information for the new policy.

  4. Next, choose from the policy template displayed:

Adversarial content

An adversarial content policy can block attempts to exploit AI models through prompt injections, SQL query injection, and security threats, ensuring safe interactions.

You can define the policy with an action that Motific.ai should perform when it detects that a prompt is injected with adversarial or harmful content. This policy also examines and blocks the output from a model that contains any adversarial or harmful content. The actions that Motific.ai can take are Pass the prompt and out or Block it.

  • To define adversarial content policy, select the Adversarial content template.

  • The following categories are available for you to define policies over:

    • Adversarial- The adversarial category is triggered when the content of a prompt tries to deceive a LLM with harmful input. Select a policy action for Motific.ai to perform when it identifies that the prompt or a model output contains adversarial content.

    • Harmful- This category is triggered when a prompt contains hate speech, profanity, or self-harm content. Select a policy action for Motific.ai to perform when it detects that the prompt passed contains harmful content.

    • SQL injection- This category is triggered when an input contains SQL code intended to manipulate data. Select a policy action for Motific.ai to perform when it detects that the prompt or a model output is injected with SQL content i.e., SQL queries.

    • XSS injection- The XSS injection, also known as a cross-site scripting attack it is triggered when an input contains malicious scripts. Select a policy action for Motific.ai to perform when it detects that the prompt or a model output is injected with XSS content i.e., malicious scripts.

    • Context switch- This category is triggered when a prompt contains content that signals a LLM to change the topic or type of content that it is generating. Select a policy action for Motific.ai to perform when it detects that the prompt or a model output is injected with context switching content.

    • DAN (Do anything now)- The DAN category is triggered when the input contains open-ended master instructions that could potentially lead LLM to generate outputs without clear ethical or safety boundaries. Select a policy action for Motific.ai to perform when it identifies that the prompt or a model output is injected with a master prompt.

Toxic content

Toxic content policy helps you enforce guidelines for toxic (umbrella term for rude, offensive content) and unsafe content. It ensures interactions with any LLMs are free from racism, sexism, and other harmful behaviors.

Here, you can set actions for when Motific.ai identifies that a prompt contains ethically wrong and unsafe content, such as hate, violence, self-harm, or sexual etc. The actions that Motific.ai can take are Pass or Block the PII.

  • To set toxic content actions, select the Toxic content option.

  • The following categories are available for you to define policies over:

    • Violence- Select a policy action such as Pass or Block that Motific.ai can perform when it detects that the prompt contains content describing violence.

    • Self-harm- Select a policy action such as Pass or Block that Motific.ai can perform when it detects that the prompt contains content that describes or is related to self-harm.

    • Hate- Select a policy action such as Pass or Block that Motific.ai can perform when it detects that the prompt contains hateful or fairness-related harmful content.

    • Sexual- Select a policy action to perform for when Motific.ai detects that the prompt or inference response contains sexually explicit content.

Malicious URL

Malicious URL and data protection policy prohibits the injection of harmful URLs, protecting the chat interface from cybersecurity risks.

Here, you can select the action that Motific.ai should perform when it detects that a prompt contains deliberately malicious, sensitive data theft, or data poisoning content. The actions that Motific.ai can take are Pass or Block the malicious content from reaching the model.

  • To define malicious URL policy, select the Malicious URL option.
  • The following malicious URL and data protection content categories are available for you to define policies over:
    • Malicious URL- Malicious URLs are unsafe URLs that, if undetected, can cause phishing attacks, etc. Select a policy action for Motific.ai to perform when it detects that a prompt is injected with malicious URL(s).

Off-topic content

Off-topic content policy, when set, helps keep conversations focused and relevant, preventing misuse of chatbots for unintended purposes.

Here, you can set actions for when Motific.ai identifies that a prompt or a model output contains content from the restricted/unintended topics that you define within Motific.ai. You are provided with fields where you can define the topic names that are considered to be off-topic or restricted while interacting with an LLM. For example, topics like dating, vacation, travel, gaming etc., are topics that an organization may regard as irrelevant to the users to be productive.

For each topic you can define an action of block or warn when Motific.ai detects these topics in a prompt, that prompt can either be blocked from getting an inference from an LLM or can be passed to an LLM. Off-topic detection when set also examines the output of a model i.e., an LLM response for any restricted topic content. And depending on the action set, Motific.ai takes the next course of action. This helps ensure that the interaction with the GenAI apps is within the organization’s values and ethics.

The actions that Motific.ai can take are Warn or Block the off-topic content.

  • To set off-topic detection policy actions, select the Off-topic content template.
  • You can see the pre-populated fields, you can either keep the same topics or edit them add customized topics want to list as off-topic.
  • Enter the off-topic names and what action needs to be taken.

PII content

PII (Personally identifiable information) content policy prevents the sharing of sensitive personal information with LLMs to safeguard user privacy.

Here, you define an action that Motific.ai should perform, when it detects that a prompt contains any or all the PII entities. This helps safeguard user’s privacy from unauthorized access and breaches. The actions that Motific.ai can take are Pass, Block, or Redact the PII. By default, the action is set to Pass for each category.

  • To define PII content, select the PII content option.

  • The following PII categories are available for you to define policies over:

    • Credit cards- Select a policy action to perform when Motific.ai detects that the prompt or inference response contains credit card numbers.
    • Email address- Select a policy action to perform when Motific.ai detects that the prompt or inference response contains email addresses.
    • Person- Select a policy action to perform when Motific.ai detects that the prompt or inference response contains a person’s details like first name, last name.
    • Phone numbers- Select a policy action to perform when Motific.ai detects that the prompt contains a US phone number.
    • Location- Select a policy action to perform when Motific.ai detects that the prompt or inference response contains a locations details like address, country, etc.
    • US social security numbers- Select a policy action to perform when Motific.ai detects that the prompt contains US social security number(s).

Code presence

Code presence policy ensures the prompt is scanned for any vulnerable code.

Here you can set actions for when Motific.ai identifies that a prompt sent to a model, or an inference output form a model contains code in coding languages such as Python, Java, or JavaScript. The actions that Motific.ai can take are Pass or Block the insecure code.

Once you are done adding the details and selecting the policies, click Save policy button.


Step 5: Access control

As a part of the access control for a Motif, Motific.ai provides an option to add users or user groups to a Motif. Provisioning access allows you to share the Motif with specific users or groups.

Add users

  1. To add new individual users to provision access to a Motif, click on the Users dropdown. The list of users added to your organization’s tenant are displayed.

  2. Select the users, or alternatively you can search for the users, click on the user you want to provision access to. You can add multiple users.

  3. Once you add new users to provision access to the Motif, or if you have previously added users, then you can see them in the field below.

  4. Alternatively, you can remove the users, click on the cross button on the users and they no longer have access to the Motif.

Add groups

  1. To add new user groups to provision access to a Motif, click on the Users dropdown. The list of user groups added to your organization’s tenant are displayed.

  2. Select the user groups, or alternatively you can search for the groups, click on the group you want to provision access to. You can add multiple groups.

  3. Once you add new user groups to provision access to the Motif, or if you have previously added user groups, then you can see them in the field below.

  4. Alternatively, you can remove the user groups, click on the cross button on the user group and they no longer have access to the Motif.

Step 6: Add Motif

  1. Verify that you have added all the configurations to the Motif you want to create in the Motif summary section.

  2. Once you are done verifying, to create the Motif, click Add Motif button.

2 - Update Motifs

Update Motifs

The Motif that you created can be viewed in the Motifs page. The Motifs are in the list view.

  1. To update a Motif, click on Motif name or alternatively click on the overflow menu (three dots) at the end of the Motif card view or in the Actions column of the list view.

  2. Select the Edit option.You are taken to the Motif details tab.

  3. Here you can view the previously configured Motif details.

    • Edit Motif name- Click on the Edit button to edit a Motif name.
    • Once you are done editing the name, click the Save button.
  4. Next, you can edit the model connections.

    • Edit model connection- Click on the Edit button to edit a model connection.
    • You can edit the model connection, model, or create a new model connection. Click the Save button to save the update.
  5. Next, you can edit knowledge base.

    • Edit knowledge base- Click on the Edit button to edit a knowledge base.
    • You can choose a different knowledge base or create a new knowledge base. Click the Save button to save the update.
  6. Next, you can edit policies.

    • Edit policies- Click on the Edit button to edit a policies.
    • You can choose different policies or create new policies to choose. Click the Save button to save the update.
  7. Next, you can edit users or user groups.

    • Edit users or user groups- Click on the Edit button icon to edit a users or user groups.
    • You can choose different users or user groups. You can also remove the current users and groups from having the access to the Motif. Click the Save button to save the update.

3 - Delete Motifs

Delete Motifs

  1. To delete a Motif, click on the overflow menu (three dots) at the end of a Motif card view or in the Actions column in list view.

  2. Select Delete option.

  3. A confirmation screen opens up cautioning you that deleting a Motif is irreversible, and asks you type in the word DELETE in the field provided for confirmation. The word should match the word presented for the delete button to be active.

  4. To delete a Motif, click Delete. Once you delete a Motif you cannot view it in the list or grid view.

4 - Manage Motifs

Manage Motif details

When a Motif is created, it is displayed on the Motifs page. Here, at a glance you can view the Motif’s name, model connection, the policies attached to the Motif and the user who added to the Motif.

Motif details

After creating a Motif, you are brought to the Motif details screen. This screen includes variety of metrics which are associated with that Motif.

Also, you can manage the Motif from here as well. You can set token budget for your Motif, such that once the budget is exceeded the users a warning is displayed.

Alternatively, you can follow the steps below to view any Motif details:

  1. To view a Motif’s details, click on the Motif name, or alternatively overflow menu (three dots) at the end of the Motif’s card view, or in the Actions column of the list view.
  2. Select the Edit option.
  3. Here you can view the existing Motif details. In Motif details tab, you can update the Motif.
  4. The Motif summary section gives a quick look at the all the configurations that have been made, you can view which model connection, policies, data soureces for KB, and users/user groups you have added.

Motif summary

Motif summary is a section that holds the summary of each configuration you made while creating a Motif. At a glance you can observe which model connection, knowledge base, policies, users/user groups you have added to a Motif.

KB summary

The knowledge base (KB) summary section is present while creating a Motif and in the Motif details tab when a Motif is created. To view the knowledge base summary follow thes steps below:

  1. To view the knowledge base summary added to a Motif, click the KB name in the Motif summary section.

  2. Here, you can see the Name and URL of the KB added.

  3. When you are done viewing the details, you can close the pop-up window.

Policies summary

The policies summary section is present while creating a Motif and in the Motif details tab for a existing Motif.

To view the policies summary follow thes steps below:

  1. To view the policies summary added to a Motif, click the policy name in the Motif summary section.

  2. Here, you can see the policy that is added as well as what are actions defined in the policy at one glance.

  3. When you are done viewing the details, you can close the pop-up window.

Other Motif details

There are also following tabs containing details associated with a Motif:

Token budget

In the Token budget tab, you can set the Motif token budget, and see the graphical representation of the token usage for the previous month. Also, you can check the token-budget for each task category that the users are performing, like text summarization, code generation etc., using the Gen AI application. You can also view the trends for token-budget change for different categories.

When the Motif has exceeded its total token budget, and the user sends a prompt via that Motif, then the prompts get blocked and are not processsed until next budget period when token budget is refreshed.

Set Motif token budget

When you create a Motif you can set the Motif token budget for a period of time, for example, monthly, weekly, yearly, or quarterly. The token budget will be applicable for the set time period.

To set Motific.ai token budget follow the steps below:

  1. Navigate to the Motif menu, click on the Motif for which you want to set the token budget. If you have not created a Motif, then create a new Motif.
  2. Go to the Cost tab of the Motif details.
  3. Click on the Set budget button.
  4. Enter the total token budget that you would like to set for the Motif. The total token budget encompasses both input tokens for user input, and the output tokens from the model after an inference.
  5. To set the percentage for the warning token threshold, adjust the slider.
  6. Select a time period for which this budget is enforced from the dropdown. For example, monthly, weekly, yearly, or quarterly .
  7. You can also view the token used.
  8. Click Update budget. You can see the graph for the token usage forthe previous month is populated with the real time data.

Update Motif token budget

To update Motific.ai token budget follow the steps below:

  1. Navigate to the Motif menu, click on the Motif for which you want to set the token budget. If you have not created a Motif, then create a new Motif.
  2. Go to the Cost tab of the Motif details. You can view the budget that has already been set.
  3. Click on the pencil icon.
  4. Now you can edit the total token budget, warning threshold and the time period for the budget.
  5. Click Update budget. You can see the graph for the token usage for previous month is populated with the real time data.

API definition

In the API definition tab, you can see the essential elements that are necessary for connecting your Gen AI app with the Motific.ai API endpoint.

The following details are displayed:

  • API base URL: This is the initial part of the API URL. The API endpoint requests should use this as the base URL for all the calls.
  • Token: This is the authentication token (Bearer token) that should be passed with each API request. The request will not be authorized to access the Motif and hence the LLMs if this token is not passed.
  • Sample cURL: This is a sample cURL command that you can use to test the Motif.

5 - User groups

The User group tab allows you to add user groups where you can add individual users. The user groups created here can be used in the access provision section while creating a Motif. When you add a user group to a Motif all the users within the group get access to that Motif.

Create a new user group

To create a user group, follow the steps below:

  1. Navigate to the Motif menu, go to the User group tab.

  2. Enter a group name.

  3. Click Create group.

  4. A page with an option to add users opens.

  5. To add users to the group, click Add users.

  6. A pop-up with the list of all the users that you have added to your organization’s tenant are displayed.

  7. Select the users that you want to add and click Add user

Update a user group

A previously created user group can be edited, users can be added and deleted from the group and the group can be updated.

To update a user group, follow the steps below:

  1. Navigate to the Motif menu, go to the User group tab.
  2. The user groups you have created are displayed in the list view or grid view, and you can toggle between the two views.
  3. To update a user group, click on user group name or alternatively click on the overflow menu (three dots) at the end of the group card view or in the Actions column of the list view and click Edit.
  4. Next, you can view the details of the user group. You can view the name and email and other details associated with the group.
  5. Here you can add users or delete users from the group.

Delete a user group

To delete a user group, follow the steps below:

  1. Navigate to the Motif menu, go to the User group tab.

  2. The user groups you have created are displayed in the list view.

  3. To delete a user group, click on the overflow menu (three dots) at the end in the Actions column and click the Delete button.

  4. If there are users present in the user group you wish to delete, then you will see the below pop-up. This screen prompts you to deleet the users first.

  5. To delete all the users in the user group, click the Delete group users button. All the users are deleted once you click this button.

  6. A confirmation screen opens up cautioning you that deleting a user group is irreversible, and asks you type in the word DELETE in the field provided for confirmation. The word should match the word presented for the delete button to be active.

  1. To delete a user group, click Delete.