Feature flags and AI ConfigsAI Configs

Tools in AI Configs

Overview

This topic explains how to manage and use tools in AI Configs. Tools are reusable, versioned definitions that let AI Configs trigger actions you define in code. Tools allow large language models (LLMs) to retrieve data or take actions on behalf of a user. You can attach tools to variations or agents. The tools library provides a central location to maintain consistency across projects.

Benefits of tools in AI Configs

Using tools in AI Configs offers organizational and technical advantages that support consistent, auditable workflows.

Key benefits are:

  • Reuse tools across multiple variations and agents.
  • Track changes with versioned updates.
  • Maintain consistency across projects.
  • Integrate standardized actions into LLM workflows.
  • Reduce duplication, improve discoverability, and support governance and auditability.

Managing tools

You can manage tools from the Library in the left navigation of the UI or from the AI Configs variation editor.

Library

The Library appears directly under AI Configs in the left navigation. It shows a centralized list of models and tools in your project with two tabs: Models and Tools. You can manage tools from the library or in the variations editor.

Models tab

From the Models tab, you can browse existing AI model configs or create a new one.

To browse existing models:

  1. LaunchDarkly, click Library. The Models tab opens by default, showing a list of the models to use in your AI Configs.
  2. Enter text in the search bar to search for an existing model. To help you search, you can filter by type or availability. To do so, click Filters and select from the displayed options.

To create a new model:

  1. Navigate to the Library page. The Models tab opens by default.

  2. Click Add AI model config. The “Add custom model” panel appears.

    The 'Add custom model' panel.

    The 'Add custom model' panel.

  3. Name the custom model. Use this name to identify this model within LaunchDarkly. It does not map to any model properties.

  4. Select a “Provider.”

  5. Select a “Model ID.” This is the identifier for the model in the LLM provider, and must map to the model you want to use.

  6. Add the “Input token cost” and the “Output token cost.”

  7. (Optional) If you need or want to supply them, click + Add custom parameters.

  8. Click Save.

Tools tab

From the Tools tab, you can browse existing tools or create a new one.

To browse existing tools:

  1. Navigate to the Library page. The Models tab opens by default, showing a list of the models to use in your AI Configs.
  2. Click Tools.
  3. Enter text in the search bar to search for an existing tool.

To view previous versions of a tool, open the tool and click View versions.

To create a new tool:

  1. Navigate to the Library page. The Models tab opens by default.

  2. Click Tools.

  3. Click Add tool. The “Create tool” page appears.

    The 'Create tool' page.

    The 'Create tool' page.

  4. Enter a “Key” for the tool. This must be alphanumeric, but can contain underscores and hyphens.

  5. Enter a “Description” for the tool.

  6. Enter a “Schema” for the tool in the visual editor or the JSON editor.

  7. Click Save.

Variation editor

When editing an AI Configs variation, you can attach or detach tools, change tool versions, create new tools inline, and explore the tools library.

To manage tools in a variation:

  1. Navigate to the AI Configs page.

  2. Click the name of the AI Config you want to edit.

  3. Select the Variations tab. Open the variation you want to manage.

    The 'Variation' page.

    The 'Variation' page.
  • To attach or detach a tool:
    1. Click +Attach tools.
    2. Check or clear the box for the tool.
  • To change the version of a tool:
    1. Click the version number next to the name of the tool.
    2. Select a version.
  • To create a new tool:
    1. Click + Add tool. The “Create tool” page appears.
    2. Enter a “Key,” “Description,” and “Schema” for the tool.
    3. Click Save.
  • To explore the tools library:
    1. Click +Attach tools.
    2. Click Explore tools.
    3. Use the “Find a tool” panel to search for existing tools.

Use tools

To use tools with AI Configs:

  1. Create a tool in the library or from within a variation.
  2. Define the tool schema with the visual editor or the JSON editor.
  3. Attach the tool to a variation in a Completion config or an Agent config.
  4. Deploy the variation. During execution, attached tools are available for the LLM to invoke as part of completing its task.