Dynamic Compute

Learn how to assign dedicated custom containers to specific users for code execution.

Overview

The Dynamic Compute page ("Manage dynamic compute environments used by agents and tools.") is a preview feature. It has one tab, Custom Containers, where you configure dynamic compute environments that are dedicated to specific users.

A dedicated custom container is a container endpoint that you provision yourself (for example, an Azure Container App). When a code session uses the DedicatedCustomContainer backend, the Context API looks up the session's environment type and the signed-in user's UPN in this configuration and sends the session to that user's active endpoint. This is typically used to give a developer their own container for debugging.

The configuration is organized as:

Environments — named after a code session environment type (for example Python).
- Users — one entry per user principal name (UPN).
  - Endpoints — one or more endpoint URLs, of which one is active.

Prerequisites

The FoundationaLLM.Preview feature flag is enabled for you. Without it, Dynamic Compute does not appear in the sidebar. See Configuration.
Permission to read and write app configurations.
The custom container endpoints are deployed and reachable from the Context API.

Open the Dynamic Compute Page

Sign in to the Management Portal.
In the sidebar, select Platform > Dynamic Compute.
The Custom Containers tab opens with all environments expanded.

Add an Environment

Select Add Environment.
In Environment Name, enter the environment type, for example Python. Names must be unique.
Select Add.

To rename an environment, select its pencil button (Rename environment). To delete it, select its trash button (Remove environment) and confirm.

Add a User to an Environment

Expand the environment and select Add User.
In User Principal Name (UPN), enter the user's UPN, for example user@domain.com.
Select Add.

Each environment header shows the number of users. You can edit a UPN directly in the user's row header. Enter UPNs in lowercase; the Context API looks up the signed-in user's UPN in lowercase.

To remove a user, expand the user and select the trash button (Remove user).

Add an Endpoint for a User

Expand the user and select Add Endpoint.
In Endpoint URL, enter the container URL, for example https://ca-custom-container.azurecontainerapps.io.
Optionally select Set as active endpoint.
Select Add.

The endpoints table has these columns:

Column	Description
Active	Radio button. Only one endpoint per user is active.
Endpoint URL	The container URL
Actions	Edit (pencil) or remove (trash) the endpoint

The user row header shows a tag with the active endpoint, or No active endpoint if none is selected. A user without an active endpoint cannot use a dedicated container.

Save or Discard Changes

Select Save and confirm Save Custom Containers to write the configuration. Save is disabled when there are no changes or when a UPN is invalid.
Select Reset to discard unsaved changes.

Important

The Context API must be restarted before saved changes take effect.

Configuration Reference

The page reads and writes the App Configuration key FoundationaLLM:Code:DedicatedCustomContainers (content type application/json):

{
  "Environments": {
    "Python": {
      "UserEnvironments": {
        "user@domain.com": [
          { "Endpoint": "https://ca-custom-container.azurecontainerapps.io", "Enabled": true }
        ]
      }
    }
  }
}

Table of Contents