Data Sources
Learn how to create and manage data sources in the Management Portal.
Overview
A data source describes where data lives and how FoundationaLLM connects to it. Data pipelines read content through a data source, and some platform services (for example, the services that use Azure Cosmos DB) resolve their connection details from a data source.
In the sidebar, select Data > Data Sources to open the Data Sources page.
Prerequisites
- To see the Create Data Source button, your account needs the Data Sources Contributor role assigned at the instance scope. See Access Control.
- The Edit and Delete actions on each row are enabled only when you have write or delete permission on that data source.
Data Sources List
The list shows all data sources you can read, ten per page (you can change the page size to 25, 50, or 100).
| Column | Description |
|---|---|
| Name | The data source name. |
| Source Type | The data source type (see Supported Data Source Types). |
| Actions | View JSON definition ({} code icon), Edit (pencil icon), and Delete (trash icon). |
Use the Search data sources box to filter by name, the refresh button to reload the list, and the column headers to sort. The search text is kept when you leave and return to the page.
Supported Data Source Types
The What is the type of the data source? dropdown offers these types:
| Type | Connection details |
|---|---|
| Azure Cosmos DB | Account endpoint and database, authenticated with Azure Identity. |
| Azure Data Lake | Azure Data Lake Storage Gen2 account and folders. |
| Azure SQL Database | Connection string and table names. |
| FoundationaLLM Context | None. Provides items from the FoundationaLLM Context service (such as files, knowledge artifacts, or code session artifacts). |
| OneLake | Microsoft Fabric OneLake account and workspaces. |
| SharePoint List | SharePoint Online site, app registration, and document libraries. |
Create a Data Source
- On the Data Sources page, select Create Data Source.
- Under What is the name of the data source?, enter:
- Data source name: Letters, numbers, dashes, and underscores only. A ✔️ means the name is available; ❌ means it is not (hover over the icon for the reason).
- Data description: Optional description.
- Under What is the type of the data source?, select a type.
- Under What are the connection details?, fill in the fields for that type (see the sections below).
- Optionally, under Would you like to assign this data source to a cost center?, enter a cost center name.
- Select Create Data Source.
If the name or type is missing, the portal shows "Please give the data source a name." or "Please specify a data source type." After a successful save, you return to the list.
To discard your changes, select Cancel and confirm with Yes in the Cancel Data Source Creation dialog.
Azure Data Lake and OneLake
Both types use the same authentication options.
| Field | When shown | Description |
|---|---|---|
| Authentication type | Always | Connection String, Account Key, or Azure Identity. |
| Connection string | Connection String | The storage connection string. Stored as a Key Vault-backed value. |
| API Key | Account Key | The storage account key. Stored as a Key Vault-backed value. |
| Endpoint | Account Key | The storage endpoint URL. |
| Account name | Azure Identity | The storage account name. |
| Folder(s) | Azure Data Lake | Folders the data source exposes. |
| Workspace(s) | OneLake | Fabric workspaces the data source exposes. |
For Folder(s) and Workspace(s), type a value and press Enter or , to add it as a chip. Select the x on a chip to remove it.
See Azure Data Lake for a step-by-step example.
Azure SQL Database
| Field | Description |
|---|---|
| Connection string | The database connection string. Stored as a Key Vault-backed value. |
| Table Name(s) | Tables the data source exposes. Press Enter or , after each name. |
Azure Cosmos DB
| Field | Description |
|---|---|
| Authentication type | Only Azure Identity is available. |
| Account endpoint | The Azure Cosmos DB account endpoint, for example https://my-account.documents.azure.com:443/. |
| Database | The Azure Cosmos DB database name. |
| Disable tracing | When enabled, tracing is disabled for Azure Cosmos DB operations. |
| Use instance ID in partition key | When enabled (the default), the FoundationaLLM instance identifier is included in container partition keys. When disabled, instanceId and instance_id entries in the partitioning strategy are ignored. |
| Partitioning strategy | A JSON object that maps container names to comma-separated partition key property paths, in hierarchy order (for example, { "<container-name>": "instanceId,sessionId" }). |
Warning: FoundationaLLM services resolve their Azure Cosmos DB connection from an Azure Cosmos DB data source (by default, the one named
Platform-Database). The partitioning settings must match how the containers were provisioned. Change them only as part of a planned deployment change.
FoundationaLLM Context
No connection details are needed. The page shows a short explanation instead of fields.
SharePoint List
| Field | Description |
|---|---|
| App ID (Client ID) | The client ID of the Microsoft Entra app registration used to read SharePoint. |
| Tenant ID | The Microsoft Entra tenant ID. |
| Certificate Name | The name of the certificate, stored in Azure Key Vault, that the app registration uses to authenticate. |
| Key Vault URL | The URL of the Key Vault that holds the certificate. |
| Site URL | The SharePoint Online site URL. |
| Document Library(s) | Document libraries the data source exposes. Press Enter or , after each name. |
See SharePoint Online for details.
Edit a Data Source
- In the list, select the Edit (pencil) icon for the data source.
- The Edit Data Source page opens with the current settings. The name cannot be changed.
- Update the settings and select Save Changes. A notification confirms the save and you stay on the page.
Manage Access to a Data Source
When editing a data source, select Access Control at the top right of the page to view and manage role assignments on that data source. See Access Control.
View the JSON Definition
Select the View JSON definition ({}) icon to open a read-only dialog titled Data Source Definition: {name} with the full resource definition.
Delete a Data Source
- Select the Delete (trash) icon for the data source.
- In the Delete Data Source dialog, select Yes to confirm, or Cancel to keep it.
Warning: Data pipelines that reference the data source can no longer read from it after it is deleted. Check your pipelines before deleting.