Class SemanticCacheService

Namespace

FoundationaLLM.Orchestration.Core.Services

Assembly

FoundationaLLM.Orchestration.Core.dll

Provides a service for managing the semantic cache.

public class SemanticCacheService : ISemanticCacheService

Inheritance

object

SemanticCacheService

Implements

ISemanticCacheService

Inherited Members

object.Equals(object)

object.Equals(object, object)

object.GetHashCode()

object.GetType()

object.MemberwiseClone()

object.ReferenceEquals(object, object)

object.ToString()

Extension Methods

ObjectExtensions.GetPropertyValues(object, List<string>)

Constructors

SemanticCacheService(IAzureCosmosDBService, IEnumerable<IResourceProviderService>, IConfiguration, ILogger<SemanticCacheService>)

Initializes a new instance of the SemanticCacheService class.

public SemanticCacheService(IAzureCosmosDBService cosmosDBService, IEnumerable<IResourceProviderService> resourceProviderServices, IConfiguration configuration, ILogger<SemanticCacheService> logger)

Parameters

cosmosDBService IAzureCosmosDBService

The IAzureCosmosDBService service providing access to the Cosmos DB vector store.

resourceProviderServices IEnumerable<IResourceProviderService>

A list of IResourceProviderService resource providers hashed by resource provider name.

configuration IConfiguration

The IConfiguration used to retrieve app settings from configuration.

logger ILogger<SemanticCacheService>

The logger used for logging..

Methods

GetCompletionResponseFromCache(string, string, CompletionRequest)

Tries to get a CompletionResponse from the semantic cache for the specified agent in the specified FoundationaLLM instance.

public Task<CompletionResponse?> GetCompletionResponseFromCache(string instanceId, string agentName, CompletionRequest completionRequest)

Parameters

instanceId string

The unique identifier of the FoundationaLLM instance.

agentName string

The name of the agent.

completionRequest CompletionRequest

The CompletionRequest for which to get the cache item.

Returns

Task<CompletionResponse>

A CompletionResponse if a match exists.

HasCacheForAgent(string, string)

Determines whether the semantic cache for the specified agent in the specified FoundationaLLM instance exists.

public bool HasCacheForAgent(string instanceId, string agentName)

Parameters

instanceId string

The unique identifier of the FoundationaLLM instance.

agentName string

The name of the agent.

Returns

bool

if the semantic cache for the specified agent exists, otherwise.

InitializeCacheForAgent(string, string, AgentSemanticCacheSettings)

Initializes the semantic cache for the specified agent in the specified FoundationaLLM instance.

public Task InitializeCacheForAgent(string instanceId, string agentName, AgentSemanticCacheSettings agentSettings)

Parameters

instanceId string

The unique identifier of the FoundationaLLM instance.

agentName string

The name of the agent.

agentSettings AgentSemanticCacheSettings

The AgentSemanticCacheSettings providing the agent's semantic cache settings.

Returns

Task

ResetCacheForAgent(string, string)

Resets the semantic cache for the specified agent in the specified FoundationaLLM instance.

public Task ResetCacheForAgent(string instanceId, string agentName)

Parameters

instanceId string

The unique identifier of the FoundationaLLM instance.

agentName string

The name of the agent.

Returns

Task

SetCompletionResponseInCache(string, string, CompletionResponse)

Sets a CompletionResponse in the semantic cache for the specified agent in the specified FoundationaLLM instance.

public Task SetCompletionResponseInCache(string instanceId, string agentName, CompletionResponse completionResponse)

Parameters

instanceId string

The unique identifier of the FoundationaLLM instance.

agentName string

The name of the agent.

completionResponse CompletionResponse

The CompletionResponse to be set in the agent's cache.

Returns

Task