Class EmbeddingModelContext
- Namespace
- FoundationaLLM.Gateway.Models
- Assembly
- FoundationaLLM.Gateway.dll
Provides context associated with an embedding model.
public class EmbeddingModelContext
- Inheritance
-
EmbeddingModelContext
- Inherited Members
- Extension Methods
Constructors
EmbeddingModelContext(ConcurrentDictionary<string, EmbeddingOperationContext>, ILogger<EmbeddingModelContext>)
Provides context associated with an embedding model.
public EmbeddingModelContext(ConcurrentDictionary<string, EmbeddingOperationContext> embeddingOperations, ILogger<EmbeddingModelContext> logger)
Parameters
embeddingOperations
ConcurrentDictionary<string, EmbeddingOperationContext>The global dictionary of EmbeddingOperationContext objects indexed by operation identifier.
logger
ILogger<EmbeddingModelContext>The ILogger used for logging.
Properties
DeploymentContexts
A list of EmbeddingModelDeploymentContext objects providing contexts for the available deployments for the model.
public List<EmbeddingModelDeploymentContext> DeploymentContexts { get; set; }
Property Value
ModelName
The name of the embedding model.
public required string ModelName { get; set; }
Property Value
Methods
AddEmbeddingOperationContext(EmbeddingOperationContext)
public void AddEmbeddingOperationContext(EmbeddingOperationContext embeddingOperationContext)
Parameters
embeddingOperationContext
EmbeddingOperationContext
ProcessOperations(CancellationToken)
Processes embedding operations in a continuous loop.
public Task ProcessOperations(CancellationToken cancellationToken)
Parameters
cancellationToken
CancellationTokenNotifies that the operation must be cancelled.