Table of Contents

Class EmbeddingModelContext

Namespace
FoundationaLLM.Gateway.Models
Assembly
FoundationaLLM.Gateway.dll

Provides context associated with an embedding model.

public class EmbeddingModelContext
Inheritance
EmbeddingModelContext
Inherited Members
Extension Methods

Constructors

EmbeddingModelContext(ConcurrentDictionary<string, EmbeddingOperationContext>, ILogger<EmbeddingModelContext>)

Provides context associated with an embedding model.

public EmbeddingModelContext(ConcurrentDictionary<string, EmbeddingOperationContext> embeddingOperations, ILogger<EmbeddingModelContext> logger)

Parameters

embeddingOperations ConcurrentDictionary<string, EmbeddingOperationContext>

The global dictionary of EmbeddingOperationContext objects indexed by operation identifier.

logger ILogger<EmbeddingModelContext>

The ILogger used for logging.

Properties

DeploymentContexts

A list of EmbeddingModelDeploymentContext objects providing contexts for the available deployments for the model.

public List<EmbeddingModelDeploymentContext> DeploymentContexts { get; set; }

Property Value

List<EmbeddingModelDeploymentContext>

ModelName

The name of the embedding model.

public required string ModelName { get; set; }

Property Value

string

Methods

AddEmbeddingOperationContext(EmbeddingOperationContext)

public void AddEmbeddingOperationContext(EmbeddingOperationContext embeddingOperationContext)

Parameters

embeddingOperationContext EmbeddingOperationContext

ProcessOperations(CancellationToken)

Processes embedding operations in a continuous loop.

public Task ProcessOperations(CancellationToken cancellationToken)

Parameters

cancellationToken CancellationToken

Notifies that the operation must be cancelled.

Returns

Task