Class EmbeddingModelDeploymentContext

Namespace

FoundationaLLM.Gateway.Models

Assembly

FoundationaLLM.Gateway.dll

Provides context associated with an embedding model deployment.

public class EmbeddingModelDeploymentContext

Inheritance

object

EmbeddingModelDeploymentContext

Inherited Members

object.Equals(object)

object.Equals(object, object)

object.GetHashCode()

object.GetType()

object.MemberwiseClone()

object.ReferenceEquals(object, object)

object.ToString()

Extension Methods

ObjectExtensions.GetPropertyValues(object, List<string>)

Constructors

EmbeddingModelDeploymentContext(AzureOpenAIAccountDeployment, double, ILoggerFactory, GatewayMetrics)

Provides context associated with an embedding model deployment.

public EmbeddingModelDeploymentContext(AzureOpenAIAccountDeployment deployment, double tokenRateLimitMultiplier, ILoggerFactory loggerFactory, GatewayMetrics metrics)

Parameters

deployment AzureOpenAIAccountDeployment

The AzureOpenAIAccountDeployment object with the details of the model deployment.

tokenRateLimitMultiplier double

The token rate limit multiplier used to account for the tokenization differences between the Gateway API and the deployed model.

loggerFactory ILoggerFactory

The ILoggerFactory used to create loggers for logging.

metrics GatewayMetrics

The FoundationaLLM Gateway telemetry metrics.

Properties

HasInput

public bool HasInput { get; }

Property Value

bool

Methods

GetEmbeddingsForInputTextChunks()

public Task<List<EmbeddingRequestResult>> GetEmbeddingsForInputTextChunks()

Returns

Task<List<EmbeddingRequestResult>>

TryAddInputTextChunk(TextChunk, int)

public bool TryAddInputTextChunk(TextChunk textChunk, int embeddingDimensions)

Parameters

textChunk TextChunk

embeddingDimensions int

Returns

bool