Class AzureAIDirectService

Namespace

FoundationaLLM.Orchestration.Core.Services

Assembly

FoundationaLLM.Orchestration.Core.dll

The Azure AI direct orchestration service.

public class AzureAIDirectService : IAzureAIDirectService, ILLMOrchestrationService

Inheritance

object

AzureAIDirectService

Implements

IAzureAIDirectService

ILLMOrchestrationService

Inherited Members

object.Equals(object)

object.Equals(object, object)

object.GetHashCode()

object.GetType()

object.MemberwiseClone()

object.ReferenceEquals(object, object)

object.ToString()

Extension Methods

ObjectExtensions.GetPropertyValues(object, List<string>)

Constructors

AzureAIDirectService(IOrchestrationContext, ILogger<AzureAIDirectService>, IHttpClientFactoryService, IEnumerable<IResourceProviderService>)

The Azure AI direct orchestration service.

public AzureAIDirectService(IOrchestrationContext callContext, ILogger<AzureAIDirectService> logger, IHttpClientFactoryService httpClientFactoryService, IEnumerable<IResourceProviderService> resourceProviderServices)

Parameters

callContext IOrchestrationContext

The IOrchestrationContext providing details about the call context.

logger ILogger<AzureAIDirectService>

The logger used for logging.

httpClientFactoryService IHttpClientFactoryService

The HTTP client factory service.

resourceProviderServices IEnumerable<IResourceProviderService>

A dictionary of IResourceProviderService resource providers hashed by resource provider name.

Properties

Name

The name of the LLM orchestration service.

public string Name { get; }

Property Value

string

Methods

GetCompletion(string, LLMCompletionRequest)

Method for retrieving a completion from the orchestration service.

public Task<LLMCompletionResponse> GetCompletion(string instanceId, LLMCompletionRequest request)

Parameters

instanceId string

The FoundationaLLM instance ID.

request LLMCompletionRequest

Hub populated request object containing agent, prompt, language model, and data source information

Returns

Task<LLMCompletionResponse>

GetCompletionOperationStatus(string, string)

Gets the status of a completion operation.

public Task<LongRunningOperation> GetCompletionOperationStatus(string instanceId, string operationId)

Parameters

instanceId string

The FoundationaLLM instance id.

operationId string

The OperationId for which to retrieve the status.

Returns

Task<LongRunningOperation>

Returns an LongRunningOperation object containing the OperationId and Status.

GetStatus(string)

Get the status of the orchestration service.

public Task<ServiceStatusInfo> GetStatus(string instanceId)

Parameters

instanceId string

The FoundationaLLM instance ID.

Returns

Task<ServiceStatusInfo>

StartCompletionOperation(string, LLMCompletionRequest)

Begins a completion operation.

public Task<LongRunningOperation> StartCompletionOperation(string instanceId, LLMCompletionRequest completionRequest)

Parameters

instanceId string

The FoundationaLLM instance id.

completionRequest LLMCompletionRequest

The completion request containing the user prompt and message history.

Returns

Task<LongRunningOperation>

Returns an LongRunningOperation object containing the OperationId and Status.