Table of Contents

Interface IOrchestrationService

Namespace
FoundationaLLM.Orchestration.Core.Interfaces
Assembly
FoundationaLLM.Orchestration.Core.dll

Interface for the Orchestration Service

public interface IOrchestrationService
Extension Methods

Methods

GetCompletion(string, CompletionRequest)

Retrieve a completion from the configured orchestration service.

Task<CompletionResponse> GetCompletion(string instanceId, CompletionRequest completionRequest)

Parameters

instanceId string

The FoundationaLLM instance id.

completionRequest CompletionRequest

The completion request.

Returns

Task<CompletionResponse>

The completion response.

GetCompletionOperationStatus(string, string)

Gets the status of a completion operation.

Task<LongRunningOperation> GetCompletionOperationStatus(string instanceId, string operationId)

Parameters

instanceId string

The FoundationaLLM instance id.

operationId string

The OperationId for which to retrieve the status.

Returns

Task<LongRunningOperation>

Returns an LongRunningOperation object containing the OperationId and Status.

GetStatus(string)

Get the aggredated status of all orchestration services.

Task<ServiceStatusInfo> GetStatus(string instanceId)

Parameters

instanceId string

The FoundationaLLM instance id.

Returns

Task<ServiceStatusInfo>

The status of the orchestration service.

StartCompletionOperation(string, CompletionRequest)

Begins a completion operation.

Task<LongRunningOperation> StartCompletionOperation(string instanceId, CompletionRequest completionRequest)

Parameters

instanceId string

The FoundationaLLM instance id.

completionRequest CompletionRequest

The completion request containing the user prompt and message history.

Returns

Task<LongRunningOperation>

Returns an LongRunningOperation object containing the OperationId and Status.