Interface IOrchestrationService
- Namespace
- FoundationaLLM.Orchestration.Core.Interfaces
- Assembly
- FoundationaLLM.Orchestration.Core.dll
Interface for the Orchestration Service
public interface IOrchestrationService
- Extension Methods
Methods
GetCompletion(string, CompletionRequest)
Retrieve a completion from the configured orchestration service.
Task<CompletionResponse> GetCompletion(string instanceId, CompletionRequest completionRequest)
Parameters
instanceId
stringThe FoundationaLLM instance id.
completionRequest
CompletionRequestThe completion request.
Returns
- Task<CompletionResponse>
The completion response.
GetCompletionOperationStatus(string, string)
Gets the status of a completion operation.
Task<LongRunningOperation> GetCompletionOperationStatus(string instanceId, string operationId)
Parameters
instanceId
stringThe FoundationaLLM instance id.
operationId
stringThe OperationId for which to retrieve the status.
Returns
- Task<LongRunningOperation>
Returns an LongRunningOperation object containing the OperationId and Status.
GetStatus(string)
Get the aggredated status of all orchestration services.
Task<ServiceStatusInfo> GetStatus(string instanceId)
Parameters
instanceId
stringThe FoundationaLLM instance id.
Returns
- Task<ServiceStatusInfo>
The status of the orchestration service.
StartCompletionOperation(string, CompletionRequest)
Begins a completion operation.
Task<LongRunningOperation> StartCompletionOperation(string instanceId, CompletionRequest completionRequest)
Parameters
instanceId
stringThe FoundationaLLM instance id.
completionRequest
CompletionRequestThe completion request containing the user prompt and message history.
Returns
- Task<LongRunningOperation>
Returns an LongRunningOperation object containing the OperationId and Status.