Class LLMOrchestrationServiceManager

Namespace

FoundationaLLM.Orchestration.Core.Services

Assembly

FoundationaLLM.Orchestration.Core.dll

Manages internal and external orchestration services.

public class LLMOrchestrationServiceManager : ILLMOrchestrationServiceManager

Inheritance

object

LLMOrchestrationServiceManager

Implements

ILLMOrchestrationServiceManager

Inherited Members

object.Equals(object)

object.Equals(object, object)

object.GetHashCode()

object.GetType()

object.MemberwiseClone()

object.ReferenceEquals(object, object)

object.ToString()

Extension Methods

ObjectExtensions.GetPropertyValues(object, List<string>)

Constructors

LLMOrchestrationServiceManager(IOptions<InstanceSettings>, IEnumerable<IResourceProviderService>, IConfiguration, ILogger<LLMOrchestrationServiceManager>)

Creates a new instance of the LLM Orchestration Service Manager.

public LLMOrchestrationServiceManager(IOptions<InstanceSettings> instanceOptions, IEnumerable<IResourceProviderService> resourceProviderServices, IConfiguration configuration, ILogger<LLMOrchestrationServiceManager> logger)

Parameters

instanceOptions IOptions<InstanceSettings>

The options providing the InstanceSettings with instance settings.

resourceProviderServices IEnumerable<IResourceProviderService>

A list of IResourceProviderService resource providers.

configuration IConfiguration

The IConfiguration used to retrieve configuration values.

logger ILogger<LLMOrchestrationServiceManager>

The logger for the orchestration service manager.

Methods

GetAggregateStatus(string, IServiceProvider)

Gets an aggregate initialization status based on the initialization status of each subordinate orchestration service.

public Task<List<ServiceStatusInfo>> GetAggregateStatus(string instanceId, IServiceProvider serviceProvider)

Parameters

instanceId string

The FoundationaLLM instance ID.

serviceProvider IServiceProvider

The IServiceProvider provding dependency injection services for the current scope.

Returns

Task<List<ServiceStatusInfo>>

GetService(string, string, IServiceProvider, IOrchestrationContext)

Gets an ILLMOrchestrationService instance based on the service name.

public ILLMOrchestrationService GetService(string instanceId, string serviceName, IServiceProvider serviceProvider, IOrchestrationContext callContext)

Parameters

instanceId string

The FoundationaLLM instance ID.

serviceName string

The name of the ILLMOrchestrationService to be retrieved.

serviceProvider IServiceProvider

The IServiceProvider provding dependency injection services for the current scope.

callContext IOrchestrationContext

The IOrchestrationContext call context of the request being handled.

Returns

ILLMOrchestrationService