Interface IDataPipelineStagePlugin

Namespace

FoundationaLLM.Common.Interfaces.Plugins

Assembly

FoundationaLLM.Common.dll

Defines the interface for a data pipeline stage plugin.

public interface IDataPipelineStagePlugin

Extension Methods

ObjectExtensions.GetPropertyValues(object, List<string>)

Methods

GetStageWorkItems(List<string>, string, string, string)

Gets the list of data pipeline work items based on the provided content items canonical identifiers.

Task<List<DataPipelineRunWorkItem>> GetStageWorkItems(List<string> contentItemsCanonicalIds, string dataPipelineRunId, string dataPipelineStageName, string previousDataPipelineStageName)

Parameters

contentItemsCanonicalIds List<string>

The list of icontent items canonical identifiers.

dataPipelineRunId string

The unique identifier of the data pipeline run.

dataPipelineStageName string

The name of the data pipeline stage.

previousDataPipelineStageName string

The name of the previous data pipeline stage.

Returns

Task<List<DataPipelineRunWorkItem>>

A list of data pipeline work items.

GetStartingStageWorkItems(List<DataPipelineContentItem>, string, string)

Gets the list of data pipeline work items based on the provided content items.

Task<List<DataPipelineRunWorkItem>> GetStartingStageWorkItems(List<DataPipelineContentItem> contentItems, string dataPipelineRunId, string dataPipelineStageName)

Parameters

contentItems List<DataPipelineContentItem>

The list of content items.

dataPipelineRunId string

The unique identifier of the data pipeline run.

dataPipelineStageName string

The name of the data pipeline stage.

Returns

Task<List<DataPipelineRunWorkItem>>

A list of data pipeline work items.

ProcessWorkItem(DataPipelineDefinition, DataPipelineRun, DataPipelineRunWorkItem)

Processes a specified data pipeline run work item.

Task<PluginResult> ProcessWorkItem(DataPipelineDefinition dataPipelineDefinition, DataPipelineRun dataPipelineRun, DataPipelineRunWorkItem dataPipelineRunWorkItem)

Parameters

dataPipelineDefinition DataPipelineDefinition

The definition of the data pipeline associated with the data pipeline run work item.

dataPipelineRun DataPipelineRun

The data pipeline run associated with the data pipeline run work item.

dataPipelineRunWorkItem DataPipelineRunWorkItem

The data pipeline run work item to process.

Returns

Task<PluginResult>

An object that contains the processing result.