Table of Contents

Class TextExtractionDataPipelineStagePlugin

Namespace
FoundationaLLM.Plugins.DataPipeline.Plugins.DataPipelineStage
Assembly
FoundationaLLM.DataPipelinePlugins.dll

Implements the Text Extraction Data Pipeline Stage Plugin.

public class TextExtractionDataPipelineStagePlugin : DataPipelineStagePluginBase, IDataPipelineStagePlugin
Inheritance
TextExtractionDataPipelineStagePlugin
Implements
Inherited Members
Extension Methods

Constructors

TextExtractionDataPipelineStagePlugin(Dictionary<string, object>, IPluginPackageManager, IServiceProvider)

Implements the Text Extraction Data Pipeline Stage Plugin.

public TextExtractionDataPipelineStagePlugin(Dictionary<string, object> pluginParameters, IPluginPackageManager packageManager, IServiceProvider serviceProvider)

Parameters

pluginParameters Dictionary<string, object>

The dictionary containing the plugin parameters.

packageManager IPluginPackageManager

The package manager for the plugin.

serviceProvider IServiceProvider

The service provider of the dependency injection container.

Properties

Name

protected override string Name { get; }

Property Value

string

Methods

GetStartingStageWorkItems(List<DataPipelineContentItem>, string, string)

Gets the list of data pipeline work items based on the provided content items.

public override Task<List<DataPipelineRunWorkItem>> GetStartingStageWorkItems(List<DataPipelineContentItem> contentItems, string dataPipelineRunId, string dataPipelineStageName)

Parameters

contentItems List<DataPipelineContentItem>

The list of content items.

dataPipelineRunId string

The unique identifier of the data pipeline run.

dataPipelineStageName string

The name of the data pipeline stage.

Returns

Task<List<DataPipelineRunWorkItem>>

A list of data pipeline work items.

ProcessWorkItem(DataPipelineDefinition, DataPipelineRun, DataPipelineRunWorkItem)

Processes a specified data pipeline run work item.

public override Task<PluginResult> ProcessWorkItem(DataPipelineDefinition dataPipelineDefinition, DataPipelineRun dataPipelineRun, DataPipelineRunWorkItem dataPipelineRunWorkItem)

Parameters

dataPipelineDefinition DataPipelineDefinition

The definition of the data pipeline associated with the data pipeline run work item.

dataPipelineRun DataPipelineRun

The data pipeline run associated with the data pipeline run work item.

dataPipelineRunWorkItem DataPipelineRunWorkItem

The data pipeline run work item to process.

Returns

Task<PluginResult>

An object that contains the processing result.