Class TextExtractionDataPipelineStagePlugin

Namespace

FoundationaLLM.Plugins.DataPipeline.Plugins.DataPipelineStage

Assembly

FoundationaLLM.DataPipelinePlugins.dll

Implements the Text Extraction Data Pipeline Stage Plugin.

public class TextExtractionDataPipelineStagePlugin : DataPipelineStagePluginBase, IDataPipelineStagePlugin

Inheritance

object

PluginBase

DataPipelineStagePluginBase

TextExtractionDataPipelineStagePlugin

Implements

IDataPipelineStagePlugin

Inherited Members

DataPipelineStagePluginBase._dataPipelineStateService

DataPipelineStagePluginBase._hasher

DataPipelineStagePluginBase.GetStageWorkItems(DataPipelineDefinition, DataPipelineRun, List<string>, string, string)

DataPipelineStagePluginBase.ComputeHash(string)

PluginBase._pluginParameters

PluginBase._packageManager

PluginBase._packageManagerResolver

PluginBase._pluginMetadata

PluginBase._serviceProvider

PluginBase._logger

object.Equals(object)

object.Equals(object, object)

object.GetHashCode()

object.GetType()

object.MemberwiseClone()

object.ReferenceEquals(object, object)

object.ToString()

Extension Methods

ObjectExtensions.GetPropertyValues(object, List<string>)

Constructors

TextExtractionDataPipelineStagePlugin(Dictionary<string, object>, IPluginPackageManager, IPluginPackageManagerResolver, IServiceProvider)

Implements the Text Extraction Data Pipeline Stage Plugin.

public TextExtractionDataPipelineStagePlugin(Dictionary<string, object> pluginParameters, IPluginPackageManager packageManager, IPluginPackageManagerResolver packageManagerResolver, IServiceProvider serviceProvider)

Parameters

pluginParameters Dictionary<string, object>

The dictionary containing the plugin parameters.

packageManager IPluginPackageManager

The package manager for the plugin.

packageManagerResolver IPluginPackageManagerResolver

The package manager resolver for the plugin.

serviceProvider IServiceProvider

The service provider of the dependency injection container.

Properties

Name

protected override string Name { get; }

Property Value

string

Methods

GetStartingStageWorkItems(DataPipelineDefinition, DataPipelineRun, List<DataPipelineContentItem>, string)

Gets the list of data pipeline work items based on the provided content items.

public override Task<List<DataPipelineRunWorkItem>> GetStartingStageWorkItems(DataPipelineDefinition dataPipelineDefinition, DataPipelineRun dataPipelineRun, List<DataPipelineContentItem> contentItems, string dataPipelineStageName)

Parameters

dataPipelineDefinition DataPipelineDefinition

The definition of the data pipeline.

dataPipelineRun DataPipelineRun

The data pipeline run.

contentItems List<DataPipelineContentItem>

The list of content items.

dataPipelineStageName string

The name of the data pipeline stage.

Returns

Task<List<DataPipelineRunWorkItem>>

A list of data pipeline work items.

ProcessWorkItem(DataPipelineDefinition, DataPipelineRun, DataPipelineRunWorkItem)

Processes a specified data pipeline run work item.

public override Task<PluginResult> ProcessWorkItem(DataPipelineDefinition dataPipelineDefinition, DataPipelineRun dataPipelineRun, DataPipelineRunWorkItem dataPipelineRunWorkItem)

Parameters

dataPipelineDefinition DataPipelineDefinition

The definition of the data pipeline associated with the data pipeline run work item.

dataPipelineRun DataPipelineRun

The data pipeline run associated with the data pipeline run work item.

dataPipelineRunWorkItem DataPipelineRunWorkItem

The data pipeline run work item to process.

Returns

Task<PluginResult>

An object that contains the processing result.