Namespace FoundationaLLM.Common.Models.Orchestration.Direct
Classes
- AssistantCompletionMessage
Assistant input message for a direct orchestration request.
- AzureAICompletionInputData
Input data for a direct request to an Azure AI model.
- AzureAICompletionParameters
Supported model configuration parameters.
- AzureAICompletionRequest
Input for a direct Azure AI request.
- AzureAICompletionResponse
The response from the Azure AI orchestration service.
- AzureOpenAICompletionParameters
Supported model configuration parameters.
- AzureOpenAICompletionRequest
Input for a direct Azure OpenAI request.
- AzureOpenAICompletionResponse
The response from the Azure OpenAI orchestration service.
- AzureOpenAICompletionResponseChoice
The completion response choice.
- CompletionMessage
Object defining the completion role and content key value pairs.
- CompletionUsage
Contains the usage statistics for a completion.
- LogitBias
Modify the likelihood of specified tokens appearing in the completion. Accepts a json object that maps tokens (specified by their token ID in the GPT tokenizer) to an associated bias value from -100 to 100. You can use this tokenizer tool (which works for both GPT-2 and GPT-3) to convert text to token IDs. Mathematically, the bias is added to the logits generated by the model prior to sampling. The exact effect varies per model, but values between -1 and 1 should decrease or increase likelihood of selection; values like -100 or 100 should result in a ban or exclusive selection of the relevant token. As an example, you can pass {"50256": -100} to prevent the endoftext token from being generated.
- SystemCompletionMessage
System input message for a direct orchestration request.
- ToolCompletionMessage
Tool input message for a direct orchestration request.
- UserCompletionMessage
User input message for a direct orchestration request.