Public Attributes
FString	Input_File_Id {}
FString	Endpoint {"/v1/chat/completions"}
FString	Completion_Window {"24h"}
TMap< FString, FString >	Metadata
FOutputExpiresAfter	Output_Expires_After

Member Data Documentation

◆ Completion_Window

FString FCreateBatch::Completion_Window {"24h"}

The time frame within which the batch should be processed. Currently only 24h is supported.

◆ Endpoint

FString FCreateBatch::Endpoint {"/v1/chat/completions"}

The endpoint to be used for all requests in the batch. Currently /v1/responses, /v1/chat/completions, /v1/embeddings, /v1/completions, /v1/moderations, /v1/images/generations, and /v1/images/edits are supported. Note that /v1/embeddings batches are also restricted to a maximum of 50,000 embedding inputs across all requests in the batch.

◆ Input_File_Id

FString FCreateBatch::Input_File_Id {}

The ID of an uploaded file that contains requests for the new batch. See upload file for how to upload a file.

Your input file must be formatted as a JSONL file, and must be uploaded with the purpose batch. The file can contain up to 50,000 requests, and can be up to 200 MB in size.

◆ Metadata

TMap<FString, FString> FCreateBatch::Metadata

Optional custom metadata for the batch.

◆ Output_Expires_After

FOutputExpiresAfter FCreateBatch::Output_Expires_After

The expiration policy for the output and/or error file generated for this batch.

The documentation for this struct was generated from the following file: