AsyncBatch
Defined in: node_modules/.pnpm/@cloudflare+workers-types@4.20250823.0/node_modules/@cloudflare/workers-types/index.ts:4250
Properties
Section titled “Properties”requests?
Section titled “requests?”
optionalrequests:object[]
Defined in: node_modules/.pnpm/@cloudflare+workers-types@4.20250823.0/node_modules/@cloudflare/workers-types/index.ts:4251
external_reference?
Section titled “external_reference?”
optionalexternal_reference:string
User-supplied reference. This field will be present in the response as well it can be used to reference the request and response. It’s NOT validated to be unique.
frequency_penalty?
Section titled “frequency_penalty?”
optionalfrequency_penalty:number
Decreases the likelihood of the model repeating the same lines verbatim.
max_tokens?
Section titled “max_tokens?”
optionalmax_tokens:number
The maximum number of tokens to generate in the response.
presence_penalty?
Section titled “presence_penalty?”
optionalpresence_penalty:number
Increases the likelihood of the model introducing new topics.
prompt?
Section titled “prompt?”
optionalprompt:string
Prompt for the text generation model
repetition_penalty?
Section titled “repetition_penalty?”
optionalrepetition_penalty:number
Penalty for repeated tokens; higher values discourage repetition.
response_format?
Section titled “response_format?”
optionalresponse_format:JSONMode
optionalseed:number
Random seed for reproducibility of the generation.
stream?
Section titled “stream?”
optionalstream:boolean
If true, the response will be streamed back incrementally using SSE, Server Sent Events.
temperature?
Section titled “temperature?”
optionaltemperature:number
Controls the randomness of the output; higher values produce more random results.
top_p?
Section titled “top_p?”
optionaltop_p:number
Adjusts the creativity of the AI’s responses by controlling how many possible words it considers. Lower values make outputs more predictable; higher values allow for more varied and creative responses.