Skip to content

Ai_Cf_Meta_Llama_3_3_70B_Instruct_Fp8_Fast_Output

Ai_Cf_Meta_Llama_3_3_70B_Instruct_Fp8_Fast_Output = { response: string; tool_calls?: object[]; usage?: { completion_tokens?: number; prompt_tokens?: number; total_tokens?: number; }; } | string | AsyncResponse

Defined in: .pnpm-home/store/v11/links/@cloudflare/workers-types/4.20251118.0/2891147a4db443bf13ca098dcb7381fb6bac5793758b7fd187ebaf5bc0deb969/node_modules/@cloudflare/workers-types/index.ts:5019

{ response: string; tool_calls?: object[]; usage?: { completion_tokens?: number; prompt_tokens?: number; total_tokens?: number; }; }

response: string

The generated text response from the model

optional tool_calls: object[]

An array of tool calls requests made during the response generation

optional usage: object

Usage statistics for the inference request

optional completion_tokens: number

Total number of tokens in output

optional prompt_tokens: number

Total number of tokens in input

optional total_tokens: number

Total number of input and output tokens

string

AsyncResponse