GoogleCloudAiplatformV1GenerationConfigThinkingConfig

import type { GoogleCloudAiplatformV1GenerationConfigThinkingConfig } from "https://googleapis.deno.dev/v1/aiplatform:v1.ts";

Configuration for the model's thinking features. "Thinking" is a process where the model breaks down a complex task into smaller, manageable steps. This allows the model to reason about the task, plan its approach, and execute the plan to generate a high-quality response.

interface GoogleCloudAiplatformV1GenerationConfigThinkingConfig {

includeThoughts?: boolean;

thinkingBudget?: number;

thinkingLevel?: "THINKING_LEVEL_UNSPECIFIED" | "LOW" | "HIGH";

}

§Properties

includeThoughts?: boolean

[src]

Optional. If true, the model will include its thoughts in the response. "Thoughts" are the intermediate steps the model takes to arrive at the final response. They can provide insights into the model's reasoning process and help with debugging. If this is true, thoughts are returned only when available.

thinkingBudget?: number

[src]

Optional. The token budget for the model's thinking process. The model will make a best effort to stay within this budget. This can be used to control the trade-off between response quality and latency.

thinkingLevel?: "THINKING_LEVEL_UNSPECIFIED" | "LOW" | "HIGH"

[src]

Optional. The number of thoughts tokens that the model should generate.