Hi there! Are you looking for the official Deno documentation? Try docs.deno.com for all your Deno learning needs.

GoogleCloudAiplatformV1SpeculativeDecodingSpec

import type { GoogleCloudAiplatformV1SpeculativeDecodingSpec } from "https://googleapis.deno.dev/v1/aiplatform:v1.ts";

Configuration for Speculative Decoding.

interface GoogleCloudAiplatformV1SpeculativeDecodingSpec {
draftModelSpeculation?: GoogleCloudAiplatformV1SpeculativeDecodingSpecDraftModelSpeculation;
ngramSpeculation?: GoogleCloudAiplatformV1SpeculativeDecodingSpecNgramSpeculation;
speculativeTokenCount?: number;
}

§Properties

§
speculativeTokenCount?: number
[src]

The number of speculative tokens to generate at each step.