Uses of Interface
com.google.cloud.vertexai.api.SpeculativeDecodingSpec.DraftModelSpeculationOrBuilder

Uses of SpeculativeDecodingSpec.DraftModelSpeculationOrBuilder in com.google.cloud.vertexai.api

Classes in com.google.cloud.vertexai.api that implement SpeculativeDecodingSpec.DraftModelSpeculationOrBuilder

Modifier and Type	Class and Description
static class	SpeculativeDecodingSpec.DraftModelSpeculation Draft model speculation works by using the smaller model to generate candidate tokens for speculative decoding.
static class	SpeculativeDecodingSpec.DraftModelSpeculation.Builder Draft model speculation works by using the smaller model to generate candidate tokens for speculative decoding.

Methods in com.google.cloud.vertexai.api that return SpeculativeDecodingSpec.DraftModelSpeculationOrBuilder

Modifier and Type	Method and Description
SpeculativeDecodingSpec.DraftModelSpeculationOrBuilder	SpeculativeDecodingSpec.getDraftModelSpeculationOrBuilder() draft model speculation.
SpeculativeDecodingSpec.DraftModelSpeculationOrBuilder	SpeculativeDecodingSpec.Builder.getDraftModelSpeculationOrBuilder() draft model speculation.
SpeculativeDecodingSpec.DraftModelSpeculationOrBuilder	SpeculativeDecodingSpecOrBuilder.getDraftModelSpeculationOrBuilder() draft model speculation.