Uses of Interface
com.google.cloud.aiplatform.v1.SpeculativeDecodingSpec.NgramSpeculationOrBuilder

Packages that use SpeculativeDecodingSpec.NgramSpeculationOrBuilder

Package	Description
com.google.cloud.aiplatform.v1

Uses of SpeculativeDecodingSpec.NgramSpeculationOrBuilder in com.google.cloud.aiplatform.v1

Classes in com.google.cloud.aiplatform.v1 that implement SpeculativeDecodingSpec.NgramSpeculationOrBuilder

Modifier and Type	Class and Description
static class	SpeculativeDecodingSpec.NgramSpeculation N-Gram speculation works by trying to find matching tokens in the previous prompt sequence and use those as speculation for generating new tokens.
static class	SpeculativeDecodingSpec.NgramSpeculation.Builder N-Gram speculation works by trying to find matching tokens in the previous prompt sequence and use those as speculation for generating new tokens.

Methods in com.google.cloud.aiplatform.v1 that return SpeculativeDecodingSpec.NgramSpeculationOrBuilder

Modifier and Type	Method and Description
SpeculativeDecodingSpec.NgramSpeculationOrBuilder	SpeculativeDecodingSpec.getNgramSpeculationOrBuilder() N-Gram speculation.
SpeculativeDecodingSpec.NgramSpeculationOrBuilder	SpeculativeDecodingSpec.Builder.getNgramSpeculationOrBuilder() N-Gram speculation.
SpeculativeDecodingSpec.NgramSpeculationOrBuilder	SpeculativeDecodingSpecOrBuilder.getNgramSpeculationOrBuilder() N-Gram speculation.