com.google.cloud.aiplatform.v1

Interface SpeculativeDecodingSpec.NgramSpeculationOrBuilder

All Superinterfaces:

com.google.protobuf.MessageLiteOrBuilder, com.google.protobuf.MessageOrBuilder

All Known Implementing Classes:

SpeculativeDecodingSpec.NgramSpeculation, SpeculativeDecodingSpec.NgramSpeculation.Builder

Enclosing class:

SpeculativeDecodingSpec

public static interface SpeculativeDecodingSpec.NgramSpeculationOrBuilder
extends com.google.protobuf.MessageOrBuilder

Method Summary

Modifier and Type	Method and Description
int	getNgramSize() The number of last N input tokens used as ngram to search/match against the previous prompt sequence.

Methods inherited from interface com.google.protobuf.MessageOrBuilder

findInitializationErrors, getAllFields, getDefaultInstanceForType, getDescriptorForType, getField, getInitializationErrorString, getOneofFieldDescriptor, getRepeatedField, getRepeatedFieldCount, getUnknownFields, hasField, hasOneof

Methods inherited from interface com.google.protobuf.MessageLiteOrBuilder

isInitialized

Method Detail

getNgramSize

int getNgramSize()

 The number of last N input tokens used as ngram to search/match
 against the previous prompt sequence.
 This is equal to the N in N-Gram.
 The default value is 3 if not specified.
 

int32 ngram_size = 1;

Returns:

The ngramSize.