com.google.cloud.vertexai.api

Interface SpeculativeDecodingSpecOrBuilder

All Superinterfaces:

com.google.protobuf.MessageLiteOrBuilder, com.google.protobuf.MessageOrBuilder

All Known Implementing Classes:

SpeculativeDecodingSpec, SpeculativeDecodingSpec.Builder

public interface SpeculativeDecodingSpecOrBuilder
extends com.google.protobuf.MessageOrBuilder

Method Summary

Modifier and Type	Method and Description
SpeculativeDecodingSpec.DraftModelSpeculation	getDraftModelSpeculation() draft model speculation.
SpeculativeDecodingSpec.DraftModelSpeculationOrBuilder	getDraftModelSpeculationOrBuilder() draft model speculation.
SpeculativeDecodingSpec.NgramSpeculation	getNgramSpeculation() N-Gram speculation.
SpeculativeDecodingSpec.NgramSpeculationOrBuilder	getNgramSpeculationOrBuilder() N-Gram speculation.
SpeculativeDecodingSpec.SpeculationCase	getSpeculationCase()
int	getSpeculativeTokenCount() The number of speculative tokens to generate at each step.
boolean	hasDraftModelSpeculation() draft model speculation.
boolean	hasNgramSpeculation() N-Gram speculation.

Methods inherited from interface com.google.protobuf.MessageOrBuilder

findInitializationErrors, getAllFields, getDefaultInstanceForType, getDescriptorForType, getField, getInitializationErrorString, getOneofFieldDescriptor, getRepeatedField, getRepeatedFieldCount, getUnknownFields, hasField, hasOneof

Methods inherited from interface com.google.protobuf.MessageLiteOrBuilder

isInitialized

Method Detail

hasDraftModelSpeculation

boolean hasDraftModelSpeculation()

 draft model speculation.
 

.google.cloud.vertexai.v1.SpeculativeDecodingSpec.DraftModelSpeculation draft_model_speculation = 2;

Returns:

Whether the draftModelSpeculation field is set.

getDraftModelSpeculation

SpeculativeDecodingSpec.DraftModelSpeculation getDraftModelSpeculation()

 draft model speculation.
 

.google.cloud.vertexai.v1.SpeculativeDecodingSpec.DraftModelSpeculation draft_model_speculation = 2;

Returns:

The draftModelSpeculation.

getDraftModelSpeculationOrBuilder

SpeculativeDecodingSpec.DraftModelSpeculationOrBuilder getDraftModelSpeculationOrBuilder()

 draft model speculation.
 

.google.cloud.vertexai.v1.SpeculativeDecodingSpec.DraftModelSpeculation draft_model_speculation = 2;

hasNgramSpeculation

boolean hasNgramSpeculation()

 N-Gram speculation.
 

.google.cloud.vertexai.v1.SpeculativeDecodingSpec.NgramSpeculation ngram_speculation = 3;

Returns:

Whether the ngramSpeculation field is set.

getNgramSpeculation

SpeculativeDecodingSpec.NgramSpeculation getNgramSpeculation()

 N-Gram speculation.
 

.google.cloud.vertexai.v1.SpeculativeDecodingSpec.NgramSpeculation ngram_speculation = 3;

Returns:

The ngramSpeculation.

getNgramSpeculationOrBuilder

SpeculativeDecodingSpec.NgramSpeculationOrBuilder getNgramSpeculationOrBuilder()

 N-Gram speculation.
 

.google.cloud.vertexai.v1.SpeculativeDecodingSpec.NgramSpeculation ngram_speculation = 3;

getSpeculativeTokenCount

int getSpeculativeTokenCount()

 The number of speculative tokens to generate at each step.
 

int32 speculative_token_count = 1;

Returns:

The speculativeTokenCount.

getSpeculationCase

SpeculativeDecodingSpec.SpeculationCase getSpeculationCase()