com.google.cloud.vertexai.api

Class PredictionServiceGrpc.PredictionServiceBlockingStub

java.lang.Object

io.grpc.stub.AbstractStub<S>

io.grpc.stub.AbstractBlockingStub<PredictionServiceGrpc.PredictionServiceBlockingStub>

com.google.cloud.vertexai.api.PredictionServiceGrpc.PredictionServiceBlockingStub

Enclosing class:

PredictionServiceGrpc

public static final class PredictionServiceGrpc.PredictionServiceBlockingStub
extends io.grpc.stub.AbstractBlockingStub<PredictionServiceGrpc.PredictionServiceBlockingStub>

A stub to allow clients to do synchronous rpc calls to service PredictionService.

 A service for online predictions and explanations.
 

Nested Class Summary

Nested classes/interfaces inherited from class io.grpc.stub.AbstractStub

io.grpc.stub.AbstractStub.StubFactory<T extends io.grpc.stub.AbstractStub<T>>

Method Summary

Modifier and Type	Method and Description
protected PredictionServiceGrpc.PredictionServiceBlockingStub	build(io.grpc.Channel channel, io.grpc.CallOptions callOptions)
DirectPredictResponse	directPredict(DirectPredictRequest request) Perform an unary online prediction request to a gRPC model server for Vertex first-party products and frameworks.
DirectRawPredictResponse	directRawPredict(DirectRawPredictRequest request) Perform an unary online prediction request to a gRPC model server for custom containers.
ExplainResponse	explain(ExplainRequest request) Perform an online explanation.
GenerateContentResponse	generateContent(GenerateContentRequest request) Generate content with multimodal inputs.
PredictResponse	predict(PredictRequest request) Perform an online prediction.
com.google.api.HttpBody	rawPredict(RawPredictRequest request) Perform an online prediction with an arbitrary HTTP payload.
Iterator<StreamingPredictResponse>	serverStreamingPredict(StreamingPredictRequest request) Perform a server-side streaming online prediction request for Vertex LLM streaming.
Iterator<GenerateContentResponse>	streamGenerateContent(GenerateContentRequest request) Generate content with multimodal inputs with streaming support.
Iterator<com.google.api.HttpBody>	streamRawPredict(StreamRawPredictRequest request) Perform a streaming online prediction with an arbitrary HTTP payload.

Methods inherited from class io.grpc.stub.AbstractBlockingStub

newStub, newStub

Methods inherited from class io.grpc.stub.AbstractStub

getCallOptions, getChannel, withCallCredentials, withChannel, withCompression, withDeadline, withDeadlineAfter, withExecutor, withInterceptors, withMaxInboundMessageSize, withMaxOutboundMessageSize, withOption, withWaitForReady

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Method Detail

build

protected PredictionServiceGrpc.PredictionServiceBlockingStub build(io.grpc.Channel channel,
                                                                    io.grpc.CallOptions callOptions)

Specified by:

build in class io.grpc.stub.AbstractStub<PredictionServiceGrpc.PredictionServiceBlockingStub>

predict

public PredictResponse predict(PredictRequest request)

 Perform an online prediction.
 

rawPredict

public com.google.api.HttpBody rawPredict(RawPredictRequest request)

 Perform an online prediction with an arbitrary HTTP payload.
 The response includes the following HTTP headers:
 * `X-Vertex-AI-Endpoint-Id`: ID of the
 [Endpoint][google.cloud.aiplatform.v1.Endpoint] that served this
 prediction.
 * `X-Vertex-AI-Deployed-Model-Id`: ID of the Endpoint's
 [DeployedModel][google.cloud.aiplatform.v1.DeployedModel] that served this
 prediction.
 

streamRawPredict

public Iterator<com.google.api.HttpBody> streamRawPredict(StreamRawPredictRequest request)

 Perform a streaming online prediction with an arbitrary HTTP payload.
 

directPredict

public DirectPredictResponse directPredict(DirectPredictRequest request)

 Perform an unary online prediction request to a gRPC model server for
 Vertex first-party products and frameworks.
 

directRawPredict

public DirectRawPredictResponse directRawPredict(DirectRawPredictRequest request)

 Perform an unary online prediction request to a gRPC model server for
 custom containers.
 

serverStreamingPredict

public Iterator<StreamingPredictResponse> serverStreamingPredict(StreamingPredictRequest request)

 Perform a server-side streaming online prediction request for Vertex
 LLM streaming.
 

explain

public ExplainResponse explain(ExplainRequest request)

 Perform an online explanation.
 If
 [deployed_model_id][google.cloud.aiplatform.v1.ExplainRequest.deployed_model_id]
 is specified, the corresponding DeployModel must have
 [explanation_spec][google.cloud.aiplatform.v1.DeployedModel.explanation_spec]
 populated. If
 [deployed_model_id][google.cloud.aiplatform.v1.ExplainRequest.deployed_model_id]
 is not specified, all DeployedModels must have
 [explanation_spec][google.cloud.aiplatform.v1.DeployedModel.explanation_spec]
 populated.
 

generateContent

public GenerateContentResponse generateContent(GenerateContentRequest request)

 Generate content with multimodal inputs.
 

streamGenerateContent

public Iterator<GenerateContentResponse> streamGenerateContent(GenerateContentRequest request)

 Generate content with multimodal inputs with streaming support.