com.google.cloud.vertexai.api

Interface PredictionServiceGrpc.AsyncService

All Known Implementing Classes:

PredictionServiceGrpc.PredictionServiceImplBase

Enclosing class:

PredictionServiceGrpc

public static interface PredictionServiceGrpc.AsyncService

 A service for online predictions and explanations.
 

Method Summary

Modifier and Type	Method and Description
default void	directPredict(DirectPredictRequest request, io.grpc.stub.StreamObserver<DirectPredictResponse> responseObserver) Perform an unary online prediction request to a gRPC model server for Vertex first-party products and frameworks.
default void	directRawPredict(DirectRawPredictRequest request, io.grpc.stub.StreamObserver<DirectRawPredictResponse> responseObserver) Perform an unary online prediction request to a gRPC model server for custom containers.
default void	explain(ExplainRequest request, io.grpc.stub.StreamObserver<ExplainResponse> responseObserver) Perform an online explanation.
default void	generateContent(GenerateContentRequest request, io.grpc.stub.StreamObserver<GenerateContentResponse> responseObserver) Generate content with multimodal inputs.
default void	predict(PredictRequest request, io.grpc.stub.StreamObserver<PredictResponse> responseObserver) Perform an online prediction.
default void	rawPredict(RawPredictRequest request, io.grpc.stub.StreamObserver<com.google.api.HttpBody> responseObserver) Perform an online prediction with an arbitrary HTTP payload.
default void	serverStreamingPredict(StreamingPredictRequest request, io.grpc.stub.StreamObserver<StreamingPredictResponse> responseObserver) Perform a server-side streaming online prediction request for Vertex LLM streaming.
default io.grpc.stub.StreamObserver<StreamDirectPredictRequest>	streamDirectPredict(io.grpc.stub.StreamObserver<StreamDirectPredictResponse> responseObserver) Perform a streaming online prediction request to a gRPC model server for Vertex first-party products and frameworks.
default io.grpc.stub.StreamObserver<StreamDirectRawPredictRequest>	streamDirectRawPredict(io.grpc.stub.StreamObserver<StreamDirectRawPredictResponse> responseObserver) Perform a streaming online prediction request to a gRPC model server for custom containers.
default void	streamGenerateContent(GenerateContentRequest request, io.grpc.stub.StreamObserver<GenerateContentResponse> responseObserver) Generate content with multimodal inputs with streaming support.
default io.grpc.stub.StreamObserver<StreamingPredictRequest>	streamingPredict(io.grpc.stub.StreamObserver<StreamingPredictResponse> responseObserver) Perform a streaming online prediction request for Vertex first-party products and frameworks.
default io.grpc.stub.StreamObserver<StreamingRawPredictRequest>	streamingRawPredict(io.grpc.stub.StreamObserver<StreamingRawPredictResponse> responseObserver) Perform a streaming online prediction request through gRPC.
default void	streamRawPredict(StreamRawPredictRequest request, io.grpc.stub.StreamObserver<com.google.api.HttpBody> responseObserver) Perform a streaming online prediction with an arbitrary HTTP payload.

Method Detail

predict

default void predict(PredictRequest request,
                     io.grpc.stub.StreamObserver<PredictResponse> responseObserver)

 Perform an online prediction.
 

rawPredict

default void rawPredict(RawPredictRequest request,
                        io.grpc.stub.StreamObserver<com.google.api.HttpBody> responseObserver)

 Perform an online prediction with an arbitrary HTTP payload.
 The response includes the following HTTP headers:
 * `X-Vertex-AI-Endpoint-Id`: ID of the
 [Endpoint][google.cloud.aiplatform.v1.Endpoint] that served this
 prediction.
 * `X-Vertex-AI-Deployed-Model-Id`: ID of the Endpoint's
 [DeployedModel][google.cloud.aiplatform.v1.DeployedModel] that served this
 prediction.
 

streamRawPredict

default void streamRawPredict(StreamRawPredictRequest request,
                              io.grpc.stub.StreamObserver<com.google.api.HttpBody> responseObserver)

 Perform a streaming online prediction with an arbitrary HTTP payload.
 

directPredict

default void directPredict(DirectPredictRequest request,
                           io.grpc.stub.StreamObserver<DirectPredictResponse> responseObserver)

 Perform an unary online prediction request to a gRPC model server for
 Vertex first-party products and frameworks.
 

directRawPredict

default void directRawPredict(DirectRawPredictRequest request,
                              io.grpc.stub.StreamObserver<DirectRawPredictResponse> responseObserver)

 Perform an unary online prediction request to a gRPC model server for
 custom containers.
 

streamDirectPredict

default io.grpc.stub.StreamObserver<StreamDirectPredictRequest> streamDirectPredict(io.grpc.stub.StreamObserver<StreamDirectPredictResponse> responseObserver)

 Perform a streaming online prediction request to a gRPC model server for
 Vertex first-party products and frameworks.
 

streamDirectRawPredict

default io.grpc.stub.StreamObserver<StreamDirectRawPredictRequest> streamDirectRawPredict(io.grpc.stub.StreamObserver<StreamDirectRawPredictResponse> responseObserver)

 Perform a streaming online prediction request to a gRPC model server for
 custom containers.
 

streamingPredict

default io.grpc.stub.StreamObserver<StreamingPredictRequest> streamingPredict(io.grpc.stub.StreamObserver<StreamingPredictResponse> responseObserver)

 Perform a streaming online prediction request for Vertex first-party
 products and frameworks.
 

serverStreamingPredict

default void serverStreamingPredict(StreamingPredictRequest request,
                                    io.grpc.stub.StreamObserver<StreamingPredictResponse> responseObserver)

 Perform a server-side streaming online prediction request for Vertex
 LLM streaming.
 

streamingRawPredict

default io.grpc.stub.StreamObserver<StreamingRawPredictRequest> streamingRawPredict(io.grpc.stub.StreamObserver<StreamingRawPredictResponse> responseObserver)

 Perform a streaming online prediction request through gRPC.
 

explain

default void explain(ExplainRequest request,
                     io.grpc.stub.StreamObserver<ExplainResponse> responseObserver)

 Perform an online explanation.
 If
 [deployed_model_id][google.cloud.aiplatform.v1.ExplainRequest.deployed_model_id]
 is specified, the corresponding DeployModel must have
 [explanation_spec][google.cloud.aiplatform.v1.DeployedModel.explanation_spec]
 populated. If
 [deployed_model_id][google.cloud.aiplatform.v1.ExplainRequest.deployed_model_id]
 is not specified, all DeployedModels must have
 [explanation_spec][google.cloud.aiplatform.v1.DeployedModel.explanation_spec]
 populated.
 

generateContent

default void generateContent(GenerateContentRequest request,
                             io.grpc.stub.StreamObserver<GenerateContentResponse> responseObserver)

 Generate content with multimodal inputs.
 

streamGenerateContent

default void streamGenerateContent(GenerateContentRequest request,
                                   io.grpc.stub.StreamObserver<GenerateContentResponse> responseObserver)

 Generate content with multimodal inputs with streaming support.