software.amazon.awscdk.services.sagemaker

Interface CfnEndpointConfig.AsyncInferenceClientConfigProperty

All Superinterfaces:

software.amazon.jsii.JsiiSerializable

All Known Implementing Classes:

CfnEndpointConfig.AsyncInferenceClientConfigProperty.Jsii$Proxy

Enclosing class:

CfnEndpointConfig

@Stability(value=Stable)
public static interface CfnEndpointConfig.AsyncInferenceClientConfigProperty
extends software.amazon.jsii.JsiiSerializable

Configures the behavior of the client used by SageMaker to interact with the model container during asynchronous inference.

Example:

 // The code below shows an example of how to instantiate this type.
 // The values are placeholders you should change.
 import software.amazon.awscdk.services.sagemaker.*;
 AsyncInferenceClientConfigProperty asyncInferenceClientConfigProperty = AsyncInferenceClientConfigProperty.builder()
         .maxConcurrentInvocationsPerInstance(123)
         .build();
 

Nested Class Summary

Nested Classes

Modifier and Type	Interface and Description
static class	CfnEndpointConfig.AsyncInferenceClientConfigProperty.Builder A builder for CfnEndpointConfig.AsyncInferenceClientConfigProperty
static class	CfnEndpointConfig.AsyncInferenceClientConfigProperty.Jsii$Proxy An implementation for CfnEndpointConfig.AsyncInferenceClientConfigProperty

Method Summary

Modifier and Type	Method and Description
static CfnEndpointConfig.AsyncInferenceClientConfigProperty.Builder	builder()
default Number	getMaxConcurrentInvocationsPerInstance() The maximum number of concurrent requests sent by the SageMaker client to the model container.

Methods inherited from interface software.amazon.jsii.JsiiSerializable

$jsii$toJson

Method Detail

getMaxConcurrentInvocationsPerInstance

@Stability(value=Stable)
 @Nullable
default Number getMaxConcurrentInvocationsPerInstance()

The maximum number of concurrent requests sent by the SageMaker client to the model container.

If no value is provided, SageMaker will choose an optimal value for you.

builder

@Stability(value=Stable)
static CfnEndpointConfig.AsyncInferenceClientConfigProperty.Builder builder()

Returns:

a CfnEndpointConfig.AsyncInferenceClientConfigProperty.Builder of CfnEndpointConfig.AsyncInferenceClientConfigProperty