EndpointConfigurationAsyncInferenceConfigClientConfig constructor

const EndpointConfigurationAsyncInferenceConfigClientConfig({
  1. Input<int?>? maxConcurrentInvocationsPerInstance,
})

Creates a new EndpointConfigurationAsyncInferenceConfigClientConfig. maxConcurrentInvocationsPerInstance Maximum number of concurrent requests sent by the SageMaker AI client to the model container. If no value is provided, SageMaker AI will choose an optimal value for you.

Implementation

const EndpointConfigurationAsyncInferenceConfigClientConfig({
  this.maxConcurrentInvocationsPerInstance,
});