Copyright | (c) 2013-2023 Brendan Hay |
---|---|
License | Mozilla Public License, v. 2.0. |
Maintainer | Brendan Hay |
Stability | auto-generated |
Portability | non-portable (GHC extensions) |
Safe Haskell | Safe-Inferred |
Language | Haskell2010 |
Documentation
data AsyncInferenceClientConfig Source #
Configures the behavior of the client used by SageMaker to interact with the model container during asynchronous inference.
See: newAsyncInferenceClientConfig
smart constructor.
AsyncInferenceClientConfig' | |
|
Instances
newAsyncInferenceClientConfig :: AsyncInferenceClientConfig Source #
Create a value of AsyncInferenceClientConfig
with all optional fields omitted.
Use generic-lens or optics to modify other optional fields.
The following record fields are available, with the corresponding lenses provided for backwards compatibility:
$sel:maxConcurrentInvocationsPerInstance:AsyncInferenceClientConfig'
, asyncInferenceClientConfig_maxConcurrentInvocationsPerInstance
- The maximum number of concurrent requests sent by the SageMaker client
to the model container. If no value is provided, SageMaker chooses an
optimal value.
asyncInferenceClientConfig_maxConcurrentInvocationsPerInstance :: Lens' AsyncInferenceClientConfig (Maybe Natural) Source #
The maximum number of concurrent requests sent by the SageMaker client to the model container. If no value is provided, SageMaker chooses an optimal value.