AsyncInferenceClientConfig
import type { AsyncInferenceClientConfig } from "https://aws-api.deno.dev/v0.3/services/sagemaker.ts?docs=full";
Configures the behavior of the client used by Amazon SageMaker to interact with the model container during asynchronous inference.
interface AsyncInferenceClientConfig {
MaxConcurrentInvocationsPerInstance?: number | null;
}