Hi there! Are you looking for the official Deno documentation? Try docs.deno.com for all your Deno learning needs.

AsyncInferenceClientConfig

import type { AsyncInferenceClientConfig } from "https://aws-api.deno.dev/v0.4/services/sagemaker.ts?docs=full";

Configures the behavior of the client used by SageMaker to interact with the model container during asynchronous inference.

interface AsyncInferenceClientConfig {
MaxConcurrentInvocationsPerInstance?: number | null;
}

§Properties

§
MaxConcurrentInvocationsPerInstance?: number | null
[src]

The maximum number of concurrent requests sent by the SageMaker client to the model container. If no value is provided, SageMaker chooses an optimal value.