Amazon SageMaker Runtime

After you deploy a model into production using Amazon SageMaker hosting services, your client applications use this API to get inferences from the model hosted at the specified endpoint.

For an overview of Amazon SageMaker, see How It Works

Amazon SageMaker strips all POST headers except those supported by the API. Amazon SageMaker might add additional headers. You should not rely on the behavior of headers outside those enumerated in the request syntax.

See also: AWS API Documentation

Request Syntax

client.invoke_endpoint(
    EndpointName='string',
    Body=b'bytes'|file,
    ContentType='string',
    Accept='string'
)

type EndpointName

string

param EndpointName

[REQUIRED]

The name of the endpoint that you specified when you created the endpoint using the CreateEndpoint API.

type Body

bytes or seekable file-like object

param Body

[REQUIRED]

Provides input data, in the format specified in the ContentType request header. Amazon SageMaker passes all of the data in the body to the model.

type ContentType

string

param ContentType

The MIME type of the input data in the request body.

type Accept

string

param Accept

The desired MIME type of the inference in the response.

rtype

dict

returns

Response Syntax

{
    'Body': b'bytes'|file,
    'ContentType': 'string',
    'InvokedProductionVariant': 'string'
}

Response Structure

• (dict) --

  • Body (bytes or seekable file-like object) --

    Includes the inference provided by the model.

  • ContentType (string) --

    The MIME type of the inference returned in the response body.

  • InvokedProductionVariant (string) --

    Identifies the production variant that was invoked.