Amazon Bedrock Runtime

{'body': {'modelTimeoutException': {'message': 'string'}}}

Invoke the specified Bedrock model to run inference using the input provided. Return the response in a stream.

For more information, see Run inference in the Bedrock User Guide.

For an example request and response, see Examples (after the Errors section).

See also: AWS API Documentation

Request Syntax

client.invoke_model_with_response_stream(
    accept='string',
    body=b'bytes'|file,
    contentType='string',
    modelId='string'
)

type accept:

string

param accept:

The desired MIME type of the inference body in the response. The default value is application/json.

type body:

bytes or seekable file-like object

param body:

[REQUIRED]

Inference input in the format specified by the content-type. To see the format and content of this field for different models, refer to Inference parameters.

type contentType:

string

param contentType:

The MIME type of the input data in the request. The default value is application/json.

type modelId:

string

param modelId:

[REQUIRED]

Id of the model to invoke using the streaming request.

rtype:

dict

returns:

The response of this operation contains an :class:`.EventStream` member. When iterated the :class:`.EventStream` will yield events based on the structure below, where only one of the top level keys will be present for any given event.

Response Syntax

{
    'body': EventStream({
        'chunk': {
            'bytes': b'bytes'
        },
        'internalServerException': {
            'message': 'string'
        },
        'modelStreamErrorException': {
            'message': 'string',
            'originalMessage': 'string',
            'originalStatusCode': 123
        },
        'modelTimeoutException': {
            'message': 'string'
        },
        'throttlingException': {
            'message': 'string'
        },
        'validationException': {
            'message': 'string'
        }
    }),
    'contentType': 'string'
}

Response Structure

• (dict) --

  • body (:class:`.EventStream`) --

    Inference response from the model in the format specified by Content-Type. To see the format and content of this field for different models, refer to Inference parameters.

    • chunk (dict) --

      Content included in the response.

      • bytes (bytes) --

        Base64-encoded bytes of payload data.

    • internalServerException (dict) --

      An internal server error occurred. Retry your request.

      • message (string) --

    • modelStreamErrorException (dict) --

      An error occurred while streaming the response.

      • message (string) --

      • originalMessage (string) --

        The original message.

      • originalStatusCode (integer) --

        The original status code.

    • modelTimeoutException (dict) --

      The request took too long to process. Processing time exceeded the model timeout length.

      • message (string) --

    • throttlingException (dict) --

      The number of requests exceeds the limit. Resubmit your request later.

      • message (string) --

    • validationException (dict) --

      Input validation failed. Check your request parameters and retry the request.

      • message (string) --

  • contentType (string) --

    The MIME type of the inference result.