Amazon Fraud Detector

2021/07/09 - Amazon Fraud Detector - 1 updated api methods

Changes  This release adds support for ML Explainability to display model variable importance value in Amazon Fraud Detector.

DescribeModelVersions (updated) Link ΒΆ
Changes (response)
{'modelVersionDetails': {'trainingResult': {'variableImportanceMetrics': {'LogitMetrics': [{'variableImportance': 'float',
                                                                                            'variableName': 'string',
                                                                                            'variableType': 'string'}]}}}}

Gets all of the model versions for the specified model type or for the specified model type and model ID. You can also get details for a single, specified model version.

See also: AWS API Documentation

Request Syntax

client.describe_model_versions(
    modelId='string',
    modelVersionNumber='string',
    modelType='ONLINE_FRAUD_INSIGHTS',
    nextToken='string',
    maxResults=123
)
type modelId:

string

param modelId:

The model ID.

type modelVersionNumber:

string

param modelVersionNumber:

The model version number.

type modelType:

string

param modelType:

The model type.

type nextToken:

string

param nextToken:

The next token from the previous results.

type maxResults:

integer

param maxResults:

The maximum number of results to return.

rtype:

dict

returns:

Response Syntax

{
    'modelVersionDetails': [
        {
            'modelId': 'string',
            'modelType': 'ONLINE_FRAUD_INSIGHTS',
            'modelVersionNumber': 'string',
            'status': 'string',
            'trainingDataSource': 'EXTERNAL_EVENTS',
            'trainingDataSchema': {
                'modelVariables': [
                    'string',
                ],
                'labelSchema': {
                    'labelMapper': {
                        'string': [
                            'string',
                        ]
                    }
                }
            },
            'externalEventsDetail': {
                'dataLocation': 'string',
                'dataAccessRoleArn': 'string'
            },
            'trainingResult': {
                'dataValidationMetrics': {
                    'fileLevelMessages': [
                        {
                            'title': 'string',
                            'content': 'string',
                            'type': 'string'
                        },
                    ],
                    'fieldLevelMessages': [
                        {
                            'fieldName': 'string',
                            'identifier': 'string',
                            'title': 'string',
                            'content': 'string',
                            'type': 'string'
                        },
                    ]
                },
                'trainingMetrics': {
                    'auc': ...,
                    'metricDataPoints': [
                        {
                            'fpr': ...,
                            'precision': ...,
                            'tpr': ...,
                            'threshold': ...
                        },
                    ]
                },
                'variableImportanceMetrics': {
                    'LogitMetrics': [
                        {
                            'variableName': 'string',
                            'variableType': 'string',
                            'variableImportance': ...
                        },
                    ]
                }
            },
            'lastUpdatedTime': 'string',
            'createdTime': 'string',
            'arn': 'string'
        },
    ],
    'nextToken': 'string'
}

Response Structure

  • (dict) --

    • modelVersionDetails (list) --

      The model version details.

      • (dict) --

        The details of the model version.

        • modelId (string) --

          The model ID.

        • modelType (string) --

          The model type.

        • modelVersionNumber (string) --

          The model version number.

        • status (string) --

          The status of the model version.

        • trainingDataSource (string) --

          The model version training data source.

        • trainingDataSchema (dict) --

          The training data schema.

          • modelVariables (list) --

            The training data schema variables.

            • (string) --

          • labelSchema (dict) --

            The label schema.

            • labelMapper (dict) --

              The label mapper maps the Amazon Fraud Detector supported model classification labels ( FRAUD, LEGIT) to the appropriate event type labels. For example, if " FRAUD" and " LEGIT" are Amazon Fraud Detector supported labels, this mapper could be: {"FRAUD" => ["0"], "LEGIT" => ["1"]} or {"FRAUD" => ["false"], "LEGIT" => ["true"]} or {"FRAUD" => ["fraud", "abuse"], "LEGIT" => ["legit", "safe"]}. The value part of the mapper is a list, because you may have multiple label variants from your event type for a single Amazon Fraud Detector label.

              • (string) --

                • (list) --

                  • (string) --

        • externalEventsDetail (dict) --

          The event details.

          • dataLocation (string) --

            The Amazon S3 bucket location for the data.

          • dataAccessRoleArn (string) --

            The ARN of the role that provides Amazon Fraud Detector access to the data location.

        • trainingResult (dict) --

          The training results.

          • dataValidationMetrics (dict) --

            The validation metrics.

            • fileLevelMessages (list) --

              The file-specific model training validation messages.

              • (dict) --

                The message details.

                • title (string) --

                  The message title.

                • content (string) --

                  The message content.

                • type (string) --

                  The message type.

            • fieldLevelMessages (list) --

              The field-specific model training validation messages.

              • (dict) --

                The message details.

                • fieldName (string) --

                  The field name.

                • identifier (string) --

                  The message ID.

                • title (string) --

                  The message title.

                • content (string) --

                  The message content.

                • type (string) --

                  The message type.

          • trainingMetrics (dict) --

            The training metric details.

            • auc (float) --

              The area under the curve. This summarizes true positive rate (TPR) and false positive rate (FPR) across all possible model score thresholds. A model with no predictive power has an AUC of 0.5, whereas a perfect model has a score of 1.0.

            • metricDataPoints (list) --

              The data points details.

              • (dict) --

                Model performance metrics data points.

                • fpr (float) --

                  The false positive rate. This is the percentage of total legitimate events that are incorrectly predicted as fraud.

                • precision (float) --

                  The percentage of fraud events correctly predicted as fraudulent as compared to all events predicted as fraudulent.

                • tpr (float) --

                  The true positive rate. This is the percentage of total fraud the model detects. Also known as capture rate.

                • threshold (float) --

                  The model threshold that specifies an acceptable fraud capture rate. For example, a threshold of 500 means any model score 500 or above is labeled as fraud.

          • variableImportanceMetrics (dict) --

            The variable importance metrics.

            • LogitMetrics (list) --

              List of variable metrics.

              • (dict) --

                The logit metric details.

                • variableName (string) --

                  The name of the variable.

                • variableType (string) --

                  The type of variable.

                • variableImportance (float) --

                  The relative importance of the variable.

        • lastUpdatedTime (string) --

          The timestamp when the model was last updated.

        • createdTime (string) --

          The timestamp when the model was created.

        • arn (string) --

          The model version ARN.

    • nextToken (string) --

      The next token.