AWS Glue

2024/06/28 - AWS Glue - 1 updated api methods

Changes  Added AttributesToGet parameter to Glue GetDatabases, allowing caller to limit output to include only the database name.

GetDatabases (updated) Link ¶
Changes (request)
{'AttributesToGet': ['NAME']}

Retrieves all databases defined in a given Data Catalog.

See also: AWS API Documentation

Request Syntax

client.get_databases(
    CatalogId='string',
    NextToken='string',
    MaxResults=123,
    ResourceShareType='FOREIGN'|'ALL'|'FEDERATED',
    AttributesToGet=[
        'NAME',
    ]
)
type CatalogId

string

param CatalogId

The ID of the Data Catalog from which to retrieve Databases . If none is provided, the Amazon Web Services account ID is used by default.

type NextToken

string

param NextToken

A continuation token, if this is a continuation call.

type MaxResults

integer

param MaxResults

The maximum number of databases to return in one response.

type ResourceShareType

string

param ResourceShareType

Allows you to specify that you want to list the databases shared with your account. The allowable values are FEDERATED , FOREIGN or ALL .

  • If set to FEDERATED , will list the federated databases (referencing an external entity) shared with your account.

  • If set to FOREIGN , will list the databases shared with your account.

  • If set to ALL , will list the databases shared with your account, as well as the databases in yor local account.

type AttributesToGet

list

param AttributesToGet

Specifies the database fields returned by the GetDatabases call. This parameter doesn’t accept an empty list. The request must include the NAME .

  • (string) --

rtype

dict

returns

Response Syntax

{
    'DatabaseList': [
        {
            'Name': 'string',
            'Description': 'string',
            'LocationUri': 'string',
            'Parameters': {
                'string': 'string'
            },
            'CreateTime': datetime(2015, 1, 1),
            'CreateTableDefaultPermissions': [
                {
                    'Principal': {
                        'DataLakePrincipalIdentifier': 'string'
                    },
                    'Permissions': [
                        'ALL'|'SELECT'|'ALTER'|'DROP'|'DELETE'|'INSERT'|'CREATE_DATABASE'|'CREATE_TABLE'|'DATA_LOCATION_ACCESS',
                    ]
                },
            ],
            'TargetDatabase': {
                'CatalogId': 'string',
                'DatabaseName': 'string',
                'Region': 'string'
            },
            'CatalogId': 'string',
            'FederatedDatabase': {
                'Identifier': 'string',
                'ConnectionName': 'string'
            }
        },
    ],
    'NextToken': 'string'
}

Response Structure

  • (dict) --

    • DatabaseList (list) --

      A list of Database objects from the specified catalog.

      • (dict) --

        The Database object represents a logical grouping of tables that might reside in a Hive metastore or an RDBMS.

        • Name (string) --

          The name of the database. For Hive compatibility, this is folded to lowercase when it is stored.

        • Description (string) --

          A description of the database.

        • LocationUri (string) --

          The location of the database (for example, an HDFS path).

        • Parameters (dict) --

          These key-value pairs define parameters and properties of the database.

          • (string) --

            • (string) --

        • CreateTime (datetime) --

          The time at which the metadata database was created in the catalog.

        • CreateTableDefaultPermissions (list) --

          Creates a set of default permissions on the table for principals. Used by Lake Formation. Not used in the normal course of Glue operations.

          • (dict) --

            Permissions granted to a principal.

            • Principal (dict) --

              The principal who is granted permissions.

              • DataLakePrincipalIdentifier (string) --

                An identifier for the Lake Formation principal.

            • Permissions (list) --

              The permissions that are granted to the principal.

              • (string) --

        • TargetDatabase (dict) --

          A DatabaseIdentifier structure that describes a target database for resource linking.

          • CatalogId (string) --

            The ID of the Data Catalog in which the database resides.

          • DatabaseName (string) --

            The name of the catalog database.

          • Region (string) --

            Region of the target database.

        • CatalogId (string) --

          The ID of the Data Catalog in which the database resides.

        • FederatedDatabase (dict) --

          A FederatedDatabase structure that references an entity outside the Glue Data Catalog.

          • Identifier (string) --

            A unique identifier for the federated database.

          • ConnectionName (string) --

            The name of the connection to the external metastore.

    • NextToken (string) --

      A continuation token for paginating the returned list of tokens, returned if the current segment of the list is not the last.