AWS Glue

2024/09/23 - 4 updated api methods

Changes   Added AthenaProperties parameter to Glue Connections, allowing Athena to store service specific properties on Glue Connections.

2024/09/19 - 1 new api methods

Changes   This change is for releasing TestConnection api SDK model

2024/09/12 - 6 updated api methods

Changes   AWS Glue is introducing two new optimizers for Apache Iceberg tables: snapshot retention and orphan file deletion. Customers can enable these optimizers and customize their configurations to perform daily maintenance tasks on their Iceberg tables based on their specific requirements.

2024/08/21 - 12 updated api methods

Changes   Add optional field JobRunQueuingEnabled to CreateJob and UpdateJob APIs.

2024/08/13 - 1 updated api methods

Changes   Add AttributesToGet parameter support for Glue GetTables

2024/08/08 - 15 updated api methods

Changes   This release adds support to retrieve the validation status when creating or updating Glue Data Catalog Views. Also added is support for BasicCatalogTarget partition keys.

2024/08/07 - 6 new 6 updated api methods

Changes   Introducing AWS Glue Data Quality anomaly detection, a new functionality that uses ML-based solutions to detect data anomalies users have not explicitly defined rules for.

2024/07/10 - 5 updated api methods

Changes   Add recipe step support for recipe node

2024/06/28 - 1 updated api methods

Changes   Added AttributesToGet parameter to Glue GetDatabases, allowing caller to limit output to include only the database name.

2024/06/17 - 5 new 12 updated api methods

Changes   This release introduces a new feature, Usage profiles. Usage profiles allow the AWS Glue admin to create different profiles for various classes of users within the account, enforcing limits and defaults for jobs and sessions.

2024/06/13 - 2 updated api methods

Changes   This release adds support for configuration of evaluation method for composite rules in Glue Data Quality rulesets.

2024/06/06 - 8 updated api methods

Changes   This release adds support for creating and updating Glue Data Catalog Views.

2024/06/05 - 4 updated api methods

Changes   AWS Glue now supports native SaaS connectivity: Salesforce connector available now

2024/05/29 - 11 updated api methods

Changes   Add optional field JobMode to CreateJob and UpdateJob APIs.

2024/05/21 - 16 updated api methods

Changes   Add Maintenance window to CreateJob and UpdateJob APIs and JobRun response. Add a new Job Run State for EXPIRED.

2024/04/19 - 1 updated api methods

Changes   Adding RowFilter in the response for GetUnfilteredTableMetadata API

2024/04/12 - 1 updated api methods

Changes   Modifying request for GetUnfilteredTableMetadata for view-related fields.

2024/04/02 - 6 updated api methods

Changes   Adding View related fields to responses of read-only Table APIs.

2024/02/05 - 2 updated api methods

Changes   Introduce Catalog Encryption Role within Glue Data Catalog Settings. Introduce SASL/PLAIN as an authentication method for Glue Kafka connections

2023/12/22 - 3 updated api methods

Changes   This release adds additional configurations for Query Session Context on the following APIs: GetUnfilteredTableMetadata, GetUnfilteredPartitionMetadata, GetUnfilteredPartitionsMetadata.

2023/11/30 - 2 updated api methods

Changes   Adds observation and analyzer support to the GetDataQualityResult and BatchGetDataQualityResult APIs.

2023/11/16 - 5 new api methods

Changes   Introduces new column statistics APIs to support statistics generation for tables within the Glue Data Catalog.

2023/11/14 - 6 new api methods

Changes   Introduces new storage optimization APIs to support automatic compaction of Apache Iceberg tables.

2023/11/02 - 5 updated api methods

Changes   This release introduces Google BigQuery Source and Target in AWS Glue CodeGenConfigurationNode.

2023/10/12 - 7 updated api methods

Changes   Extending version control support to GitLab and Bitbucket from AWSGlue

2023/08/24 - 3 updated api methods

Changes   Added API attributes that help in the monitoring of sessions.

2023/08/15 - 4 updated api methods

Changes   AWS Glue Crawlers can now accept SerDe overrides from a custom csv classifier. The two SerDe options are LazySimpleSerDe and OpenCSVSerDe. In case, the user wants crawler to do the selection, "None" can be selected for this purpose.

2023/07/26 - 5 updated api methods

Changes   Release Glue Studio Snowflake Connector Node for SDK/CLI

2023/07/24 - 5 updated api methods

Changes   Added support for Data Preparation Recipe node in Glue Studio jobs

2023/07/21 - 5 updated api methods

Changes   This release adds support for AWS Glue Crawler with Apache Hudi Tables, allowing Crawlers to discover Hudi Tables in S3 and register them in Glue Data Catalog for query engines to query against.

2023/07/17 - 3 updated api methods

Changes   Adding new supported permission type flags to get-unfiltered endpoints that callers may pass to indicate support for enforcing Lake Formation fine-grained access control on nested column attributes.

2023/07/07 - 1 updated api methods

Changes   This release enables customers to create new Apache Iceberg tables and associated metadata in Amazon S3 by using native AWS Glue CreateTable operation.

2023/06/29 - 5 updated api methods

Changes   This release adds support for AWS Glue Crawler with Iceberg Tables, allowing Crawlers to discover Iceberg Tables in S3 and register them in Glue Data Catalog for query engines to query against.

2023/06/26 - 5 updated api methods

Changes   Timestamp Starting Position For Kinesis and Kafka Data Sources in a Glue Streaming Job

2023/06/19 - 12 updated api methods

Changes   This release adds support for creating cross region table/database resource links

2023/05/30 - 21 updated api methods

Changes   Added Runtime parameter to allow selection of Ray Runtime

2023/05/25 - 12 updated api methods

Changes   Added ability to create data quality rulesets for shared, cross-account Glue Data Catalog tables. Added support for dataset comparison rules through a new parameter called AdditionalDataSources. Enhanced the data quality results with a map containing profiled metric values.

2023/05/16 - 2 updated api methods

Changes   Add Support for Tags for Custom Entity Types

2023/05/09 - 5 updated api methods

Changes   This release adds AmazonRedshift Source and Target nodes in addition to DynamicTransform OutputSchemas

2023/05/08 - 21 updated api methods

Changes   We don't do release notes https://w.amazon.com/bin/view/AWSDocs/common-tasks/release-notes

2023/04/03 - 10 updated api methods

Changes   Add support for database-level federation

2023/02/17 - 5 updated api methods

Changes   Release of Delta Lake Data Lake Format for Glue Studio Service

2023/02/15 - 5 updated api methods

Changes   Fix DirectJDBCSource not showing up in CLI code gen

2023/02/08 - 5 updated api methods

Changes   DirectJDBCSource + Glue 4.0 streaming options

2023/01/19 - 5 updated api methods

Changes   Release Glue Studio Hudi Data Lake Format for SDK/CLI

2022/12/15 - 5 updated api methods

Changes   This release adds support for AWS Glue Crawler with native DeltaLake tables, allowing Crawlers to classify Delta Lake format tables and catalog them for query engines to query against.

2022/11/30 - 16 new 8 updated api methods

Changes   This release adds support for AWS Glue Data Quality, which helps you evaluate and monitor the quality of your data and includes the API for creating, deleting, or updating data quality rulesets, runs and evaluations.

2022/11/29 - 5 updated api methods

Changes   This release allows the creation of Custom Visual Transforms (Dynamic Transforms) to be created via AWS Glue CLI/SDK.

2022/11/18 - 5 updated api methods

Changes   AWSGlue Crawler - Adding support for Table and Column level Comments with database level datatypes for JDBC based crawler.

2022/10/27 - 4 updated api methods

Changes   Added support for custom datatypes when using custom csv classifier.

2022/10/05 - 2 new 5 updated api methods

Changes   This SDK release adds support to sync glue jobs with source control provider. Additionally, a new parameter called SourceControlDetails will be added to Job model.

2022/09/22 - 5 updated api methods

Changes   Added support for S3 Event Notifications for Catalog Target Crawlers.

2022/08/08 - 17 updated api methods

Changes   Add an option to run non-urgent or non-time sensitive Glue Jobs on spare capacity

2022/07/14 - 21 updated api methods

Changes   This release adds an additional worker type for Glue Streaming jobs.

2022/06/30 - 1 updated api methods

Changes   This release adds tag as an input of CreateDatabase

2022/06/24 - 1 new api methods

Changes   This release enables the new ListCrawls API for viewing the AWS Glue Crawler run history.

2022/05/17 - 5 updated api methods

Changes   This release adds a new optional parameter called codeGenNodeConfiguration to CRUD job APIs that allows users to manage visual jobs via APIs. The updated CreateJob and UpdateJob will create jobs that can be viewed in Glue Studio as a visual graph. GetJob can be used to get codeGenNodeConfiguration.

2022/04/21 - 5 new api methods

Changes   This release adds APIs to create, read, delete, list, and batch read of Glue custom entity types

2022/04/14 - 6 updated api methods

Changes   Auto Scaling for Glue version 3.0 and later jobs to dynamically scale compute resources. This SDK change provides customers with the auto-scaled DPU usage

2022/03/18 - 9 new 3 updated api methods

Changes   Added 9 new APIs for AWS Glue Interactive Sessions: ListSessions, StopSession, CreateSession, GetSession, DeleteSession, RunStatement, GetStatement, ListStatements, CancelStatement

2022/02/16 - 7 updated api methods

Changes   Support for optimistic locking in UpdateTable

2022/02/02 - 5 updated api methods

Changes   Launch Protobuf support for AWS Glue Schema Registry

2022/01/13 - 1 updated api methods

Changes   This SDK release adds support to pass run properties when starting a workflow run

2022/01/05 - 3 new 19 updated api methods

Changes   Add Delta Lake target support for Glue Crawler and 3rd Party Support for Lake Formation

2021/11/30 - 7 updated api methods

Changes   Support for DataLake transactions

2021/10/15 - 5 updated api methods

Changes   Enable S3 event base crawler API.

2021/10/05 - 1 updated api methods

Changes   This release adds tag as an input of CreateConnection

2021/08/23 - 9 new 2 updated api methods

Changes   Add support for Custom Blueprints

2021/07/14 - 9 updated api methods

Changes   Add support for Event Driven Workflows

2021/06/28 - 5 updated api methods

Changes   Add JSON Support for Glue Schema Registry

2021/06/07 - 5 updated api methods

Changes   Add SampleSize variable to S3Target to enable s3-sampling feature through API.

2021/03/29 - 1 updated api methods

Changes   Allow Dots in Registry and Schema Names for CreateRegistry, CreateSchema; Fixed issue when duplicate keys are present and not returned as part of QuerySchemaVersionMetadata.

2021/02/23 - 1 updated api methods

Changes   Update glue client to latest version

2020/12/22 - 2 updated api methods

Changes   Update glue client to latest version

2020/12/21 - 4 updated api methods

Changes   Update glue client to latest version

2020/11/23 - 2 new 6 updated api methods

Changes   Update glue client to latest version

2020/11/19 - 20 new 14 updated api methods

Changes   Update glue client to latest version

2020/10/27 - 3 updated api methods

Changes   Update glue client to latest version

2020/10/21 - 5 updated api methods

Changes   Update glue client to latest version

2020/10/05 - 5 updated api methods

Changes   Update glue client to latest version

2020/10/01 - 1 updated api methods

Changes   Update glue client to latest version

2020/09/21 - 1 new api methods

Changes   Update glue client to latest version

2020/09/09 - 1 new 1 updated api methods

Changes   Update glue client to latest version

2020/08/10 - 6 updated api methods

Changes   Update glue client to latest version

2020/08/07 - 9 updated api methods

Changes   Update glue client to latest version

2020/07/27 - 1 new 4 updated api methods

Changes   Update glue client to latest version

2020/07/07 - 1 new 19 updated api methods

Changes   Update glue client to latest version

2020/06/25 - 6 new api methods

Changes   Update glue client to latest version

2020/06/12 - 5 updated api methods

Changes   Update glue client to latest version

2020/06/03 - 2 updated api methods

Changes   Update glue client to latest version

2020/05/15 - 1 new 9 updated api methods

Changes   Update glue client to latest version

2020/04/20 - 4 updated api methods

Changes   Update glue client to latest version

2020/03/31 - 4 updated api methods

Changes   Update glue client to latest version

2020/02/28 - 1 new 1 updated api methods

Changes   Update glue client to latest version

2020/02/12 - 5 updated api methods

Changes   Update glue client to latest version

2019/11/21 - 4 updated api methods

Changes   Update glue client to latest version

2019/09/19 - 4 updated api methods

Changes   Update glue client to latest version

2019/08/08 - 13 new 16 updated api methods

Changes   Update glue client to latest version

2019/07/26 - 2 new 1 updated api methods

Changes   Update glue client to latest version

2019/07/24 - 16 updated api methods

Changes   Update glue client to latest version

2019/06/20 - 11 new 5 updated api methods

Changes   Update glue client to latest version

2019/06/05 - 5 updated api methods

Changes   Update glue client to latest version

2019/05/10 - 5 updated api methods

Changes   Update glue client to latest version

2019/04/05 - 8 updated api methods

Changes   Update glue client to latest version

2019/03/26 - 4 updated api methods

Changes   Update glue client to latest version

2019/03/11 - 5 updated api methods

Changes   Update glue client to latest version

2019/02/22 - 11 new 4 updated api methods

Changes   Update glue client to latest version

2019/01/18 - 7 updated api methods

Changes   Update glue client to latest version

2018/12/12 - 4 updated api methods

Changes   Update glue client to latest version

2018/10/16 - 3 new api methods

Changes   Update glue client to latest version

2018/09/26 - 1 new api methods

Changes   Update glue client to latest version

2018/08/28 - 3 new api methods

Changes   Update glue client to latest version

2018/08/25 - 5 new 18 updated api methods

Changes   Update glue client to latest version

2018/07/30 - 4 updated api methods

Changes   Update glue client to latest version

2018/07/10 - 6 updated api methods

Changes   Update glue client to latest version

2018/05/25 - 11 updated api methods

Changes   Update glue client to latest version

2018/04/10 - 11 updated api methods

Changes   Update glue client to latest version

2018/03/20 - 2 updated api methods

Changes   Update glue client to latest version

2018/02/06 - 4 updated api methods

Changes   Update glue client to latest version

2018/01/19 - 3 new 1 updated api methods

Changes   Update glue client to latest version

2018/01/12 - 6 updated api methods

Changes   Update glue client to latest version

2017/11/16 - 8 updated api methods

Changes   Update glue client to latest version

2017/10/24 - 1 new 4 updated api methods

Changes   Update glue client to latest version

2017/08/14 - 74 new api methods

Changes   Update glue client to latest version