AWS API Changes

2024/12/12 - 3 updated api methods

Changes To support customer-managed encryption in Data Quality to allow customers encrypt data with their own KMS key, we will add a DataQualityEncryption field to the SecurityConfiguration API where customers can provide their KMS keys.

2024/12/03 - 22 new 6 updated api methods

Changes This release includes(1)Zero-ETL integration to ingest data from 3P SaaS and DynamoDB to Redshift/Redlake (2)new properties on Connections to enable reuse; new connection APIs for retrieve/preview metadata (3)support of CRUD operations for Multi-catalog (4)support of automatic statistics collections

2024/11/19 - 4 updated api methods

Changes AWS Glue Data Catalog now enhances managed table optimizations of Apache Iceberg tables that can be accessed only from a specific Amazon Virtual Private Cloud (VPC) environment.

2024/10/31 - 6 new 2 updated api methods

Changes Add schedule support for AWS Glue column statistics

2024/09/23 - 4 updated api methods

Changes Added AthenaProperties parameter to Glue Connections, allowing Athena to store service specific properties on Glue Connections.

2024/09/19 - 1 new api methods

Changes This change is for releasing TestConnection api SDK model

2024/09/12 - 6 updated api methods

Changes AWS Glue is introducing two new optimizers for Apache Iceberg tables: snapshot retention and orphan file deletion. Customers can enable these optimizers and customize their configurations to perform daily maintenance tasks on their Iceberg tables based on their specific requirements.

2024/08/21 - 12 updated api methods

Changes Add optional field JobRunQueuingEnabled to CreateJob and UpdateJob APIs.

2024/08/13 - 1 updated api methods

Changes Add AttributesToGet parameter support for Glue GetTables

2024/08/08 - 15 updated api methods

Changes This release adds support to retrieve the validation status when creating or updating Glue Data Catalog Views. Also added is support for BasicCatalogTarget partition keys.

2024/08/07 - 6 new 6 updated api methods

Changes Introducing AWS Glue Data Quality anomaly detection, a new functionality that uses ML-based solutions to detect data anomalies users have not explicitly defined rules for.

2024/07/10 - 5 updated api methods

Changes Add recipe step support for recipe node

2024/06/28 - 1 updated api methods

Changes Added AttributesToGet parameter to Glue GetDatabases, allowing caller to limit output to include only the database name.

2024/06/17 - 5 new 12 updated api methods

Changes This release introduces a new feature, Usage profiles. Usage profiles allow the AWS Glue admin to create different profiles for various classes of users within the account, enforcing limits and defaults for jobs and sessions.

2024/06/13 - 2 updated api methods

Changes This release adds support for configuration of evaluation method for composite rules in Glue Data Quality rulesets.

2024/06/06 - 8 updated api methods

Changes This release adds support for creating and updating Glue Data Catalog Views.

2024/06/05 - 4 updated api methods

Changes AWS Glue now supports native SaaS connectivity: Salesforce connector available now

2024/05/29 - 11 updated api methods

Changes Add optional field JobMode to CreateJob and UpdateJob APIs.

2024/05/21 - 16 updated api methods

Changes Add Maintenance window to CreateJob and UpdateJob APIs and JobRun response. Add a new Job Run State for EXPIRED.

2024/04/19 - 1 updated api methods

Changes Adding RowFilter in the response for GetUnfilteredTableMetadata API

2024/04/12 - 1 updated api methods

Changes Modifying request for GetUnfilteredTableMetadata for view-related fields.

2024/04/02 - 6 updated api methods

Changes Adding View related fields to responses of read-only Table APIs.

2024/02/05 - 2 updated api methods

Changes Introduce Catalog Encryption Role within Glue Data Catalog Settings. Introduce SASL/PLAIN as an authentication method for Glue Kafka connections

2023/12/22 - 3 updated api methods

Changes This release adds additional configurations for Query Session Context on the following APIs: GetUnfilteredTableMetadata, GetUnfilteredPartitionMetadata, GetUnfilteredPartitionsMetadata.

2023/11/30 - 2 updated api methods

Changes Adds observation and analyzer support to the GetDataQualityResult and BatchGetDataQualityResult APIs.

2023/11/16 - 5 new api methods

Changes Introduces new column statistics APIs to support statistics generation for tables within the Glue Data Catalog.

2023/11/14 - 6 new api methods

Changes Introduces new storage optimization APIs to support automatic compaction of Apache Iceberg tables.

2023/11/02 - 5 updated api methods

Changes This release introduces Google BigQuery Source and Target in AWS Glue CodeGenConfigurationNode.

2023/10/12 - 7 updated api methods

Changes Extending version control support to GitLab and Bitbucket from AWSGlue

2023/08/24 - 3 updated api methods

Changes Added API attributes that help in the monitoring of sessions.

2023/08/15 - 4 updated api methods

Changes AWS Glue Crawlers can now accept SerDe overrides from a custom csv classifier. The two SerDe options are LazySimpleSerDe and OpenCSVSerDe. In case, the user wants crawler to do the selection, "None" can be selected for this purpose.

2023/07/26 - 5 updated api methods

Changes Release Glue Studio Snowflake Connector Node for SDK/CLI

2023/07/24 - 5 updated api methods

Changes Added support for Data Preparation Recipe node in Glue Studio jobs

2023/07/21 - 5 updated api methods

Changes This release adds support for AWS Glue Crawler with Apache Hudi Tables, allowing Crawlers to discover Hudi Tables in S3 and register them in Glue Data Catalog for query engines to query against.

2023/07/17 - 3 updated api methods

Changes Adding new supported permission type flags to get-unfiltered endpoints that callers may pass to indicate support for enforcing Lake Formation fine-grained access control on nested column attributes.

2023/07/07 - 1 updated api methods

Changes This release enables customers to create new Apache Iceberg tables and associated metadata in Amazon S3 by using native AWS Glue CreateTable operation.

2023/06/29 - 5 updated api methods

Changes This release adds support for AWS Glue Crawler with Iceberg Tables, allowing Crawlers to discover Iceberg Tables in S3 and register them in Glue Data Catalog for query engines to query against.

2023/06/26 - 5 updated api methods

Changes Timestamp Starting Position For Kinesis and Kafka Data Sources in a Glue Streaming Job

2023/06/19 - 12 updated api methods

Changes This release adds support for creating cross region table/database resource links

2023/05/30 - 21 updated api methods

Changes Added Runtime parameter to allow selection of Ray Runtime

2023/05/25 - 12 updated api methods

Changes Added ability to create data quality rulesets for shared, cross-account Glue Data Catalog tables. Added support for dataset comparison rules through a new parameter called AdditionalDataSources. Enhanced the data quality results with a map containing profiled metric values.

2023/05/16 - 2 updated api methods

Changes Add Support for Tags for Custom Entity Types

2023/05/09 - 5 updated api methods

Changes This release adds AmazonRedshift Source and Target nodes in addition to DynamicTransform OutputSchemas

2023/05/08 - 21 updated api methods

Changes We don't do release notes https://w.amazon.com/bin/view/AWSDocs/common-tasks/release-notes

2023/04/03 - 10 updated api methods

Changes Add support for database-level federation

2023/02/17 - 5 updated api methods

Changes Release of Delta Lake Data Lake Format for Glue Studio Service

2023/02/15 - 5 updated api methods

Changes Fix DirectJDBCSource not showing up in CLI code gen

2023/02/08 - 5 updated api methods

Changes DirectJDBCSource + Glue 4.0 streaming options

2023/01/19 - 5 updated api methods

Changes Release Glue Studio Hudi Data Lake Format for SDK/CLI

2022/12/15 - 5 updated api methods

Changes This release adds support for AWS Glue Crawler with native DeltaLake tables, allowing Crawlers to classify Delta Lake format tables and catalog them for query engines to query against.

2022/11/30 - 16 new 8 updated api methods

Changes This release adds support for AWS Glue Data Quality, which helps you evaluate and monitor the quality of your data and includes the API for creating, deleting, or updating data quality rulesets, runs and evaluations.

2022/11/29 - 5 updated api methods

Changes This release allows the creation of Custom Visual Transforms (Dynamic Transforms) to be created via AWS Glue CLI/SDK.

2022/11/18 - 5 updated api methods

Changes AWSGlue Crawler - Adding support for Table and Column level Comments with database level datatypes for JDBC based crawler.

2022/10/27 - 4 updated api methods

Changes Added support for custom datatypes when using custom csv classifier.

2022/10/05 - 2 new 5 updated api methods

Changes This SDK release adds support to sync glue jobs with source control provider. Additionally, a new parameter called SourceControlDetails will be added to Job model.

2022/09/22 - 5 updated api methods

Changes Added support for S3 Event Notifications for Catalog Target Crawlers.

2022/08/08 - 17 updated api methods

Changes Add an option to run non-urgent or non-time sensitive Glue Jobs on spare capacity

2022/07/14 - 21 updated api methods

Changes This release adds an additional worker type for Glue Streaming jobs.

2022/06/30 - 1 updated api methods

Changes This release adds tag as an input of CreateDatabase

2022/06/24 - 1 new api methods

Changes This release enables the new ListCrawls API for viewing the AWS Glue Crawler run history.

2022/05/17 - 5 updated api methods

Changes This release adds a new optional parameter called codeGenNodeConfiguration to CRUD job APIs that allows users to manage visual jobs via APIs. The updated CreateJob and UpdateJob will create jobs that can be viewed in Glue Studio as a visual graph. GetJob can be used to get codeGenNodeConfiguration.

2022/04/21 - 5 new api methods

Changes This release adds APIs to create, read, delete, list, and batch read of Glue custom entity types

2022/04/14 - 6 updated api methods

Changes Auto Scaling for Glue version 3.0 and later jobs to dynamically scale compute resources. This SDK change provides customers with the auto-scaled DPU usage

2022/03/18 - 9 new 3 updated api methods

Changes Added 9 new APIs for AWS Glue Interactive Sessions: ListSessions, StopSession, CreateSession, GetSession, DeleteSession, RunStatement, GetStatement, ListStatements, CancelStatement

2022/02/16 - 7 updated api methods

Changes Support for optimistic locking in UpdateTable

2022/02/02 - 5 updated api methods

Changes Launch Protobuf support for AWS Glue Schema Registry

2022/01/13 - 1 updated api methods

Changes This SDK release adds support to pass run properties when starting a workflow run

2022/01/05 - 3 new 19 updated api methods

Changes Add Delta Lake target support for Glue Crawler and 3rd Party Support for Lake Formation

2021/11/30 - 7 updated api methods

Changes Support for DataLake transactions

2021/10/15 - 5 updated api methods

Changes Enable S3 event base crawler API.

2021/10/05 - 1 updated api methods

Changes This release adds tag as an input of CreateConnection

2021/08/23 - 9 new 2 updated api methods

Changes Add support for Custom Blueprints

2021/07/14 - 9 updated api methods

Changes Add support for Event Driven Workflows

2021/06/28 - 5 updated api methods

Changes Add JSON Support for Glue Schema Registry

2021/06/07 - 5 updated api methods

Changes Add SampleSize variable to S3Target to enable s3-sampling feature through API.

2021/03/29 - 1 updated api methods

Changes Allow Dots in Registry and Schema Names for CreateRegistry, CreateSchema; Fixed issue when duplicate keys are present and not returned as part of QuerySchemaVersionMetadata.

2021/02/23 - 1 updated api methods