Amazon EMR Containers

2024/04/24 - 3 new 3 updated api methods

Changes   EMRonEKS Service support for SecurityConfiguration enforcement for Spark Jobs.

2024/04/04 - 1 updated api methods

Changes   This release adds support for integration with EKS AccessEntry APIs to enable automatic Cluster Access for EMR on EKS.

2023/06/07 - 6 updated api methods

Changes   EMR on EKS adds support for log rotation of Spark container logs with EMR-6.11.0 onwards, to the StartJobRun API.

2023/04/27 - 1 new api methods

Changes   This release adds GetManagedEndpointSessionCredentials, a new API that allows customers to generate an auth token to connect to a managed endpoint, enabling features such as self-hosted Jupyter notebooks for EMR on EKS.

2023/02/09 - 3 updated api methods

Changes   EMR on EKS allows configuring retry policies for job runs through the StartJobRun API. Using retry policies, a job cause a driver pod to be restarted automatically if it fails or is deleted. The job's status can be seen in the DescribeJobRun and ListJobRun APIs and monitored using CloudWatch events.

2022/11/04 - 4 new 1 updated api methods

Changes   Adding support for Job templates. Job templates allow you to create and store templates to configure Spark applications parameters. This helps you ensure consistent settings across applications by reusing and enforcing configuration overrides in data pipelines.

2022/09/08 - 3 updated api methods

Changes   EMR on EKS now allows running Spark SQL using the newly introduced Spark SQL Job Driver in the Start Job Run API

2021/10/26 - 2 updated api methods

Changes   This feature enables auto-generation of certificate to secure the managed-endpoint and removes the need for customer provided certificate-arn during managed-endpoint setup.

2021/07/19 - 2 updated api methods

Changes   Updated DescribeManagedEndpoint and ListManagedEndpoints to return failureReason and stateDetails in API response.

2020/12/08 - 15 new api methods

Changes   This release adds support for Amazon EMR on EKS, a simple way to run Spark on Kubernetes.