2026/11/05 - AWS Glue - 3 new3 updated api methods
Changes AWS Glue Spark ETL jobs can now auto-upgrade to the latest version. Set GlueVersion to Auto, then track progress with the AutoVersionStatus field in GetJob. Use StartJobUpgradeAnalysis to approve or decline an upgrade, GetJobUpgradeAnalysis to view details, and StopJobUpgradeAnalysis to stop it.
Stops an in-progress upgrade analysis.
See also: AWS API Documentation
Request Syntax
client.stop_job_upgrade_analysis(
jobName='string',
analysisId='string'
)
string
[REQUIRED]
The name of the job associated with the analysis.
string
[REQUIRED]
The unique identifier of the analysis to stop.
dict
Response Syntax
{}
Response Structure
(dict) --
Retrieves the current status and results of an upgrade analysis.
See also: AWS API Documentation
Request Syntax
client.get_job_upgrade_analysis(
analysisId='string',
jobName='string'
)
string
[REQUIRED]
The unique identifier of the upgrade analysis to retrieve.
string
[REQUIRED]
The name of the job associated with the analysis.
dict
Response Syntax
{
'jobName': 'string',
'analysisId': 'string',
'status': 'OBSERVING'|'WAITING_FOR_CONSENT'|'UPGRADING'|'SUCCEEDED'|'FAILED'|'TIMEOUT'|'STOPPED',
'sourceVersion': 'string',
'targetVersion': 'string',
'analysisType': 'AUTO_UPGRADE',
'autoUpgradeEvaluationSummary': 'string',
'errorMessage': 'string',
'autoUpgradeEligibilitySummary': 'string'
}
Response Structure
(dict) --
jobName (string) --
The name of the job associated with this analysis.
analysisId (string) --
The unique identifier of the upgrade analysis.
status (string) --
The current status of the analysis.
sourceVersion (string) --
The Glue version the job was running before the upgrade, for example 4.0.
targetVersion (string) --
The Glue version the job will be upgraded to, for example 6.0.
analysisType (string) --
The type of upgrade analysis. For auto-upgrade jobs, this value is AUTO_UPGRADE.
autoUpgradeEvaluationSummary (string) --
The Amazon S3 URI of the terminal-state evaluation summary, available once the analysis reaches a terminal status ( SUCCEEDED or FAILED).
errorMessage (string) --
The reason the analysis did not complete.
autoUpgradeEligibilitySummary (string) --
The Amazon S3 URI of the consent report summarizing upgrade assessment findings. Populated when the analysis reaches WAITING_FOR_CONSENT and remains available in all subsequent states.
Resumes an analysis that is waiting for upgrade consent.
See also: AWS API Documentation
Request Syntax
client.start_job_upgrade_analysis(
jobName='string',
analysisId='string',
upgradeConsent='APPROVE'|'DECLINE'
)
string
[REQUIRED]
The name of the job associated with the analysis to resume.
string
The unique identifier of the upgrade analysis. The analysis must be in WAITING_FOR_CONSENT status.
string
The customer's decision on whether to proceed with the upgrade.
dict
Response Syntax
{
'analysisId': 'string',
'jobName': 'string'
}
Response Structure
(dict) --
analysisId (string) --
The unique identifier of the upgrade analysis.
jobName (string) --
The name of the job associated with this analysis.
{'Jobs': {'AutoUpgradeMetadata': {'AnalysisId': 'string',
'SourceVersion': 'string',
'Status': 'OBSERVING | UPGRADING | '
'UPGRADE_SUCCEEDED | '
'UPGRADE_FAILED | STOPPED | '
'WAITING_FOR_CONSENT',
'TargetVersion': 'string'}}}
Returns a list of resource metadata for a given list of job names. After calling the ListJobs operation, you can call this operation to access the data to which you have been granted permissions. This operation supports all IAM permissions, including permission conditions that uses tags.
See also: AWS API Documentation
Request Syntax
client.batch_get_jobs(
JobNames=[
'string',
]
)
list
[REQUIRED]
A list of job names, which might be the names returned from the ListJobs operation.
(string) --
dict
Response Syntax
# This section is too large to render. # Please see the AWS API Documentation linked below.
Response Structure
# This section is too large to render. # Please see the AWS API Documentation linked below.
{'Job': {'AutoUpgradeMetadata': {'AnalysisId': 'string',
'SourceVersion': 'string',
'Status': 'OBSERVING | UPGRADING | '
'UPGRADE_SUCCEEDED | UPGRADE_FAILED '
'| STOPPED | WAITING_FOR_CONSENT',
'TargetVersion': 'string'}}}
Retrieves an existing job definition.
See also: AWS API Documentation
Request Syntax
client.get_job(
JobName='string'
)
string
[REQUIRED]
The name of the job definition to retrieve.
dict
Response Syntax
# This section is too large to render. # Please see the AWS API Documentation linked below.
Response Structure
# This section is too large to render. # Please see the AWS API Documentation linked below.
{'Jobs': {'AutoUpgradeMetadata': {'AnalysisId': 'string',
'SourceVersion': 'string',
'Status': 'OBSERVING | UPGRADING | '
'UPGRADE_SUCCEEDED | '
'UPGRADE_FAILED | STOPPED | '
'WAITING_FOR_CONSENT',
'TargetVersion': 'string'}}}
Retrieves all current job definitions.
See also: AWS API Documentation
Request Syntax
client.get_jobs(
NextToken='string',
MaxResults=123
)
string
A continuation token, if this is a continuation call.
integer
The maximum size of the response.
dict
Response Syntax
# This section is too large to render. # Please see the AWS API Documentation linked below.
Response Structure
# This section is too large to render. # Please see the AWS API Documentation linked below.