AWS Glue

2026/11/05 - AWS Glue - 3 new 3 updated api methods

Changes  AWS Glue Spark ETL jobs can now auto-upgrade to the latest version. Set GlueVersion to Auto, then track progress with the AutoVersionStatus field in GetJob. Use StartJobUpgradeAnalysis to approve or decline an upgrade, GetJobUpgradeAnalysis to view details, and StopJobUpgradeAnalysis to stop it.

StartJobUpgradeAnalysis (new) Link ¶

Resumes an analysis that is waiting for upgrade consent.

See also: AWS API Documentation

Request Syntax

client.start_job_upgrade_analysis(
    jobName='string',
    analysisId='string',
    upgradeConsent='APPROVE'|'DECLINE'
)
type jobName:

string

param jobName:

[REQUIRED]

The name of the job associated with the analysis to resume.

type analysisId:

string

param analysisId:

The unique identifier of the upgrade analysis. The analysis must be in WAITING_FOR_CONSENT status.

type upgradeConsent:

string

param upgradeConsent:

The customer's decision on whether to proceed with the upgrade.

rtype:

dict

returns:

Response Syntax

{
    'analysisId': 'string',
    'jobName': 'string'
}

Response Structure

  • (dict) --

    • analysisId (string) --

      The unique identifier of the upgrade analysis.

    • jobName (string) --

      The name of the job associated with this analysis.

StopJobUpgradeAnalysis (new) Link ¶

Stops an in-progress upgrade analysis.

See also: AWS API Documentation

Request Syntax

client.stop_job_upgrade_analysis(
    jobName='string',
    analysisId='string'
)
type jobName:

string

param jobName:

[REQUIRED]

The name of the job associated with the analysis.

type analysisId:

string

param analysisId:

[REQUIRED]

The unique identifier of the analysis to stop.

rtype:

dict

returns:

Response Syntax

{}

Response Structure

  • (dict) --

GetJobUpgradeAnalysis (new) Link ¶

Retrieves the current status and results of an upgrade analysis.

See also: AWS API Documentation

Request Syntax

client.get_job_upgrade_analysis(
    analysisId='string',
    jobName='string'
)
type analysisId:

string

param analysisId:

[REQUIRED]

The unique identifier of the upgrade analysis to retrieve.

type jobName:

string

param jobName:

[REQUIRED]

The name of the job associated with the analysis.

rtype:

dict

returns:

Response Syntax

{
    'jobName': 'string',
    'analysisId': 'string',
    'status': 'OBSERVING'|'WAITING_FOR_CONSENT'|'UPGRADING'|'SUCCEEDED'|'FAILED'|'TIMEOUT'|'STOPPED',
    'sourceVersion': 'string',
    'targetVersion': 'string',
    'analysisType': 'AUTO_UPGRADE',
    'autoUpgradeEvaluationSummary': 'string',
    'errorMessage': 'string',
    'autoUpgradeEligibilitySummary': 'string'
}

Response Structure

  • (dict) --

    • jobName (string) --

      The name of the job associated with this analysis.

    • analysisId (string) --

      The unique identifier of the upgrade analysis.

    • status (string) --

      The current status of the analysis.

    • sourceVersion (string) --

      The Glue version the job was running before the upgrade, for example 4.0.

    • targetVersion (string) --

      The Glue version the job will be upgraded to, for example 6.0.

    • analysisType (string) --

      The type of upgrade analysis. For auto-upgrade jobs, this value is AUTO_UPGRADE.

    • autoUpgradeEvaluationSummary (string) --

      The Amazon S3 URI of the terminal-state evaluation summary, available once the analysis reaches a terminal status ( SUCCEEDED or FAILED).

    • errorMessage (string) --

      The reason the analysis did not complete.

    • autoUpgradeEligibilitySummary (string) --

      The Amazon S3 URI of the consent report summarizing upgrade assessment findings. Populated when the analysis reaches WAITING_FOR_CONSENT and remains available in all subsequent states.

BatchGetJobs (updated) Link ¶
Changes (response)
{'Jobs': {'AutoUpgradeMetadata': {'AnalysisId': 'string',
                                  'SourceVersion': 'string',
                                  'Status': 'OBSERVING | UPGRADING | '
                                            'UPGRADE_SUCCEEDED | '
                                            'UPGRADE_FAILED | STOPPED | '
                                            'WAITING_FOR_CONSENT',
                                  'TargetVersion': 'string'}}}

Returns a list of resource metadata for a given list of job names. After calling the ListJobs operation, you can call this operation to access the data to which you have been granted permissions. This operation supports all IAM permissions, including permission conditions that uses tags.

See also: AWS API Documentation

Request Syntax

client.batch_get_jobs(
    JobNames=[
        'string',
    ]
)
type JobNames:

list

param JobNames:

[REQUIRED]

A list of job names, which might be the names returned from the ListJobs operation.

  • (string) --

rtype:

dict

returns:

Response Syntax

# This section is too large to render.
# Please see the AWS API Documentation linked below.

AWS API Documentation

Response Structure

# This section is too large to render.
# Please see the AWS API Documentation linked below.

AWS API Documentation

GetJob (updated) Link ¶
Changes (response)
{'Job': {'AutoUpgradeMetadata': {'AnalysisId': 'string',
                                 'SourceVersion': 'string',
                                 'Status': 'OBSERVING | UPGRADING | '
                                           'UPGRADE_SUCCEEDED | UPGRADE_FAILED '
                                           '| STOPPED | WAITING_FOR_CONSENT',
                                 'TargetVersion': 'string'}}}

Retrieves an existing job definition.

See also: AWS API Documentation

Request Syntax

client.get_job(
    JobName='string'
)
type JobName:

string

param JobName:

[REQUIRED]

The name of the job definition to retrieve.

rtype:

dict

returns:

Response Syntax

# This section is too large to render.
# Please see the AWS API Documentation linked below.

AWS API Documentation

Response Structure

# This section is too large to render.
# Please see the AWS API Documentation linked below.

AWS API Documentation

GetJobs (updated) Link ¶
Changes (response)
{'Jobs': {'AutoUpgradeMetadata': {'AnalysisId': 'string',
                                  'SourceVersion': 'string',
                                  'Status': 'OBSERVING | UPGRADING | '
                                            'UPGRADE_SUCCEEDED | '
                                            'UPGRADE_FAILED | STOPPED | '
                                            'WAITING_FOR_CONSENT',
                                  'TargetVersion': 'string'}}}

Retrieves all current job definitions.

See also: AWS API Documentation

Request Syntax

client.get_jobs(
    NextToken='string',
    MaxResults=123
)
type NextToken:

string

param NextToken:

A continuation token, if this is a continuation call.

type MaxResults:

integer

param MaxResults:

The maximum size of the response.

rtype:

dict

returns:

Response Syntax

# This section is too large to render.
# Please see the AWS API Documentation linked below.

AWS API Documentation

Response Structure

# This section is too large to render.
# Please see the AWS API Documentation linked below.

AWS API Documentation