2026/04/10 - Amazon SageMaker Service - 1 new 4 updated api methods
Changes Support new SageMaker StartClusterHealthCheck API for on-demand DHC on Hyperpod EKS cluster. Support updated CreateCluster, UpdateCluster, DescribeCluster, BatchAddClusterNodes APIs for flexible instance group on HyperPod cluster
Start deep health checks for a SageMaker HyperPod cluster. You can use DescribeClusterNode API to track progress of the deep health checks. The unhealthy nodes will be automatically rebooted or replaced. Please see Resilience-related Kubernetes labels by SageMaker HyperPod for details.
See also: AWS API Documentation
Request Syntax
client.start_cluster_health_check(
ClusterName='string',
DeepHealthCheckConfigurations=[
{
'InstanceGroupName': 'string',
'InstanceIds': [
'string',
],
'DeepHealthChecks': [
'InstanceStress'|'InstanceConnectivity',
]
},
]
)
string
[REQUIRED]
The string name or the Amazon Resource Name (ARN) of the SageMaker HyperPod cluster.
list
[REQUIRED]
A list of configurations containing instance group names, EC2 instance IDs, and deep health checks to perform.
(dict) --
The configuration of deep health checks for an instance group.
InstanceGroupName (string) -- [REQUIRED]
The name of the instance group.
InstanceIds (list) --
A list of Amazon Elastic Compute Cloud (EC2) instance IDs on which to perform deep health checks.
(string) --
DeepHealthChecks (list) -- [REQUIRED]
A list of deep health checks to be performed.
(string) --
dict
Response Syntax
{
'ClusterArn': 'string'
}
Response Structure
(dict) --
ClusterArn (string) --
The Amazon Resource Name (ARN) of the SageMaker HyperPod cluster on which the deep health checks were initiated.
{'NodesToAdd': {'AvailabilityZones': ['string'],
'InstanceTypes': ['ml.p4d.24xlarge | ml.p4de.24xlarge | '
'ml.p5.48xlarge | ml.p5.4xlarge | '
'ml.p6e-gb200.36xlarge | ml.trn1.32xlarge | '
'ml.trn1n.32xlarge | ml.g5.xlarge | '
'ml.g5.2xlarge | ml.g5.4xlarge | '
'ml.g5.8xlarge | ml.g5.12xlarge | '
'ml.g5.16xlarge | ml.g5.24xlarge | '
'ml.g5.48xlarge | ml.c5.large | ml.c5.xlarge '
'| ml.c5.2xlarge | ml.c5.4xlarge | '
'ml.c5.9xlarge | ml.c5.12xlarge | '
'ml.c5.18xlarge | ml.c5.24xlarge | '
'ml.c5n.large | ml.c5n.2xlarge | '
'ml.c5n.4xlarge | ml.c5n.9xlarge | '
'ml.c5n.18xlarge | ml.m5.large | '
'ml.m5.xlarge | ml.m5.2xlarge | '
'ml.m5.4xlarge | ml.m5.8xlarge | '
'ml.m5.12xlarge | ml.m5.16xlarge | '
'ml.m5.24xlarge | ml.t3.medium | ml.t3.large '
'| ml.t3.xlarge | ml.t3.2xlarge | '
'ml.g6.xlarge | ml.g6.2xlarge | '
'ml.g6.4xlarge | ml.g6.8xlarge | '
'ml.g6.16xlarge | ml.g6.12xlarge | '
'ml.g6.24xlarge | ml.g6.48xlarge | '
'ml.gr6.4xlarge | ml.gr6.8xlarge | '
'ml.g6e.xlarge | ml.g6e.2xlarge | '
'ml.g6e.4xlarge | ml.g6e.8xlarge | '
'ml.g6e.16xlarge | ml.g6e.12xlarge | '
'ml.g6e.24xlarge | ml.g6e.48xlarge | '
'ml.p5e.48xlarge | ml.p5en.48xlarge | '
'ml.p6-b200.48xlarge | ml.trn2.3xlarge | '
'ml.trn2.48xlarge | ml.c6i.large | '
'ml.c6i.xlarge | ml.c6i.2xlarge | '
'ml.c6i.4xlarge | ml.c6i.8xlarge | '
'ml.c6i.12xlarge | ml.c6i.16xlarge | '
'ml.c6i.24xlarge | ml.c6i.32xlarge | '
'ml.m6i.large | ml.m6i.xlarge | '
'ml.m6i.2xlarge | ml.m6i.4xlarge | '
'ml.m6i.8xlarge | ml.m6i.12xlarge | '
'ml.m6i.16xlarge | ml.m6i.24xlarge | '
'ml.m6i.32xlarge | ml.r6i.large | '
'ml.r6i.xlarge | ml.r6i.2xlarge | '
'ml.r6i.4xlarge | ml.r6i.8xlarge | '
'ml.r6i.12xlarge | ml.r6i.16xlarge | '
'ml.r6i.24xlarge | ml.r6i.32xlarge | '
'ml.i3en.large | ml.i3en.xlarge | '
'ml.i3en.2xlarge | ml.i3en.3xlarge | '
'ml.i3en.6xlarge | ml.i3en.12xlarge | '
'ml.i3en.24xlarge | ml.m7i.large | '
'ml.m7i.xlarge | ml.m7i.2xlarge | '
'ml.m7i.4xlarge | ml.m7i.8xlarge | '
'ml.m7i.12xlarge | ml.m7i.16xlarge | '
'ml.m7i.24xlarge | ml.m7i.48xlarge | '
'ml.r7i.large | ml.r7i.xlarge | '
'ml.r7i.2xlarge | ml.r7i.4xlarge | '
'ml.r7i.8xlarge | ml.r7i.12xlarge | '
'ml.r7i.16xlarge | ml.r7i.24xlarge | '
'ml.r7i.48xlarge | ml.r5d.16xlarge | '
'ml.g7e.2xlarge | ml.g7e.4xlarge | '
'ml.g7e.8xlarge | ml.g7e.12xlarge | '
'ml.g7e.24xlarge | ml.g7e.48xlarge | '
'ml.p6-b300.48xlarge']}}
Response {'Failed': {'AvailabilityZones': ['string'],
'ErrorCode': {'IncompatibleAvailabilityZones',
'IncompatibleInstanceTypes'},
'InstanceTypes': ['ml.p4d.24xlarge | ml.p4de.24xlarge | '
'ml.p5.48xlarge | ml.p5.4xlarge | '
'ml.p6e-gb200.36xlarge | ml.trn1.32xlarge | '
'ml.trn1n.32xlarge | ml.g5.xlarge | '
'ml.g5.2xlarge | ml.g5.4xlarge | ml.g5.8xlarge | '
'ml.g5.12xlarge | ml.g5.16xlarge | '
'ml.g5.24xlarge | ml.g5.48xlarge | ml.c5.large | '
'ml.c5.xlarge | ml.c5.2xlarge | ml.c5.4xlarge | '
'ml.c5.9xlarge | ml.c5.12xlarge | ml.c5.18xlarge '
'| ml.c5.24xlarge | ml.c5n.large | '
'ml.c5n.2xlarge | ml.c5n.4xlarge | '
'ml.c5n.9xlarge | ml.c5n.18xlarge | ml.m5.large '
'| ml.m5.xlarge | ml.m5.2xlarge | ml.m5.4xlarge '
'| ml.m5.8xlarge | ml.m5.12xlarge | '
'ml.m5.16xlarge | ml.m5.24xlarge | ml.t3.medium '
'| ml.t3.large | ml.t3.xlarge | ml.t3.2xlarge | '
'ml.g6.xlarge | ml.g6.2xlarge | ml.g6.4xlarge | '
'ml.g6.8xlarge | ml.g6.16xlarge | ml.g6.12xlarge '
'| ml.g6.24xlarge | ml.g6.48xlarge | '
'ml.gr6.4xlarge | ml.gr6.8xlarge | ml.g6e.xlarge '
'| ml.g6e.2xlarge | ml.g6e.4xlarge | '
'ml.g6e.8xlarge | ml.g6e.16xlarge | '
'ml.g6e.12xlarge | ml.g6e.24xlarge | '
'ml.g6e.48xlarge | ml.p5e.48xlarge | '
'ml.p5en.48xlarge | ml.p6-b200.48xlarge | '
'ml.trn2.3xlarge | ml.trn2.48xlarge | '
'ml.c6i.large | ml.c6i.xlarge | ml.c6i.2xlarge | '
'ml.c6i.4xlarge | ml.c6i.8xlarge | '
'ml.c6i.12xlarge | ml.c6i.16xlarge | '
'ml.c6i.24xlarge | ml.c6i.32xlarge | '
'ml.m6i.large | ml.m6i.xlarge | ml.m6i.2xlarge | '
'ml.m6i.4xlarge | ml.m6i.8xlarge | '
'ml.m6i.12xlarge | ml.m6i.16xlarge | '
'ml.m6i.24xlarge | ml.m6i.32xlarge | '
'ml.r6i.large | ml.r6i.xlarge | ml.r6i.2xlarge | '
'ml.r6i.4xlarge | ml.r6i.8xlarge | '
'ml.r6i.12xlarge | ml.r6i.16xlarge | '
'ml.r6i.24xlarge | ml.r6i.32xlarge | '
'ml.i3en.large | ml.i3en.xlarge | '
'ml.i3en.2xlarge | ml.i3en.3xlarge | '
'ml.i3en.6xlarge | ml.i3en.12xlarge | '
'ml.i3en.24xlarge | ml.m7i.large | ml.m7i.xlarge '
'| ml.m7i.2xlarge | ml.m7i.4xlarge | '
'ml.m7i.8xlarge | ml.m7i.12xlarge | '
'ml.m7i.16xlarge | ml.m7i.24xlarge | '
'ml.m7i.48xlarge | ml.r7i.large | ml.r7i.xlarge '
'| ml.r7i.2xlarge | ml.r7i.4xlarge | '
'ml.r7i.8xlarge | ml.r7i.12xlarge | '
'ml.r7i.16xlarge | ml.r7i.24xlarge | '
'ml.r7i.48xlarge | ml.r5d.16xlarge | '
'ml.g7e.2xlarge | ml.g7e.4xlarge | '
'ml.g7e.8xlarge | ml.g7e.12xlarge | '
'ml.g7e.24xlarge | ml.g7e.48xlarge | '
'ml.p6-b300.48xlarge']},
'Successful': {'AvailabilityZones': ['string'],
'InstanceTypes': ['ml.p4d.24xlarge | ml.p4de.24xlarge | '
'ml.p5.48xlarge | ml.p5.4xlarge | '
'ml.p6e-gb200.36xlarge | ml.trn1.32xlarge | '
'ml.trn1n.32xlarge | ml.g5.xlarge | '
'ml.g5.2xlarge | ml.g5.4xlarge | '
'ml.g5.8xlarge | ml.g5.12xlarge | '
'ml.g5.16xlarge | ml.g5.24xlarge | '
'ml.g5.48xlarge | ml.c5.large | ml.c5.xlarge '
'| ml.c5.2xlarge | ml.c5.4xlarge | '
'ml.c5.9xlarge | ml.c5.12xlarge | '
'ml.c5.18xlarge | ml.c5.24xlarge | '
'ml.c5n.large | ml.c5n.2xlarge | '
'ml.c5n.4xlarge | ml.c5n.9xlarge | '
'ml.c5n.18xlarge | ml.m5.large | '
'ml.m5.xlarge | ml.m5.2xlarge | '
'ml.m5.4xlarge | ml.m5.8xlarge | '
'ml.m5.12xlarge | ml.m5.16xlarge | '
'ml.m5.24xlarge | ml.t3.medium | ml.t3.large '
'| ml.t3.xlarge | ml.t3.2xlarge | '
'ml.g6.xlarge | ml.g6.2xlarge | '
'ml.g6.4xlarge | ml.g6.8xlarge | '
'ml.g6.16xlarge | ml.g6.12xlarge | '
'ml.g6.24xlarge | ml.g6.48xlarge | '
'ml.gr6.4xlarge | ml.gr6.8xlarge | '
'ml.g6e.xlarge | ml.g6e.2xlarge | '
'ml.g6e.4xlarge | ml.g6e.8xlarge | '
'ml.g6e.16xlarge | ml.g6e.12xlarge | '
'ml.g6e.24xlarge | ml.g6e.48xlarge | '
'ml.p5e.48xlarge | ml.p5en.48xlarge | '
'ml.p6-b200.48xlarge | ml.trn2.3xlarge | '
'ml.trn2.48xlarge | ml.c6i.large | '
'ml.c6i.xlarge | ml.c6i.2xlarge | '
'ml.c6i.4xlarge | ml.c6i.8xlarge | '
'ml.c6i.12xlarge | ml.c6i.16xlarge | '
'ml.c6i.24xlarge | ml.c6i.32xlarge | '
'ml.m6i.large | ml.m6i.xlarge | '
'ml.m6i.2xlarge | ml.m6i.4xlarge | '
'ml.m6i.8xlarge | ml.m6i.12xlarge | '
'ml.m6i.16xlarge | ml.m6i.24xlarge | '
'ml.m6i.32xlarge | ml.r6i.large | '
'ml.r6i.xlarge | ml.r6i.2xlarge | '
'ml.r6i.4xlarge | ml.r6i.8xlarge | '
'ml.r6i.12xlarge | ml.r6i.16xlarge | '
'ml.r6i.24xlarge | ml.r6i.32xlarge | '
'ml.i3en.large | ml.i3en.xlarge | '
'ml.i3en.2xlarge | ml.i3en.3xlarge | '
'ml.i3en.6xlarge | ml.i3en.12xlarge | '
'ml.i3en.24xlarge | ml.m7i.large | '
'ml.m7i.xlarge | ml.m7i.2xlarge | '
'ml.m7i.4xlarge | ml.m7i.8xlarge | '
'ml.m7i.12xlarge | ml.m7i.16xlarge | '
'ml.m7i.24xlarge | ml.m7i.48xlarge | '
'ml.r7i.large | ml.r7i.xlarge | '
'ml.r7i.2xlarge | ml.r7i.4xlarge | '
'ml.r7i.8xlarge | ml.r7i.12xlarge | '
'ml.r7i.16xlarge | ml.r7i.24xlarge | '
'ml.r7i.48xlarge | ml.r5d.16xlarge | '
'ml.g7e.2xlarge | ml.g7e.4xlarge | '
'ml.g7e.8xlarge | ml.g7e.12xlarge | '
'ml.g7e.24xlarge | ml.g7e.48xlarge | '
'ml.p6-b300.48xlarge']}}
Adds nodes to a HyperPod cluster by incrementing the target count for one or more instance groups. This operation returns a unique NodeLogicalId for each node being added, which can be used to track the provisioning status of the node. This API provides a safer alternative to UpdateCluster for scaling operations by avoiding unintended configuration changes.
See also: AWS API Documentation
Request Syntax
client.batch_add_cluster_nodes(
ClusterName='string',
ClientToken='string',
NodesToAdd=[
{
'InstanceGroupName': 'string',
'IncrementTargetCountBy': 123,
'AvailabilityZones': [
'string',
],
'InstanceTypes': [
'ml.p4d.24xlarge'|'ml.p4de.24xlarge'|'ml.p5.48xlarge'|'ml.p5.4xlarge'|'ml.p6e-gb200.36xlarge'|'ml.trn1.32xlarge'|'ml.trn1n.32xlarge'|'ml.g5.xlarge'|'ml.g5.2xlarge'|'ml.g5.4xlarge'|'ml.g5.8xlarge'|'ml.g5.12xlarge'|'ml.g5.16xlarge'|'ml.g5.24xlarge'|'ml.g5.48xlarge'|'ml.c5.large'|'ml.c5.xlarge'|'ml.c5.2xlarge'|'ml.c5.4xlarge'|'ml.c5.9xlarge'|'ml.c5.12xlarge'|'ml.c5.18xlarge'|'ml.c5.24xlarge'|'ml.c5n.large'|'ml.c5n.2xlarge'|'ml.c5n.4xlarge'|'ml.c5n.9xlarge'|'ml.c5n.18xlarge'|'ml.m5.large'|'ml.m5.xlarge'|'ml.m5.2xlarge'|'ml.m5.4xlarge'|'ml.m5.8xlarge'|'ml.m5.12xlarge'|'ml.m5.16xlarge'|'ml.m5.24xlarge'|'ml.t3.medium'|'ml.t3.large'|'ml.t3.xlarge'|'ml.t3.2xlarge'|'ml.g6.xlarge'|'ml.g6.2xlarge'|'ml.g6.4xlarge'|'ml.g6.8xlarge'|'ml.g6.16xlarge'|'ml.g6.12xlarge'|'ml.g6.24xlarge'|'ml.g6.48xlarge'|'ml.gr6.4xlarge'|'ml.gr6.8xlarge'|'ml.g6e.xlarge'|'ml.g6e.2xlarge'|'ml.g6e.4xlarge'|'ml.g6e.8xlarge'|'ml.g6e.16xlarge'|'ml.g6e.12xlarge'|'ml.g6e.24xlarge'|'ml.g6e.48xlarge'|'ml.p5e.48xlarge'|'ml.p5en.48xlarge'|'ml.p6-b200.48xlarge'|'ml.trn2.3xlarge'|'ml.trn2.48xlarge'|'ml.c6i.large'|'ml.c6i.xlarge'|'ml.c6i.2xlarge'|'ml.c6i.4xlarge'|'ml.c6i.8xlarge'|'ml.c6i.12xlarge'|'ml.c6i.16xlarge'|'ml.c6i.24xlarge'|'ml.c6i.32xlarge'|'ml.m6i.large'|'ml.m6i.xlarge'|'ml.m6i.2xlarge'|'ml.m6i.4xlarge'|'ml.m6i.8xlarge'|'ml.m6i.12xlarge'|'ml.m6i.16xlarge'|'ml.m6i.24xlarge'|'ml.m6i.32xlarge'|'ml.r6i.large'|'ml.r6i.xlarge'|'ml.r6i.2xlarge'|'ml.r6i.4xlarge'|'ml.r6i.8xlarge'|'ml.r6i.12xlarge'|'ml.r6i.16xlarge'|'ml.r6i.24xlarge'|'ml.r6i.32xlarge'|'ml.i3en.large'|'ml.i3en.xlarge'|'ml.i3en.2xlarge'|'ml.i3en.3xlarge'|'ml.i3en.6xlarge'|'ml.i3en.12xlarge'|'ml.i3en.24xlarge'|'ml.m7i.large'|'ml.m7i.xlarge'|'ml.m7i.2xlarge'|'ml.m7i.4xlarge'|'ml.m7i.8xlarge'|'ml.m7i.12xlarge'|'ml.m7i.16xlarge'|'ml.m7i.24xlarge'|'ml.m7i.48xlarge'|'ml.r7i.large'|'ml.r7i.xlarge'|'ml.r7i.2xlarge'|'ml.r7i.4xlarge'|'ml.r7i.8xlarge'|'ml.r7i.12xlarge'|'ml.r7i.16xlarge'|'ml.r7i.24xlarge'|'ml.r7i.48xlarge'|'ml.r5d.16xlarge'|'ml.g7e.2xlarge'|'ml.g7e.4xlarge'|'ml.g7e.8xlarge'|'ml.g7e.12xlarge'|'ml.g7e.24xlarge'|'ml.g7e.48xlarge'|'ml.p6-b300.48xlarge',
]
},
]
)
string
[REQUIRED]
The name of the HyperPod cluster to which you want to add nodes.
string
A unique, case-sensitive identifier that you provide to ensure the idempotency of the request. This token is valid for 8 hours. If you retry the request with the same client token within this timeframe and the same parameters, the API returns the same set of NodeLogicalIds with their latest status.
This field is autopopulated if not provided.
list
[REQUIRED]
A list of instance groups and the number of nodes to add to each. You can specify up to 5 instance groups in a single request, with a maximum of 50 nodes total across all instance groups.
(dict) --
Specifies an instance group and the number of nodes to add to it.
InstanceGroupName (string) -- [REQUIRED]
The name of the instance group to which you want to add nodes.
IncrementTargetCountBy (integer) -- [REQUIRED]
The number of nodes to add to the specified instance group. The total number of nodes across all instance groups in a single request cannot exceed 50.
AvailabilityZones (list) --
The availability zones in which to add nodes. Use this to target node placement in specific availability zones within a flexible instance group.
(string) --
InstanceTypes (list) --
The instance types to use when adding nodes. Use this to target specific instance types within a flexible instance group.
(string) --
dict
Response Syntax
{
'Successful': [
{
'NodeLogicalId': 'string',
'InstanceGroupName': 'string',
'Status': 'Running'|'Failure'|'Pending'|'ShuttingDown'|'SystemUpdating'|'DeepHealthCheckInProgress'|'NotFound',
'AvailabilityZones': [
'string',
],
'InstanceTypes': [
'ml.p4d.24xlarge'|'ml.p4de.24xlarge'|'ml.p5.48xlarge'|'ml.p5.4xlarge'|'ml.p6e-gb200.36xlarge'|'ml.trn1.32xlarge'|'ml.trn1n.32xlarge'|'ml.g5.xlarge'|'ml.g5.2xlarge'|'ml.g5.4xlarge'|'ml.g5.8xlarge'|'ml.g5.12xlarge'|'ml.g5.16xlarge'|'ml.g5.24xlarge'|'ml.g5.48xlarge'|'ml.c5.large'|'ml.c5.xlarge'|'ml.c5.2xlarge'|'ml.c5.4xlarge'|'ml.c5.9xlarge'|'ml.c5.12xlarge'|'ml.c5.18xlarge'|'ml.c5.24xlarge'|'ml.c5n.large'|'ml.c5n.2xlarge'|'ml.c5n.4xlarge'|'ml.c5n.9xlarge'|'ml.c5n.18xlarge'|'ml.m5.large'|'ml.m5.xlarge'|'ml.m5.2xlarge'|'ml.m5.4xlarge'|'ml.m5.8xlarge'|'ml.m5.12xlarge'|'ml.m5.16xlarge'|'ml.m5.24xlarge'|'ml.t3.medium'|'ml.t3.large'|'ml.t3.xlarge'|'ml.t3.2xlarge'|'ml.g6.xlarge'|'ml.g6.2xlarge'|'ml.g6.4xlarge'|'ml.g6.8xlarge'|'ml.g6.16xlarge'|'ml.g6.12xlarge'|'ml.g6.24xlarge'|'ml.g6.48xlarge'|'ml.gr6.4xlarge'|'ml.gr6.8xlarge'|'ml.g6e.xlarge'|'ml.g6e.2xlarge'|'ml.g6e.4xlarge'|'ml.g6e.8xlarge'|'ml.g6e.16xlarge'|'ml.g6e.12xlarge'|'ml.g6e.24xlarge'|'ml.g6e.48xlarge'|'ml.p5e.48xlarge'|'ml.p5en.48xlarge'|'ml.p6-b200.48xlarge'|'ml.trn2.3xlarge'|'ml.trn2.48xlarge'|'ml.c6i.large'|'ml.c6i.xlarge'|'ml.c6i.2xlarge'|'ml.c6i.4xlarge'|'ml.c6i.8xlarge'|'ml.c6i.12xlarge'|'ml.c6i.16xlarge'|'ml.c6i.24xlarge'|'ml.c6i.32xlarge'|'ml.m6i.large'|'ml.m6i.xlarge'|'ml.m6i.2xlarge'|'ml.m6i.4xlarge'|'ml.m6i.8xlarge'|'ml.m6i.12xlarge'|'ml.m6i.16xlarge'|'ml.m6i.24xlarge'|'ml.m6i.32xlarge'|'ml.r6i.large'|'ml.r6i.xlarge'|'ml.r6i.2xlarge'|'ml.r6i.4xlarge'|'ml.r6i.8xlarge'|'ml.r6i.12xlarge'|'ml.r6i.16xlarge'|'ml.r6i.24xlarge'|'ml.r6i.32xlarge'|'ml.i3en.large'|'ml.i3en.xlarge'|'ml.i3en.2xlarge'|'ml.i3en.3xlarge'|'ml.i3en.6xlarge'|'ml.i3en.12xlarge'|'ml.i3en.24xlarge'|'ml.m7i.large'|'ml.m7i.xlarge'|'ml.m7i.2xlarge'|'ml.m7i.4xlarge'|'ml.m7i.8xlarge'|'ml.m7i.12xlarge'|'ml.m7i.16xlarge'|'ml.m7i.24xlarge'|'ml.m7i.48xlarge'|'ml.r7i.large'|'ml.r7i.xlarge'|'ml.r7i.2xlarge'|'ml.r7i.4xlarge'|'ml.r7i.8xlarge'|'ml.r7i.12xlarge'|'ml.r7i.16xlarge'|'ml.r7i.24xlarge'|'ml.r7i.48xlarge'|'ml.r5d.16xlarge'|'ml.g7e.2xlarge'|'ml.g7e.4xlarge'|'ml.g7e.8xlarge'|'ml.g7e.12xlarge'|'ml.g7e.24xlarge'|'ml.g7e.48xlarge'|'ml.p6-b300.48xlarge',
]
},
],
'Failed': [
{
'InstanceGroupName': 'string',
'ErrorCode': 'InstanceGroupNotFound'|'InvalidInstanceGroupStatus'|'IncompatibleAvailabilityZones'|'IncompatibleInstanceTypes',
'FailedCount': 123,
'AvailabilityZones': [
'string',
],
'InstanceTypes': [
'ml.p4d.24xlarge'|'ml.p4de.24xlarge'|'ml.p5.48xlarge'|'ml.p5.4xlarge'|'ml.p6e-gb200.36xlarge'|'ml.trn1.32xlarge'|'ml.trn1n.32xlarge'|'ml.g5.xlarge'|'ml.g5.2xlarge'|'ml.g5.4xlarge'|'ml.g5.8xlarge'|'ml.g5.12xlarge'|'ml.g5.16xlarge'|'ml.g5.24xlarge'|'ml.g5.48xlarge'|'ml.c5.large'|'ml.c5.xlarge'|'ml.c5.2xlarge'|'ml.c5.4xlarge'|'ml.c5.9xlarge'|'ml.c5.12xlarge'|'ml.c5.18xlarge'|'ml.c5.24xlarge'|'ml.c5n.large'|'ml.c5n.2xlarge'|'ml.c5n.4xlarge'|'ml.c5n.9xlarge'|'ml.c5n.18xlarge'|'ml.m5.large'|'ml.m5.xlarge'|'ml.m5.2xlarge'|'ml.m5.4xlarge'|'ml.m5.8xlarge'|'ml.m5.12xlarge'|'ml.m5.16xlarge'|'ml.m5.24xlarge'|'ml.t3.medium'|'ml.t3.large'|'ml.t3.xlarge'|'ml.t3.2xlarge'|'ml.g6.xlarge'|'ml.g6.2xlarge'|'ml.g6.4xlarge'|'ml.g6.8xlarge'|'ml.g6.16xlarge'|'ml.g6.12xlarge'|'ml.g6.24xlarge'|'ml.g6.48xlarge'|'ml.gr6.4xlarge'|'ml.gr6.8xlarge'|'ml.g6e.xlarge'|'ml.g6e.2xlarge'|'ml.g6e.4xlarge'|'ml.g6e.8xlarge'|'ml.g6e.16xlarge'|'ml.g6e.12xlarge'|'ml.g6e.24xlarge'|'ml.g6e.48xlarge'|'ml.p5e.48xlarge'|'ml.p5en.48xlarge'|'ml.p6-b200.48xlarge'|'ml.trn2.3xlarge'|'ml.trn2.48xlarge'|'ml.c6i.large'|'ml.c6i.xlarge'|'ml.c6i.2xlarge'|'ml.c6i.4xlarge'|'ml.c6i.8xlarge'|'ml.c6i.12xlarge'|'ml.c6i.16xlarge'|'ml.c6i.24xlarge'|'ml.c6i.32xlarge'|'ml.m6i.large'|'ml.m6i.xlarge'|'ml.m6i.2xlarge'|'ml.m6i.4xlarge'|'ml.m6i.8xlarge'|'ml.m6i.12xlarge'|'ml.m6i.16xlarge'|'ml.m6i.24xlarge'|'ml.m6i.32xlarge'|'ml.r6i.large'|'ml.r6i.xlarge'|'ml.r6i.2xlarge'|'ml.r6i.4xlarge'|'ml.r6i.8xlarge'|'ml.r6i.12xlarge'|'ml.r6i.16xlarge'|'ml.r6i.24xlarge'|'ml.r6i.32xlarge'|'ml.i3en.large'|'ml.i3en.xlarge'|'ml.i3en.2xlarge'|'ml.i3en.3xlarge'|'ml.i3en.6xlarge'|'ml.i3en.12xlarge'|'ml.i3en.24xlarge'|'ml.m7i.large'|'ml.m7i.xlarge'|'ml.m7i.2xlarge'|'ml.m7i.4xlarge'|'ml.m7i.8xlarge'|'ml.m7i.12xlarge'|'ml.m7i.16xlarge'|'ml.m7i.24xlarge'|'ml.m7i.48xlarge'|'ml.r7i.large'|'ml.r7i.xlarge'|'ml.r7i.2xlarge'|'ml.r7i.4xlarge'|'ml.r7i.8xlarge'|'ml.r7i.12xlarge'|'ml.r7i.16xlarge'|'ml.r7i.24xlarge'|'ml.r7i.48xlarge'|'ml.r5d.16xlarge'|'ml.g7e.2xlarge'|'ml.g7e.4xlarge'|'ml.g7e.8xlarge'|'ml.g7e.12xlarge'|'ml.g7e.24xlarge'|'ml.g7e.48xlarge'|'ml.p6-b300.48xlarge',
],
'Message': 'string'
},
]
}
Response Structure
(dict) --
Successful (list) --
A list of NodeLogicalIDs that were successfully added to the cluster. The NodeLogicalID is unique per cluster and does not change between instance replacements. Each entry includes a NodeLogicalId that can be used to track the node's provisioning status (with DescribeClusterNode), the instance group name, and the current status of the node.
(dict) --
Information about a node that was successfully added to the cluster.
NodeLogicalId (string) --
A unique identifier assigned to the node that can be used to track its provisioning status through the DescribeClusterNode operation.
InstanceGroupName (string) --
The name of the instance group to which the node was added.
Status (string) --
The current status of the node. Possible values include Pending, Running, Failed, ShuttingDown, SystemUpdating, DeepHealthCheckInProgress, and NotFound.
AvailabilityZones (list) --
The availability zones associated with the successfully added node.
(string) --
InstanceTypes (list) --
The instance types associated with the successfully added node.
(string) --
Failed (list) --
A list of errors that occurred during the node addition operation. Each entry includes the instance group name, error code, number of failed additions, and an error message.
(dict) --
Information about an error that occurred during the node addition operation.
InstanceGroupName (string) --
The name of the instance group for which the error occurred.
ErrorCode (string) --
The error code associated with the failure. Possible values include InstanceGroupNotFound and InvalidInstanceGroupState.
FailedCount (integer) --
The number of nodes that failed to be added to the specified instance group.
AvailabilityZones (list) --
The availability zones associated with the failed node addition request.
(string) --
InstanceTypes (list) --
The instance types associated with the failed node addition request.
(string) --
Message (string) --
A descriptive message providing additional details about the error.
{'InstanceGroups': {'InstanceRequirements': {'InstanceTypes': ['ml.p4d.24xlarge '
'| '
'ml.p4de.24xlarge '
'| '
'ml.p5.48xlarge '
'| '
'ml.p5.4xlarge '
'| '
'ml.p6e-gb200.36xlarge '
'| '
'ml.trn1.32xlarge '
'| '
'ml.trn1n.32xlarge '
'| ml.g5.xlarge '
'| '
'ml.g5.2xlarge '
'| '
'ml.g5.4xlarge '
'| '
'ml.g5.8xlarge '
'| '
'ml.g5.12xlarge '
'| '
'ml.g5.16xlarge '
'| '
'ml.g5.24xlarge '
'| '
'ml.g5.48xlarge '
'| ml.c5.large '
'| ml.c5.xlarge '
'| '
'ml.c5.2xlarge '
'| '
'ml.c5.4xlarge '
'| '
'ml.c5.9xlarge '
'| '
'ml.c5.12xlarge '
'| '
'ml.c5.18xlarge '
'| '
'ml.c5.24xlarge '
'| ml.c5n.large '
'| '
'ml.c5n.2xlarge '
'| '
'ml.c5n.4xlarge '
'| '
'ml.c5n.9xlarge '
'| '
'ml.c5n.18xlarge '
'| ml.m5.large '
'| ml.m5.xlarge '
'| '
'ml.m5.2xlarge '
'| '
'ml.m5.4xlarge '
'| '
'ml.m5.8xlarge '
'| '
'ml.m5.12xlarge '
'| '
'ml.m5.16xlarge '
'| '
'ml.m5.24xlarge '
'| ml.t3.medium '
'| ml.t3.large '
'| ml.t3.xlarge '
'| '
'ml.t3.2xlarge '
'| ml.g6.xlarge '
'| '
'ml.g6.2xlarge '
'| '
'ml.g6.4xlarge '
'| '
'ml.g6.8xlarge '
'| '
'ml.g6.16xlarge '
'| '
'ml.g6.12xlarge '
'| '
'ml.g6.24xlarge '
'| '
'ml.g6.48xlarge '
'| '
'ml.gr6.4xlarge '
'| '
'ml.gr6.8xlarge '
'| '
'ml.g6e.xlarge '
'| '
'ml.g6e.2xlarge '
'| '
'ml.g6e.4xlarge '
'| '
'ml.g6e.8xlarge '
'| '
'ml.g6e.16xlarge '
'| '
'ml.g6e.12xlarge '
'| '
'ml.g6e.24xlarge '
'| '
'ml.g6e.48xlarge '
'| '
'ml.p5e.48xlarge '
'| '
'ml.p5en.48xlarge '
'| '
'ml.p6-b200.48xlarge '
'| '
'ml.trn2.3xlarge '
'| '
'ml.trn2.48xlarge '
'| ml.c6i.large '
'| '
'ml.c6i.xlarge '
'| '
'ml.c6i.2xlarge '
'| '
'ml.c6i.4xlarge '
'| '
'ml.c6i.8xlarge '
'| '
'ml.c6i.12xlarge '
'| '
'ml.c6i.16xlarge '
'| '
'ml.c6i.24xlarge '
'| '
'ml.c6i.32xlarge '
'| ml.m6i.large '
'| '
'ml.m6i.xlarge '
'| '
'ml.m6i.2xlarge '
'| '
'ml.m6i.4xlarge '
'| '
'ml.m6i.8xlarge '
'| '
'ml.m6i.12xlarge '
'| '
'ml.m6i.16xlarge '
'| '
'ml.m6i.24xlarge '
'| '
'ml.m6i.32xlarge '
'| ml.r6i.large '
'| '
'ml.r6i.xlarge '
'| '
'ml.r6i.2xlarge '
'| '
'ml.r6i.4xlarge '
'| '
'ml.r6i.8xlarge '
'| '
'ml.r6i.12xlarge '
'| '
'ml.r6i.16xlarge '
'| '
'ml.r6i.24xlarge '
'| '
'ml.r6i.32xlarge '
'| '
'ml.i3en.large '
'| '
'ml.i3en.xlarge '
'| '
'ml.i3en.2xlarge '
'| '
'ml.i3en.3xlarge '
'| '
'ml.i3en.6xlarge '
'| '
'ml.i3en.12xlarge '
'| '
'ml.i3en.24xlarge '
'| ml.m7i.large '
'| '
'ml.m7i.xlarge '
'| '
'ml.m7i.2xlarge '
'| '
'ml.m7i.4xlarge '
'| '
'ml.m7i.8xlarge '
'| '
'ml.m7i.12xlarge '
'| '
'ml.m7i.16xlarge '
'| '
'ml.m7i.24xlarge '
'| '
'ml.m7i.48xlarge '
'| ml.r7i.large '
'| '
'ml.r7i.xlarge '
'| '
'ml.r7i.2xlarge '
'| '
'ml.r7i.4xlarge '
'| '
'ml.r7i.8xlarge '
'| '
'ml.r7i.12xlarge '
'| '
'ml.r7i.16xlarge '
'| '
'ml.r7i.24xlarge '
'| '
'ml.r7i.48xlarge '
'| '
'ml.r5d.16xlarge '
'| '
'ml.g7e.2xlarge '
'| '
'ml.g7e.4xlarge '
'| '
'ml.g7e.8xlarge '
'| '
'ml.g7e.12xlarge '
'| '
'ml.g7e.24xlarge '
'| '
'ml.g7e.48xlarge '
'| '
'ml.p6-b300.48xlarge']}}}
Creates an Amazon SageMaker HyperPod cluster. SageMaker HyperPod is a capability of SageMaker for creating and managing persistent clusters for developing large machine learning models, such as large language models (LLMs) and diffusion models. To learn more, see Amazon SageMaker HyperPod in the Amazon SageMaker Developer Guide.
See also: AWS API Documentation
Request Syntax
client.create_cluster(
ClusterName='string',
InstanceGroups=[
{
'InstanceCount': 123,
'MinInstanceCount': 123,
'InstanceGroupName': 'string',
'InstanceType': 'ml.p4d.24xlarge'|'ml.p4de.24xlarge'|'ml.p5.48xlarge'|'ml.p5.4xlarge'|'ml.p6e-gb200.36xlarge'|'ml.trn1.32xlarge'|'ml.trn1n.32xlarge'|'ml.g5.xlarge'|'ml.g5.2xlarge'|'ml.g5.4xlarge'|'ml.g5.8xlarge'|'ml.g5.12xlarge'|'ml.g5.16xlarge'|'ml.g5.24xlarge'|'ml.g5.48xlarge'|'ml.c5.large'|'ml.c5.xlarge'|'ml.c5.2xlarge'|'ml.c5.4xlarge'|'ml.c5.9xlarge'|'ml.c5.12xlarge'|'ml.c5.18xlarge'|'ml.c5.24xlarge'|'ml.c5n.large'|'ml.c5n.2xlarge'|'ml.c5n.4xlarge'|'ml.c5n.9xlarge'|'ml.c5n.18xlarge'|'ml.m5.large'|'ml.m5.xlarge'|'ml.m5.2xlarge'|'ml.m5.4xlarge'|'ml.m5.8xlarge'|'ml.m5.12xlarge'|'ml.m5.16xlarge'|'ml.m5.24xlarge'|'ml.t3.medium'|'ml.t3.large'|'ml.t3.xlarge'|'ml.t3.2xlarge'|'ml.g6.xlarge'|'ml.g6.2xlarge'|'ml.g6.4xlarge'|'ml.g6.8xlarge'|'ml.g6.16xlarge'|'ml.g6.12xlarge'|'ml.g6.24xlarge'|'ml.g6.48xlarge'|'ml.gr6.4xlarge'|'ml.gr6.8xlarge'|'ml.g6e.xlarge'|'ml.g6e.2xlarge'|'ml.g6e.4xlarge'|'ml.g6e.8xlarge'|'ml.g6e.16xlarge'|'ml.g6e.12xlarge'|'ml.g6e.24xlarge'|'ml.g6e.48xlarge'|'ml.p5e.48xlarge'|'ml.p5en.48xlarge'|'ml.p6-b200.48xlarge'|'ml.trn2.3xlarge'|'ml.trn2.48xlarge'|'ml.c6i.large'|'ml.c6i.xlarge'|'ml.c6i.2xlarge'|'ml.c6i.4xlarge'|'ml.c6i.8xlarge'|'ml.c6i.12xlarge'|'ml.c6i.16xlarge'|'ml.c6i.24xlarge'|'ml.c6i.32xlarge'|'ml.m6i.large'|'ml.m6i.xlarge'|'ml.m6i.2xlarge'|'ml.m6i.4xlarge'|'ml.m6i.8xlarge'|'ml.m6i.12xlarge'|'ml.m6i.16xlarge'|'ml.m6i.24xlarge'|'ml.m6i.32xlarge'|'ml.r6i.large'|'ml.r6i.xlarge'|'ml.r6i.2xlarge'|'ml.r6i.4xlarge'|'ml.r6i.8xlarge'|'ml.r6i.12xlarge'|'ml.r6i.16xlarge'|'ml.r6i.24xlarge'|'ml.r6i.32xlarge'|'ml.i3en.large'|'ml.i3en.xlarge'|'ml.i3en.2xlarge'|'ml.i3en.3xlarge'|'ml.i3en.6xlarge'|'ml.i3en.12xlarge'|'ml.i3en.24xlarge'|'ml.m7i.large'|'ml.m7i.xlarge'|'ml.m7i.2xlarge'|'ml.m7i.4xlarge'|'ml.m7i.8xlarge'|'ml.m7i.12xlarge'|'ml.m7i.16xlarge'|'ml.m7i.24xlarge'|'ml.m7i.48xlarge'|'ml.r7i.large'|'ml.r7i.xlarge'|'ml.r7i.2xlarge'|'ml.r7i.4xlarge'|'ml.r7i.8xlarge'|'ml.r7i.12xlarge'|'ml.r7i.16xlarge'|'ml.r7i.24xlarge'|'ml.r7i.48xlarge'|'ml.r5d.16xlarge'|'ml.g7e.2xlarge'|'ml.g7e.4xlarge'|'ml.g7e.8xlarge'|'ml.g7e.12xlarge'|'ml.g7e.24xlarge'|'ml.g7e.48xlarge'|'ml.p6-b300.48xlarge',
'InstanceRequirements': {
'InstanceTypes': [
'ml.p4d.24xlarge'|'ml.p4de.24xlarge'|'ml.p5.48xlarge'|'ml.p5.4xlarge'|'ml.p6e-gb200.36xlarge'|'ml.trn1.32xlarge'|'ml.trn1n.32xlarge'|'ml.g5.xlarge'|'ml.g5.2xlarge'|'ml.g5.4xlarge'|'ml.g5.8xlarge'|'ml.g5.12xlarge'|'ml.g5.16xlarge'|'ml.g5.24xlarge'|'ml.g5.48xlarge'|'ml.c5.large'|'ml.c5.xlarge'|'ml.c5.2xlarge'|'ml.c5.4xlarge'|'ml.c5.9xlarge'|'ml.c5.12xlarge'|'ml.c5.18xlarge'|'ml.c5.24xlarge'|'ml.c5n.large'|'ml.c5n.2xlarge'|'ml.c5n.4xlarge'|'ml.c5n.9xlarge'|'ml.c5n.18xlarge'|'ml.m5.large'|'ml.m5.xlarge'|'ml.m5.2xlarge'|'ml.m5.4xlarge'|'ml.m5.8xlarge'|'ml.m5.12xlarge'|'ml.m5.16xlarge'|'ml.m5.24xlarge'|'ml.t3.medium'|'ml.t3.large'|'ml.t3.xlarge'|'ml.t3.2xlarge'|'ml.g6.xlarge'|'ml.g6.2xlarge'|'ml.g6.4xlarge'|'ml.g6.8xlarge'|'ml.g6.16xlarge'|'ml.g6.12xlarge'|'ml.g6.24xlarge'|'ml.g6.48xlarge'|'ml.gr6.4xlarge'|'ml.gr6.8xlarge'|'ml.g6e.xlarge'|'ml.g6e.2xlarge'|'ml.g6e.4xlarge'|'ml.g6e.8xlarge'|'ml.g6e.16xlarge'|'ml.g6e.12xlarge'|'ml.g6e.24xlarge'|'ml.g6e.48xlarge'|'ml.p5e.48xlarge'|'ml.p5en.48xlarge'|'ml.p6-b200.48xlarge'|'ml.trn2.3xlarge'|'ml.trn2.48xlarge'|'ml.c6i.large'|'ml.c6i.xlarge'|'ml.c6i.2xlarge'|'ml.c6i.4xlarge'|'ml.c6i.8xlarge'|'ml.c6i.12xlarge'|'ml.c6i.16xlarge'|'ml.c6i.24xlarge'|'ml.c6i.32xlarge'|'ml.m6i.large'|'ml.m6i.xlarge'|'ml.m6i.2xlarge'|'ml.m6i.4xlarge'|'ml.m6i.8xlarge'|'ml.m6i.12xlarge'|'ml.m6i.16xlarge'|'ml.m6i.24xlarge'|'ml.m6i.32xlarge'|'ml.r6i.large'|'ml.r6i.xlarge'|'ml.r6i.2xlarge'|'ml.r6i.4xlarge'|'ml.r6i.8xlarge'|'ml.r6i.12xlarge'|'ml.r6i.16xlarge'|'ml.r6i.24xlarge'|'ml.r6i.32xlarge'|'ml.i3en.large'|'ml.i3en.xlarge'|'ml.i3en.2xlarge'|'ml.i3en.3xlarge'|'ml.i3en.6xlarge'|'ml.i3en.12xlarge'|'ml.i3en.24xlarge'|'ml.m7i.large'|'ml.m7i.xlarge'|'ml.m7i.2xlarge'|'ml.m7i.4xlarge'|'ml.m7i.8xlarge'|'ml.m7i.12xlarge'|'ml.m7i.16xlarge'|'ml.m7i.24xlarge'|'ml.m7i.48xlarge'|'ml.r7i.large'|'ml.r7i.xlarge'|'ml.r7i.2xlarge'|'ml.r7i.4xlarge'|'ml.r7i.8xlarge'|'ml.r7i.12xlarge'|'ml.r7i.16xlarge'|'ml.r7i.24xlarge'|'ml.r7i.48xlarge'|'ml.r5d.16xlarge'|'ml.g7e.2xlarge'|'ml.g7e.4xlarge'|'ml.g7e.8xlarge'|'ml.g7e.12xlarge'|'ml.g7e.24xlarge'|'ml.g7e.48xlarge'|'ml.p6-b300.48xlarge',
]
},
'LifeCycleConfig': {
'SourceS3Uri': 'string',
'OnCreate': 'string'
},
'ExecutionRole': 'string',
'ThreadsPerCore': 123,
'InstanceStorageConfigs': [
{
'EbsVolumeConfig': {
'VolumeSizeInGB': 123,
'VolumeKmsKeyId': 'string',
'RootVolume': True|False
},
'FsxLustreConfig': {
'DnsName': 'string',
'MountName': 'string',
'MountPath': 'string'
},
'FsxOpenZfsConfig': {
'DnsName': 'string',
'MountPath': 'string'
}
},
],
'OnStartDeepHealthChecks': [
'InstanceStress'|'InstanceConnectivity',
],
'TrainingPlanArn': 'string',
'OverrideVpcConfig': {
'SecurityGroupIds': [
'string',
],
'Subnets': [
'string',
]
},
'ScheduledUpdateConfig': {
'ScheduleExpression': 'string',
'DeploymentConfig': {
'RollingUpdatePolicy': {
'MaximumBatchSize': {
'Type': 'INSTANCE_COUNT'|'CAPACITY_PERCENTAGE',
'Value': 123
},
'RollbackMaximumBatchSize': {
'Type': 'INSTANCE_COUNT'|'CAPACITY_PERCENTAGE',
'Value': 123
}
},
'WaitIntervalInSeconds': 123,
'AutoRollbackConfiguration': [
{
'AlarmName': 'string'
},
]
}
},
'ImageId': 'string',
'KubernetesConfig': {
'Labels': {
'string': 'string'
},
'Taints': [
{
'Key': 'string',
'Value': 'string',
'Effect': 'NoSchedule'|'PreferNoSchedule'|'NoExecute'
},
]
},
'SlurmConfig': {
'NodeType': 'Controller'|'Login'|'Compute',
'PartitionNames': [
'string',
]
},
'CapacityRequirements': {
'Spot': {}
,
'OnDemand': {}
}
},
],
RestrictedInstanceGroups=[
{
'InstanceCount': 123,
'InstanceGroupName': 'string',
'InstanceType': 'ml.p4d.24xlarge'|'ml.p4de.24xlarge'|'ml.p5.48xlarge'|'ml.p5.4xlarge'|'ml.p6e-gb200.36xlarge'|'ml.trn1.32xlarge'|'ml.trn1n.32xlarge'|'ml.g5.xlarge'|'ml.g5.2xlarge'|'ml.g5.4xlarge'|'ml.g5.8xlarge'|'ml.g5.12xlarge'|'ml.g5.16xlarge'|'ml.g5.24xlarge'|'ml.g5.48xlarge'|'ml.c5.large'|'ml.c5.xlarge'|'ml.c5.2xlarge'|'ml.c5.4xlarge'|'ml.c5.9xlarge'|'ml.c5.12xlarge'|'ml.c5.18xlarge'|'ml.c5.24xlarge'|'ml.c5n.large'|'ml.c5n.2xlarge'|'ml.c5n.4xlarge'|'ml.c5n.9xlarge'|'ml.c5n.18xlarge'|'ml.m5.large'|'ml.m5.xlarge'|'ml.m5.2xlarge'|'ml.m5.4xlarge'|'ml.m5.8xlarge'|'ml.m5.12xlarge'|'ml.m5.16xlarge'|'ml.m5.24xlarge'|'ml.t3.medium'|'ml.t3.large'|'ml.t3.xlarge'|'ml.t3.2xlarge'|'ml.g6.xlarge'|'ml.g6.2xlarge'|'ml.g6.4xlarge'|'ml.g6.8xlarge'|'ml.g6.16xlarge'|'ml.g6.12xlarge'|'ml.g6.24xlarge'|'ml.g6.48xlarge'|'ml.gr6.4xlarge'|'ml.gr6.8xlarge'|'ml.g6e.xlarge'|'ml.g6e.2xlarge'|'ml.g6e.4xlarge'|'ml.g6e.8xlarge'|'ml.g6e.16xlarge'|'ml.g6e.12xlarge'|'ml.g6e.24xlarge'|'ml.g6e.48xlarge'|'ml.p5e.48xlarge'|'ml.p5en.48xlarge'|'ml.p6-b200.48xlarge'|'ml.trn2.3xlarge'|'ml.trn2.48xlarge'|'ml.c6i.large'|'ml.c6i.xlarge'|'ml.c6i.2xlarge'|'ml.c6i.4xlarge'|'ml.c6i.8xlarge'|'ml.c6i.12xlarge'|'ml.c6i.16xlarge'|'ml.c6i.24xlarge'|'ml.c6i.32xlarge'|'ml.m6i.large'|'ml.m6i.xlarge'|'ml.m6i.2xlarge'|'ml.m6i.4xlarge'|'ml.m6i.8xlarge'|'ml.m6i.12xlarge'|'ml.m6i.16xlarge'|'ml.m6i.24xlarge'|'ml.m6i.32xlarge'|'ml.r6i.large'|'ml.r6i.xlarge'|'ml.r6i.2xlarge'|'ml.r6i.4xlarge'|'ml.r6i.8xlarge'|'ml.r6i.12xlarge'|'ml.r6i.16xlarge'|'ml.r6i.24xlarge'|'ml.r6i.32xlarge'|'ml.i3en.large'|'ml.i3en.xlarge'|'ml.i3en.2xlarge'|'ml.i3en.3xlarge'|'ml.i3en.6xlarge'|'ml.i3en.12xlarge'|'ml.i3en.24xlarge'|'ml.m7i.large'|'ml.m7i.xlarge'|'ml.m7i.2xlarge'|'ml.m7i.4xlarge'|'ml.m7i.8xlarge'|'ml.m7i.12xlarge'|'ml.m7i.16xlarge'|'ml.m7i.24xlarge'|'ml.m7i.48xlarge'|'ml.r7i.large'|'ml.r7i.xlarge'|'ml.r7i.2xlarge'|'ml.r7i.4xlarge'|'ml.r7i.8xlarge'|'ml.r7i.12xlarge'|'ml.r7i.16xlarge'|'ml.r7i.24xlarge'|'ml.r7i.48xlarge'|'ml.r5d.16xlarge'|'ml.g7e.2xlarge'|'ml.g7e.4xlarge'|'ml.g7e.8xlarge'|'ml.g7e.12xlarge'|'ml.g7e.24xlarge'|'ml.g7e.48xlarge'|'ml.p6-b300.48xlarge',
'ExecutionRole': 'string',
'ThreadsPerCore': 123,
'InstanceStorageConfigs': [
{
'EbsVolumeConfig': {
'VolumeSizeInGB': 123,
'VolumeKmsKeyId': 'string',
'RootVolume': True|False
},
'FsxLustreConfig': {
'DnsName': 'string',
'MountName': 'string',
'MountPath': 'string'
},
'FsxOpenZfsConfig': {
'DnsName': 'string',
'MountPath': 'string'
}
},
],
'OnStartDeepHealthChecks': [
'InstanceStress'|'InstanceConnectivity',
],
'TrainingPlanArn': 'string',
'OverrideVpcConfig': {
'SecurityGroupIds': [
'string',
],
'Subnets': [
'string',
]
},
'ScheduledUpdateConfig': {
'ScheduleExpression': 'string',
'DeploymentConfig': {
'RollingUpdatePolicy': {
'MaximumBatchSize': {
'Type': 'INSTANCE_COUNT'|'CAPACITY_PERCENTAGE',
'Value': 123
},
'RollbackMaximumBatchSize': {
'Type': 'INSTANCE_COUNT'|'CAPACITY_PERCENTAGE',
'Value': 123
}
},
'WaitIntervalInSeconds': 123,
'AutoRollbackConfiguration': [
{
'AlarmName': 'string'
},
]
}
},
'EnvironmentConfig': {
'FSxLustreConfig': {
'SizeInGiB': 123,
'PerUnitStorageThroughput': 123
}
}
},
],
VpcConfig={
'SecurityGroupIds': [
'string',
],
'Subnets': [
'string',
]
},
Tags=[
{
'Key': 'string',
'Value': 'string'
},
],
Orchestrator={
'Eks': {
'ClusterArn': 'string'
},
'Slurm': {
'SlurmConfigStrategy': 'Overwrite'|'Managed'|'Merge'
}
},
NodeRecovery='Automatic'|'None',
TieredStorageConfig={
'Mode': 'Enable'|'Disable',
'InstanceMemoryAllocationPercentage': 123
},
NodeProvisioningMode='Continuous',
ClusterRole='string',
AutoScaling={
'Mode': 'Enable'|'Disable',
'AutoScalerType': 'Karpenter'
}
)
string
[REQUIRED]
The name for the new SageMaker HyperPod cluster.
list
The instance groups to be created in the SageMaker HyperPod cluster.
(dict) --
The specifications of an instance group that you need to define.
InstanceCount (integer) -- [REQUIRED]
Specifies the number of instances to add to the instance group of a SageMaker HyperPod cluster.
MinInstanceCount (integer) --
Defines the minimum number of instances required for an instance group to become InService. If this threshold isn't met within 3 hours, the instance group rolls back to its previous state - zero instances for new instance groups, or previous settings for existing instance groups. MinInstanceCount only affects the initial transition to InService and does not guarantee maintaining this minimum afterward.
InstanceGroupName (string) -- [REQUIRED]
Specifies the name of the instance group.
InstanceType (string) --
Specifies the instance type of the instance group.
InstanceRequirements (dict) --
The instance requirements for the instance group, including the instance types to use. Use this to create a flexible instance group that supports multiple instance types. The InstanceType and InstanceRequirements properties are mutually exclusive.
InstanceTypes (list) -- [REQUIRED]
The list of instance types that the instance group can use. The order of instance types determines the priority—HyperPod attempts to provision instances using the first instance type in the list and falls back to subsequent types if capacity is unavailable.
(string) --
LifeCycleConfig (dict) --
Specifies the LifeCycle configuration for the instance group.
SourceS3Uri (string) --
An Amazon S3 bucket path where your lifecycle scripts are stored.
OnCreate (string) --
The file name of the entrypoint script of lifecycle scripts under SourceS3Uri. This entrypoint script runs during cluster creation.
ExecutionRole (string) -- [REQUIRED]
Specifies an IAM execution role to be assumed by the instance group.
ThreadsPerCore (integer) --
Specifies the value for Threads per core. For instance types that support multithreading, you can specify 1 for disabling multithreading and 2 for enabling multithreading. For instance types that doesn't support multithreading, specify 1. For more information, see the reference table of CPU cores and threads per CPU core per instance type in the Amazon Elastic Compute Cloud User Guide.
InstanceStorageConfigs (list) --
Specifies the additional storage configurations for the instances in the SageMaker HyperPod cluster instance group.
(dict) --
Defines the configuration for attaching additional storage to the instances in the SageMaker HyperPod cluster instance group. To learn more, see SageMaker HyperPod release notes: June 20, 2024.
EbsVolumeConfig (dict) --
Defines the configuration for attaching additional Amazon Elastic Block Store (EBS) volumes to the instances in the SageMaker HyperPod cluster instance group. The additional EBS volume is attached to each instance within the SageMaker HyperPod cluster instance group and mounted to /opt/sagemaker.
VolumeSizeInGB (integer) --
The size in gigabytes (GB) of the additional EBS volume to be attached to the instances in the SageMaker HyperPod cluster instance group. The additional EBS volume is attached to each instance within the SageMaker HyperPod cluster instance group and mounted to /opt/sagemaker.
VolumeKmsKeyId (string) --
The ID of a KMS key to encrypt the Amazon EBS volume.
RootVolume (boolean) --
Specifies whether the configuration is for the cluster's root or secondary Amazon EBS volume. You can specify two ClusterEbsVolumeConfig fields to configure both the root and secondary volumes. Set the value to True if you'd like to provide your own customer managed Amazon Web Services KMS key to encrypt the root volume. When True:
The configuration is applied to the root volume.
You can't specify the VolumeSizeInGB field. The size of the root volume is determined for you.
You must specify a KMS key ID for VolumeKmsKeyId to encrypt the root volume with your own KMS key instead of an Amazon Web Services owned KMS key.
Otherwise, by default, the value is False, and the following applies:
The configuration is applied to the secondary volume, while the root volume is encrypted with an Amazon Web Services owned key.
You must specify the VolumeSizeInGB field.
You can optionally specify the VolumeKmsKeyId to encrypt the secondary volume with your own KMS key instead of an Amazon Web Services owned KMS key.
FsxLustreConfig (dict) --
Defines the configuration for attaching an Amazon FSx for Lustre file system to the instances in the SageMaker HyperPod cluster instance group.
DnsName (string) -- [REQUIRED]
The DNS name of the Amazon FSx for Lustre file system.
MountName (string) -- [REQUIRED]
The mount name of the Amazon FSx for Lustre file system.
MountPath (string) --
The local path where the Amazon FSx for Lustre file system is mounted on instances.
FsxOpenZfsConfig (dict) --
Defines the configuration for attaching an Amazon FSx for OpenZFS file system to the instances in the SageMaker HyperPod cluster instance group.
DnsName (string) -- [REQUIRED]
The DNS name of the Amazon FSx for OpenZFS file system.
MountPath (string) --
The local path where the Amazon FSx for OpenZFS file system is mounted on instances.
OnStartDeepHealthChecks (list) --
A flag indicating whether deep health checks should be performed when the cluster instance group is created or updated.
(string) --
TrainingPlanArn (string) --
The Amazon Resource Name (ARN); of the training plan to use for this cluster instance group.
For more information about how to reserve GPU capacity for your SageMaker HyperPod clusters using Amazon SageMaker Training Plan, see ``CreateTrainingPlan ``.
OverrideVpcConfig (dict) --
To configure multi-AZ deployments, customize the Amazon VPC configuration at the instance group level. You can specify different subnets and security groups across different AZs in the instance group specification to override a SageMaker HyperPod cluster's default Amazon VPC configuration. For more information about deploying a cluster in multiple AZs, see Setting up SageMaker HyperPod clusters across multiple AZs.
SecurityGroupIds (list) -- [REQUIRED]
The VPC security group IDs, in the form sg-xxxxxxxx. Specify the security groups for the VPC that is specified in the Subnets field.
(string) --
Subnets (list) -- [REQUIRED]
The ID of the subnets in the VPC to which you want to connect your training job or model. For information about the availability of specific instance types, see Supported Instance Types and Availability Zones.
(string) --
ScheduledUpdateConfig (dict) --
The configuration object of the schedule that SageMaker uses to update the AMI.
ScheduleExpression (string) -- [REQUIRED]
A cron expression that specifies the schedule that SageMaker follows when updating the AMI.
DeploymentConfig (dict) --
The configuration to use when updating the AMI versions.
RollingUpdatePolicy (dict) --
The policy that SageMaker uses when updating the AMI versions of the cluster.
MaximumBatchSize (dict) -- [REQUIRED]
The maximum amount of instances in the cluster that SageMaker can update at a time.
Type (string) -- [REQUIRED]
Specifies whether SageMaker should process the update by amount or percentage of instances.
Value (integer) -- [REQUIRED]
Specifies the amount or percentage of instances SageMaker updates at a time.
RollbackMaximumBatchSize (dict) --
The maximum amount of instances in the cluster that SageMaker can roll back at a time.
Type (string) -- [REQUIRED]
Specifies whether SageMaker should process the update by amount or percentage of instances.
Value (integer) -- [REQUIRED]
Specifies the amount or percentage of instances SageMaker updates at a time.
WaitIntervalInSeconds (integer) --
The duration in seconds that SageMaker waits before updating more instances in the cluster.
AutoRollbackConfiguration (list) --
An array that contains the alarms that SageMaker monitors to know whether to roll back the AMI update.
(dict) --
The details of the alarm to monitor during the AMI update.
AlarmName (string) -- [REQUIRED]
The name of the alarm.
ImageId (string) --
When configuring your HyperPod cluster, you can specify an image ID using one of the following options:
HyperPodPublicAmiId: Use a HyperPod public AMI
CustomAmiId: Use your custom AMI
default: Use the default latest system image
If you choose to use a custom AMI ( CustomAmiId), ensure it meets the following requirements:
Encryption: The custom AMI must be unencrypted.
Ownership: The custom AMI must be owned by the same Amazon Web Services account that is creating the HyperPod cluster.
Volume support: Only the primary AMI snapshot volume is supported; additional AMI volumes are not supported.
When updating the instance group's AMI through the UpdateClusterSoftware operation, if an instance group uses a custom AMI, you must provide an ImageId or use the default as input. Note that if you don't specify an instance group in your UpdateClusterSoftware request, then all of the instance groups are patched with the specified image.
KubernetesConfig (dict) --
Specifies the Kubernetes configuration for the instance group. You describe what you want the labels and taints to look like, and the cluster works to reconcile the actual state with the declared state for nodes in this instance group.
Labels (dict) --
Key-value pairs of labels to be applied to cluster nodes.
(string) --
(string) --
Taints (list) --
List of taints to be applied to cluster nodes.
(dict) --
A Kubernetes taint that can be applied to cluster nodes.
Key (string) -- [REQUIRED]
The key of the taint.
Value (string) --
The value of the taint.
Effect (string) -- [REQUIRED]
The effect of the taint. Valid values are NoSchedule, PreferNoSchedule, and NoExecute.
SlurmConfig (dict) --
Specifies the Slurm configuration for the instance group.
NodeType (string) -- [REQUIRED]
The type of Slurm node for the instance group. Valid values are Controller, Worker, and Login.
PartitionNames (list) --
The list of Slurm partition names that the instance group belongs to.
(string) --
CapacityRequirements (dict) --
Specifies the capacity requirements for the instance group.
Spot (dict) --
Configuration options specific to Spot instances.
OnDemand (dict) --
Configuration options specific to On-Demand instances.
list
The specialized instance groups for training models like Amazon Nova to be created in the SageMaker HyperPod cluster.
(dict) --
The specifications of a restricted instance group that you need to define.
InstanceCount (integer) -- [REQUIRED]
Specifies the number of instances to add to the restricted instance group of a SageMaker HyperPod cluster.
InstanceGroupName (string) -- [REQUIRED]
Specifies the name of the restricted instance group.
InstanceType (string) -- [REQUIRED]
Specifies the instance type of the restricted instance group.
ExecutionRole (string) -- [REQUIRED]
Specifies an IAM execution role to be assumed by the restricted instance group.
ThreadsPerCore (integer) --
The number you specified to TreadsPerCore in CreateCluster for enabling or disabling multithreading. For instance types that support multithreading, you can specify 1 for disabling multithreading and 2 for enabling multithreading. For more information, see the reference table of CPU cores and threads per CPU core per instance type in the Amazon Elastic Compute Cloud User Guide.
InstanceStorageConfigs (list) --
Specifies the additional storage configurations for the instances in the SageMaker HyperPod cluster restricted instance group.
(dict) --
Defines the configuration for attaching additional storage to the instances in the SageMaker HyperPod cluster instance group. To learn more, see SageMaker HyperPod release notes: June 20, 2024.
EbsVolumeConfig (dict) --
Defines the configuration for attaching additional Amazon Elastic Block Store (EBS) volumes to the instances in the SageMaker HyperPod cluster instance group. The additional EBS volume is attached to each instance within the SageMaker HyperPod cluster instance group and mounted to /opt/sagemaker.
VolumeSizeInGB (integer) --
The size in gigabytes (GB) of the additional EBS volume to be attached to the instances in the SageMaker HyperPod cluster instance group. The additional EBS volume is attached to each instance within the SageMaker HyperPod cluster instance group and mounted to /opt/sagemaker.
VolumeKmsKeyId (string) --
The ID of a KMS key to encrypt the Amazon EBS volume.
RootVolume (boolean) --
Specifies whether the configuration is for the cluster's root or secondary Amazon EBS volume. You can specify two ClusterEbsVolumeConfig fields to configure both the root and secondary volumes. Set the value to True if you'd like to provide your own customer managed Amazon Web Services KMS key to encrypt the root volume. When True:
The configuration is applied to the root volume.
You can't specify the VolumeSizeInGB field. The size of the root volume is determined for you.
You must specify a KMS key ID for VolumeKmsKeyId to encrypt the root volume with your own KMS key instead of an Amazon Web Services owned KMS key.
Otherwise, by default, the value is False, and the following applies:
The configuration is applied to the secondary volume, while the root volume is encrypted with an Amazon Web Services owned key.
You must specify the VolumeSizeInGB field.
You can optionally specify the VolumeKmsKeyId to encrypt the secondary volume with your own KMS key instead of an Amazon Web Services owned KMS key.
FsxLustreConfig (dict) --
Defines the configuration for attaching an Amazon FSx for Lustre file system to the instances in the SageMaker HyperPod cluster instance group.
DnsName (string) -- [REQUIRED]
The DNS name of the Amazon FSx for Lustre file system.
MountName (string) -- [REQUIRED]
The mount name of the Amazon FSx for Lustre file system.
MountPath (string) --
The local path where the Amazon FSx for Lustre file system is mounted on instances.
FsxOpenZfsConfig (dict) --
Defines the configuration for attaching an Amazon FSx for OpenZFS file system to the instances in the SageMaker HyperPod cluster instance group.
DnsName (string) -- [REQUIRED]
The DNS name of the Amazon FSx for OpenZFS file system.
MountPath (string) --
The local path where the Amazon FSx for OpenZFS file system is mounted on instances.
OnStartDeepHealthChecks (list) --
A flag indicating whether deep health checks should be performed when the cluster restricted instance group is created or updated.
(string) --
TrainingPlanArn (string) --
The Amazon Resource Name (ARN) of the training plan to filter clusters by. For more information about reserving GPU capacity for your SageMaker HyperPod clusters using Amazon SageMaker Training Plan, see ``CreateTrainingPlan ``.
OverrideVpcConfig (dict) --
Specifies an Amazon Virtual Private Cloud (VPC) that your SageMaker jobs, hosted models, and compute resources have access to. You can control access to and from your resources by configuring a VPC. For more information, see Give SageMaker Access to Resources in your Amazon VPC.
SecurityGroupIds (list) -- [REQUIRED]
The VPC security group IDs, in the form sg-xxxxxxxx. Specify the security groups for the VPC that is specified in the Subnets field.
(string) --
Subnets (list) -- [REQUIRED]
The ID of the subnets in the VPC to which you want to connect your training job or model. For information about the availability of specific instance types, see Supported Instance Types and Availability Zones.
(string) --
ScheduledUpdateConfig (dict) --
The configuration object of the schedule that SageMaker follows when updating the AMI.
ScheduleExpression (string) -- [REQUIRED]
A cron expression that specifies the schedule that SageMaker follows when updating the AMI.
DeploymentConfig (dict) --
The configuration to use when updating the AMI versions.
RollingUpdatePolicy (dict) --
The policy that SageMaker uses when updating the AMI versions of the cluster.
MaximumBatchSize (dict) -- [REQUIRED]
The maximum amount of instances in the cluster that SageMaker can update at a time.
Type (string) -- [REQUIRED]
Specifies whether SageMaker should process the update by amount or percentage of instances.
Value (integer) -- [REQUIRED]
Specifies the amount or percentage of instances SageMaker updates at a time.
RollbackMaximumBatchSize (dict) --
The maximum amount of instances in the cluster that SageMaker can roll back at a time.
Type (string) -- [REQUIRED]
Specifies whether SageMaker should process the update by amount or percentage of instances.
Value (integer) -- [REQUIRED]
Specifies the amount or percentage of instances SageMaker updates at a time.
WaitIntervalInSeconds (integer) --
The duration in seconds that SageMaker waits before updating more instances in the cluster.
AutoRollbackConfiguration (list) --
An array that contains the alarms that SageMaker monitors to know whether to roll back the AMI update.
(dict) --
The details of the alarm to monitor during the AMI update.
AlarmName (string) -- [REQUIRED]
The name of the alarm.
EnvironmentConfig (dict) -- [REQUIRED]
The configuration for the restricted instance groups (RIG) environment.
FSxLustreConfig (dict) --
Configuration settings for an Amazon FSx for Lustre file system to be used with the cluster.
SizeInGiB (integer) -- [REQUIRED]
The storage capacity of the Amazon FSx for Lustre file system, specified in gibibytes (GiB).
PerUnitStorageThroughput (integer) -- [REQUIRED]
The throughput capacity of the Amazon FSx for Lustre file system, measured in MB/s per TiB of storage.
dict
Specifies the Amazon Virtual Private Cloud (VPC) that is associated with the Amazon SageMaker HyperPod cluster. You can control access to and from your resources by configuring your VPC. For more information, see Give SageMaker access to resources in your Amazon VPC.
SecurityGroupIds (list) -- [REQUIRED]
The VPC security group IDs, in the form sg-xxxxxxxx. Specify the security groups for the VPC that is specified in the Subnets field.
(string) --
Subnets (list) -- [REQUIRED]
The ID of the subnets in the VPC to which you want to connect your training job or model. For information about the availability of specific instance types, see Supported Instance Types and Availability Zones.
(string) --
list
Custom tags for managing the SageMaker HyperPod cluster as an Amazon Web Services resource. You can add tags to your cluster in the same way you add them in other Amazon Web Services services that support tagging. To learn more about tagging Amazon Web Services resources in general, see Tagging Amazon Web Services Resources User Guide.
(dict) --
A tag object that consists of a key and an optional value, used to manage metadata for SageMaker Amazon Web Services resources.
You can add tags to notebook instances, training jobs, hyperparameter tuning jobs, batch transform jobs, models, labeling jobs, work teams, endpoint configurations, and endpoints. For more information on adding tags to SageMaker resources, see AddTags.
For more information on adding metadata to your Amazon Web Services resources with tagging, see Tagging Amazon Web Services resources. For advice on best practices for managing Amazon Web Services resources with tagging, see Tagging Best Practices: Implement an Effective Amazon Web Services Resource Tagging Strategy.
Key (string) -- [REQUIRED]
The tag key. Tag keys must be unique per resource.
Value (string) -- [REQUIRED]
The tag value.
dict
The type of orchestrator to use for the SageMaker HyperPod cluster. Currently, supported values are "Eks" and "Slurm", which is to use an Amazon Elastic Kubernetes Service or Slurm cluster as the orchestrator.
Eks (dict) --
The Amazon EKS cluster used as the orchestrator for the SageMaker HyperPod cluster.
ClusterArn (string) -- [REQUIRED]
The Amazon Resource Name (ARN) of the Amazon EKS cluster associated with the SageMaker HyperPod cluster.
Slurm (dict) --
The Slurm orchestrator configuration for the SageMaker HyperPod cluster.
SlurmConfigStrategy (string) --
The strategy for managing partitions for the Slurm configuration. Valid values are Managed, Overwrite, and Merge.
string
The node recovery mode for the SageMaker HyperPod cluster. When set to Automatic, SageMaker HyperPod will automatically reboot or replace faulty nodes when issues are detected. When set to None, cluster administrators will need to manually manage any faulty cluster instances.
dict
The configuration for managed tier checkpointing on the HyperPod cluster. When enabled, this feature uses a multi-tier storage approach for storing model checkpoints, providing faster checkpoint operations and improved fault tolerance across cluster nodes.
Mode (string) -- [REQUIRED]
Specifies whether managed tier checkpointing is enabled or disabled for the HyperPod cluster. When set to Enable, the system installs a memory management daemon that provides disaggregated memory as a service for checkpoint storage. When set to Disable, the feature is turned off and the memory management daemon is removed from the cluster.
InstanceMemoryAllocationPercentage (integer) --
The percentage (int) of cluster memory to allocate for checkpointing.
string
The mode for provisioning nodes in the cluster. You can specify the following modes:
Continuous: Scaling behavior that enables 1) concurrent operation execution within instance groups, 2) continuous retry mechanisms for failed operations, 3) enhanced customer visibility into cluster events through detailed event streams, 4) partial provisioning capabilities. Your clusters and instance groups remain InService while scaling. This mode is only supported for EKS orchestrated clusters.
string
The Amazon Resource Name (ARN) of the IAM role that HyperPod assumes to perform cluster autoscaling operations. This role must have permissions for sagemaker:BatchAddClusterNodes and sagemaker:BatchDeleteClusterNodes. This is only required when autoscaling is enabled and when HyperPod is performing autoscaling operations.
dict
The autoscaling configuration for the cluster. Enables automatic scaling of cluster nodes based on workload demand using a Karpenter-based system.
Mode (string) -- [REQUIRED]
Describes whether autoscaling is enabled or disabled for the cluster. Valid values are Enable and Disable.
AutoScalerType (string) --
The type of autoscaler to use. Currently supported value is Karpenter.
dict
Response Syntax
{
'ClusterArn': 'string'
}
Response Structure
(dict) --
ClusterArn (string) --
The Amazon Resource Name (ARN) of the cluster.
{'InstanceGroups': {'InstanceRequirements': {'CurrentInstanceTypes': ['ml.p4d.24xlarge '
'| '
'ml.p4de.24xlarge '
'| '
'ml.p5.48xlarge '
'| '
'ml.p5.4xlarge '
'| '
'ml.p6e-gb200.36xlarge '
'| '
'ml.trn1.32xlarge '
'| '
'ml.trn1n.32xlarge '
'| '
'ml.g5.xlarge '
'| '
'ml.g5.2xlarge '
'| '
'ml.g5.4xlarge '
'| '
'ml.g5.8xlarge '
'| '
'ml.g5.12xlarge '
'| '
'ml.g5.16xlarge '
'| '
'ml.g5.24xlarge '
'| '
'ml.g5.48xlarge '
'| '
'ml.c5.large '
'| '
'ml.c5.xlarge '
'| '
'ml.c5.2xlarge '
'| '
'ml.c5.4xlarge '
'| '
'ml.c5.9xlarge '
'| '
'ml.c5.12xlarge '
'| '
'ml.c5.18xlarge '
'| '
'ml.c5.24xlarge '
'| '
'ml.c5n.large '
'| '
'ml.c5n.2xlarge '
'| '
'ml.c5n.4xlarge '
'| '
'ml.c5n.9xlarge '
'| '
'ml.c5n.18xlarge '
'| '
'ml.m5.large '
'| '
'ml.m5.xlarge '
'| '
'ml.m5.2xlarge '
'| '
'ml.m5.4xlarge '
'| '
'ml.m5.8xlarge '
'| '
'ml.m5.12xlarge '
'| '
'ml.m5.16xlarge '
'| '
'ml.m5.24xlarge '
'| '
'ml.t3.medium '
'| '
'ml.t3.large '
'| '
'ml.t3.xlarge '
'| '
'ml.t3.2xlarge '
'| '
'ml.g6.xlarge '
'| '
'ml.g6.2xlarge '
'| '
'ml.g6.4xlarge '
'| '
'ml.g6.8xlarge '
'| '
'ml.g6.16xlarge '
'| '
'ml.g6.12xlarge '
'| '
'ml.g6.24xlarge '
'| '
'ml.g6.48xlarge '
'| '
'ml.gr6.4xlarge '
'| '
'ml.gr6.8xlarge '
'| '
'ml.g6e.xlarge '
'| '
'ml.g6e.2xlarge '
'| '
'ml.g6e.4xlarge '
'| '
'ml.g6e.8xlarge '
'| '
'ml.g6e.16xlarge '
'| '
'ml.g6e.12xlarge '
'| '
'ml.g6e.24xlarge '
'| '
'ml.g6e.48xlarge '
'| '
'ml.p5e.48xlarge '
'| '
'ml.p5en.48xlarge '
'| '
'ml.p6-b200.48xlarge '
'| '
'ml.trn2.3xlarge '
'| '
'ml.trn2.48xlarge '
'| '
'ml.c6i.large '
'| '
'ml.c6i.xlarge '
'| '
'ml.c6i.2xlarge '
'| '
'ml.c6i.4xlarge '
'| '
'ml.c6i.8xlarge '
'| '
'ml.c6i.12xlarge '
'| '
'ml.c6i.16xlarge '
'| '
'ml.c6i.24xlarge '
'| '
'ml.c6i.32xlarge '
'| '
'ml.m6i.large '
'| '
'ml.m6i.xlarge '
'| '
'ml.m6i.2xlarge '
'| '
'ml.m6i.4xlarge '
'| '
'ml.m6i.8xlarge '
'| '
'ml.m6i.12xlarge '
'| '
'ml.m6i.16xlarge '
'| '
'ml.m6i.24xlarge '
'| '
'ml.m6i.32xlarge '
'| '
'ml.r6i.large '
'| '
'ml.r6i.xlarge '
'| '
'ml.r6i.2xlarge '
'| '
'ml.r6i.4xlarge '
'| '
'ml.r6i.8xlarge '
'| '
'ml.r6i.12xlarge '
'| '
'ml.r6i.16xlarge '
'| '
'ml.r6i.24xlarge '
'| '
'ml.r6i.32xlarge '
'| '
'ml.i3en.large '
'| '
'ml.i3en.xlarge '
'| '
'ml.i3en.2xlarge '
'| '
'ml.i3en.3xlarge '
'| '
'ml.i3en.6xlarge '
'| '
'ml.i3en.12xlarge '
'| '
'ml.i3en.24xlarge '
'| '
'ml.m7i.large '
'| '
'ml.m7i.xlarge '
'| '
'ml.m7i.2xlarge '
'| '
'ml.m7i.4xlarge '
'| '
'ml.m7i.8xlarge '
'| '
'ml.m7i.12xlarge '
'| '
'ml.m7i.16xlarge '
'| '
'ml.m7i.24xlarge '
'| '
'ml.m7i.48xlarge '
'| '
'ml.r7i.large '
'| '
'ml.r7i.xlarge '
'| '
'ml.r7i.2xlarge '
'| '
'ml.r7i.4xlarge '
'| '
'ml.r7i.8xlarge '
'| '
'ml.r7i.12xlarge '
'| '
'ml.r7i.16xlarge '
'| '
'ml.r7i.24xlarge '
'| '
'ml.r7i.48xlarge '
'| '
'ml.r5d.16xlarge '
'| '
'ml.g7e.2xlarge '
'| '
'ml.g7e.4xlarge '
'| '
'ml.g7e.8xlarge '
'| '
'ml.g7e.12xlarge '
'| '
'ml.g7e.24xlarge '
'| '
'ml.g7e.48xlarge '
'| '
'ml.p6-b300.48xlarge'],
'DesiredInstanceTypes': ['ml.p4d.24xlarge '
'| '
'ml.p4de.24xlarge '
'| '
'ml.p5.48xlarge '
'| '
'ml.p5.4xlarge '
'| '
'ml.p6e-gb200.36xlarge '
'| '
'ml.trn1.32xlarge '
'| '
'ml.trn1n.32xlarge '
'| '
'ml.g5.xlarge '
'| '
'ml.g5.2xlarge '
'| '
'ml.g5.4xlarge '
'| '
'ml.g5.8xlarge '
'| '
'ml.g5.12xlarge '
'| '
'ml.g5.16xlarge '
'| '
'ml.g5.24xlarge '
'| '
'ml.g5.48xlarge '
'| '
'ml.c5.large '
'| '
'ml.c5.xlarge '
'| '
'ml.c5.2xlarge '
'| '
'ml.c5.4xlarge '
'| '
'ml.c5.9xlarge '
'| '
'ml.c5.12xlarge '
'| '
'ml.c5.18xlarge '
'| '
'ml.c5.24xlarge '
'| '
'ml.c5n.large '
'| '
'ml.c5n.2xlarge '
'| '
'ml.c5n.4xlarge '
'| '
'ml.c5n.9xlarge '
'| '
'ml.c5n.18xlarge '
'| '
'ml.m5.large '
'| '
'ml.m5.xlarge '
'| '
'ml.m5.2xlarge '
'| '
'ml.m5.4xlarge '
'| '
'ml.m5.8xlarge '
'| '
'ml.m5.12xlarge '
'| '
'ml.m5.16xlarge '
'| '
'ml.m5.24xlarge '
'| '
'ml.t3.medium '
'| '
'ml.t3.large '
'| '
'ml.t3.xlarge '
'| '
'ml.t3.2xlarge '
'| '
'ml.g6.xlarge '
'| '
'ml.g6.2xlarge '
'| '
'ml.g6.4xlarge '
'| '
'ml.g6.8xlarge '
'| '
'ml.g6.16xlarge '
'| '
'ml.g6.12xlarge '
'| '
'ml.g6.24xlarge '
'| '
'ml.g6.48xlarge '
'| '
'ml.gr6.4xlarge '
'| '
'ml.gr6.8xlarge '
'| '
'ml.g6e.xlarge '
'| '
'ml.g6e.2xlarge '
'| '
'ml.g6e.4xlarge '
'| '
'ml.g6e.8xlarge '
'| '
'ml.g6e.16xlarge '
'| '
'ml.g6e.12xlarge '
'| '
'ml.g6e.24xlarge '
'| '
'ml.g6e.48xlarge '
'| '
'ml.p5e.48xlarge '
'| '
'ml.p5en.48xlarge '
'| '
'ml.p6-b200.48xlarge '
'| '
'ml.trn2.3xlarge '
'| '
'ml.trn2.48xlarge '
'| '
'ml.c6i.large '
'| '
'ml.c6i.xlarge '
'| '
'ml.c6i.2xlarge '
'| '
'ml.c6i.4xlarge '
'| '
'ml.c6i.8xlarge '
'| '
'ml.c6i.12xlarge '
'| '
'ml.c6i.16xlarge '
'| '
'ml.c6i.24xlarge '
'| '
'ml.c6i.32xlarge '
'| '
'ml.m6i.large '
'| '
'ml.m6i.xlarge '
'| '
'ml.m6i.2xlarge '
'| '
'ml.m6i.4xlarge '
'| '
'ml.m6i.8xlarge '
'| '
'ml.m6i.12xlarge '
'| '
'ml.m6i.16xlarge '
'| '
'ml.m6i.24xlarge '
'| '
'ml.m6i.32xlarge '
'| '
'ml.r6i.large '
'| '
'ml.r6i.xlarge '
'| '
'ml.r6i.2xlarge '
'| '
'ml.r6i.4xlarge '
'| '
'ml.r6i.8xlarge '
'| '
'ml.r6i.12xlarge '
'| '
'ml.r6i.16xlarge '
'| '
'ml.r6i.24xlarge '
'| '
'ml.r6i.32xlarge '
'| '
'ml.i3en.large '
'| '
'ml.i3en.xlarge '
'| '
'ml.i3en.2xlarge '
'| '
'ml.i3en.3xlarge '
'| '
'ml.i3en.6xlarge '
'| '
'ml.i3en.12xlarge '
'| '
'ml.i3en.24xlarge '
'| '
'ml.m7i.large '
'| '
'ml.m7i.xlarge '
'| '
'ml.m7i.2xlarge '
'| '
'ml.m7i.4xlarge '
'| '
'ml.m7i.8xlarge '
'| '
'ml.m7i.12xlarge '
'| '
'ml.m7i.16xlarge '
'| '
'ml.m7i.24xlarge '
'| '
'ml.m7i.48xlarge '
'| '
'ml.r7i.large '
'| '
'ml.r7i.xlarge '
'| '
'ml.r7i.2xlarge '
'| '
'ml.r7i.4xlarge '
'| '
'ml.r7i.8xlarge '
'| '
'ml.r7i.12xlarge '
'| '
'ml.r7i.16xlarge '
'| '
'ml.r7i.24xlarge '
'| '
'ml.r7i.48xlarge '
'| '
'ml.r5d.16xlarge '
'| '
'ml.g7e.2xlarge '
'| '
'ml.g7e.4xlarge '
'| '
'ml.g7e.8xlarge '
'| '
'ml.g7e.12xlarge '
'| '
'ml.g7e.24xlarge '
'| '
'ml.g7e.48xlarge '
'| '
'ml.p6-b300.48xlarge']},
'InstanceTypeDetails': [{'CurrentCount': 'integer',
'InstanceType': 'ml.p4d.24xlarge '
'| '
'ml.p4de.24xlarge '
'| ml.p5.48xlarge '
'| ml.p5.4xlarge '
'| '
'ml.p6e-gb200.36xlarge '
'| '
'ml.trn1.32xlarge '
'| '
'ml.trn1n.32xlarge '
'| ml.g5.xlarge | '
'ml.g5.2xlarge | '
'ml.g5.4xlarge | '
'ml.g5.8xlarge | '
'ml.g5.12xlarge | '
'ml.g5.16xlarge | '
'ml.g5.24xlarge | '
'ml.g5.48xlarge | '
'ml.c5.large | '
'ml.c5.xlarge | '
'ml.c5.2xlarge | '
'ml.c5.4xlarge | '
'ml.c5.9xlarge | '
'ml.c5.12xlarge | '
'ml.c5.18xlarge | '
'ml.c5.24xlarge | '
'ml.c5n.large | '
'ml.c5n.2xlarge | '
'ml.c5n.4xlarge | '
'ml.c5n.9xlarge | '
'ml.c5n.18xlarge '
'| ml.m5.large | '
'ml.m5.xlarge | '
'ml.m5.2xlarge | '
'ml.m5.4xlarge | '
'ml.m5.8xlarge | '
'ml.m5.12xlarge | '
'ml.m5.16xlarge | '
'ml.m5.24xlarge | '
'ml.t3.medium | '
'ml.t3.large | '
'ml.t3.xlarge | '
'ml.t3.2xlarge | '
'ml.g6.xlarge | '
'ml.g6.2xlarge | '
'ml.g6.4xlarge | '
'ml.g6.8xlarge | '
'ml.g6.16xlarge | '
'ml.g6.12xlarge | '
'ml.g6.24xlarge | '
'ml.g6.48xlarge | '
'ml.gr6.4xlarge | '
'ml.gr6.8xlarge | '
'ml.g6e.xlarge | '
'ml.g6e.2xlarge | '
'ml.g6e.4xlarge | '
'ml.g6e.8xlarge | '
'ml.g6e.16xlarge '
'| '
'ml.g6e.12xlarge '
'| '
'ml.g6e.24xlarge '
'| '
'ml.g6e.48xlarge '
'| '
'ml.p5e.48xlarge '
'| '
'ml.p5en.48xlarge '
'| '
'ml.p6-b200.48xlarge '
'| '
'ml.trn2.3xlarge '
'| '
'ml.trn2.48xlarge '
'| ml.c6i.large | '
'ml.c6i.xlarge | '
'ml.c6i.2xlarge | '
'ml.c6i.4xlarge | '
'ml.c6i.8xlarge | '
'ml.c6i.12xlarge '
'| '
'ml.c6i.16xlarge '
'| '
'ml.c6i.24xlarge '
'| '
'ml.c6i.32xlarge '
'| ml.m6i.large | '
'ml.m6i.xlarge | '
'ml.m6i.2xlarge | '
'ml.m6i.4xlarge | '
'ml.m6i.8xlarge | '
'ml.m6i.12xlarge '
'| '
'ml.m6i.16xlarge '
'| '
'ml.m6i.24xlarge '
'| '
'ml.m6i.32xlarge '
'| ml.r6i.large | '
'ml.r6i.xlarge | '
'ml.r6i.2xlarge | '
'ml.r6i.4xlarge | '
'ml.r6i.8xlarge | '
'ml.r6i.12xlarge '
'| '
'ml.r6i.16xlarge '
'| '
'ml.r6i.24xlarge '
'| '
'ml.r6i.32xlarge '
'| ml.i3en.large '
'| ml.i3en.xlarge '
'| '
'ml.i3en.2xlarge '
'| '
'ml.i3en.3xlarge '
'| '
'ml.i3en.6xlarge '
'| '
'ml.i3en.12xlarge '
'| '
'ml.i3en.24xlarge '
'| ml.m7i.large | '
'ml.m7i.xlarge | '
'ml.m7i.2xlarge | '
'ml.m7i.4xlarge | '
'ml.m7i.8xlarge | '
'ml.m7i.12xlarge '
'| '
'ml.m7i.16xlarge '
'| '
'ml.m7i.24xlarge '
'| '
'ml.m7i.48xlarge '
'| ml.r7i.large | '
'ml.r7i.xlarge | '
'ml.r7i.2xlarge | '
'ml.r7i.4xlarge | '
'ml.r7i.8xlarge | '
'ml.r7i.12xlarge '
'| '
'ml.r7i.16xlarge '
'| '
'ml.r7i.24xlarge '
'| '
'ml.r7i.48xlarge '
'| '
'ml.r5d.16xlarge '
'| ml.g7e.2xlarge '
'| ml.g7e.4xlarge '
'| ml.g7e.8xlarge '
'| '
'ml.g7e.12xlarge '
'| '
'ml.g7e.24xlarge '
'| '
'ml.g7e.48xlarge '
'| '
'ml.p6-b300.48xlarge',
'ThreadsPerCore': 'integer'}]}}
Retrieves information of a SageMaker HyperPod cluster.
See also: AWS API Documentation
Request Syntax
client.describe_cluster(
ClusterName='string'
)
string
[REQUIRED]
The string name or the Amazon Resource Name (ARN) of the SageMaker HyperPod cluster.
dict
Response Syntax
{
'ClusterArn': 'string',
'ClusterName': 'string',
'ClusterStatus': 'Creating'|'Deleting'|'Failed'|'InService'|'RollingBack'|'SystemUpdating'|'Updating',
'CreationTime': datetime(2015, 1, 1),
'FailureMessage': 'string',
'InstanceGroups': [
{
'CurrentCount': 123,
'TargetCount': 123,
'MinCount': 123,
'InstanceGroupName': 'string',
'InstanceType': 'ml.p4d.24xlarge'|'ml.p4de.24xlarge'|'ml.p5.48xlarge'|'ml.p5.4xlarge'|'ml.p6e-gb200.36xlarge'|'ml.trn1.32xlarge'|'ml.trn1n.32xlarge'|'ml.g5.xlarge'|'ml.g5.2xlarge'|'ml.g5.4xlarge'|'ml.g5.8xlarge'|'ml.g5.12xlarge'|'ml.g5.16xlarge'|'ml.g5.24xlarge'|'ml.g5.48xlarge'|'ml.c5.large'|'ml.c5.xlarge'|'ml.c5.2xlarge'|'ml.c5.4xlarge'|'ml.c5.9xlarge'|'ml.c5.12xlarge'|'ml.c5.18xlarge'|'ml.c5.24xlarge'|'ml.c5n.large'|'ml.c5n.2xlarge'|'ml.c5n.4xlarge'|'ml.c5n.9xlarge'|'ml.c5n.18xlarge'|'ml.m5.large'|'ml.m5.xlarge'|'ml.m5.2xlarge'|'ml.m5.4xlarge'|'ml.m5.8xlarge'|'ml.m5.12xlarge'|'ml.m5.16xlarge'|'ml.m5.24xlarge'|'ml.t3.medium'|'ml.t3.large'|'ml.t3.xlarge'|'ml.t3.2xlarge'|'ml.g6.xlarge'|'ml.g6.2xlarge'|'ml.g6.4xlarge'|'ml.g6.8xlarge'|'ml.g6.16xlarge'|'ml.g6.12xlarge'|'ml.g6.24xlarge'|'ml.g6.48xlarge'|'ml.gr6.4xlarge'|'ml.gr6.8xlarge'|'ml.g6e.xlarge'|'ml.g6e.2xlarge'|'ml.g6e.4xlarge'|'ml.g6e.8xlarge'|'ml.g6e.16xlarge'|'ml.g6e.12xlarge'|'ml.g6e.24xlarge'|'ml.g6e.48xlarge'|'ml.p5e.48xlarge'|'ml.p5en.48xlarge'|'ml.p6-b200.48xlarge'|'ml.trn2.3xlarge'|'ml.trn2.48xlarge'|'ml.c6i.large'|'ml.c6i.xlarge'|'ml.c6i.2xlarge'|'ml.c6i.4xlarge'|'ml.c6i.8xlarge'|'ml.c6i.12xlarge'|'ml.c6i.16xlarge'|'ml.c6i.24xlarge'|'ml.c6i.32xlarge'|'ml.m6i.large'|'ml.m6i.xlarge'|'ml.m6i.2xlarge'|'ml.m6i.4xlarge'|'ml.m6i.8xlarge'|'ml.m6i.12xlarge'|'ml.m6i.16xlarge'|'ml.m6i.24xlarge'|'ml.m6i.32xlarge'|'ml.r6i.large'|'ml.r6i.xlarge'|'ml.r6i.2xlarge'|'ml.r6i.4xlarge'|'ml.r6i.8xlarge'|'ml.r6i.12xlarge'|'ml.r6i.16xlarge'|'ml.r6i.24xlarge'|'ml.r6i.32xlarge'|'ml.i3en.large'|'ml.i3en.xlarge'|'ml.i3en.2xlarge'|'ml.i3en.3xlarge'|'ml.i3en.6xlarge'|'ml.i3en.12xlarge'|'ml.i3en.24xlarge'|'ml.m7i.large'|'ml.m7i.xlarge'|'ml.m7i.2xlarge'|'ml.m7i.4xlarge'|'ml.m7i.8xlarge'|'ml.m7i.12xlarge'|'ml.m7i.16xlarge'|'ml.m7i.24xlarge'|'ml.m7i.48xlarge'|'ml.r7i.large'|'ml.r7i.xlarge'|'ml.r7i.2xlarge'|'ml.r7i.4xlarge'|'ml.r7i.8xlarge'|'ml.r7i.12xlarge'|'ml.r7i.16xlarge'|'ml.r7i.24xlarge'|'ml.r7i.48xlarge'|'ml.r5d.16xlarge'|'ml.g7e.2xlarge'|'ml.g7e.4xlarge'|'ml.g7e.8xlarge'|'ml.g7e.12xlarge'|'ml.g7e.24xlarge'|'ml.g7e.48xlarge'|'ml.p6-b300.48xlarge',
'InstanceRequirements': {
'CurrentInstanceTypes': [
'ml.p4d.24xlarge'|'ml.p4de.24xlarge'|'ml.p5.48xlarge'|'ml.p5.4xlarge'|'ml.p6e-gb200.36xlarge'|'ml.trn1.32xlarge'|'ml.trn1n.32xlarge'|'ml.g5.xlarge'|'ml.g5.2xlarge'|'ml.g5.4xlarge'|'ml.g5.8xlarge'|'ml.g5.12xlarge'|'ml.g5.16xlarge'|'ml.g5.24xlarge'|'ml.g5.48xlarge'|'ml.c5.large'|'ml.c5.xlarge'|'ml.c5.2xlarge'|'ml.c5.4xlarge'|'ml.c5.9xlarge'|'ml.c5.12xlarge'|'ml.c5.18xlarge'|'ml.c5.24xlarge'|'ml.c5n.large'|'ml.c5n.2xlarge'|'ml.c5n.4xlarge'|'ml.c5n.9xlarge'|'ml.c5n.18xlarge'|'ml.m5.large'|'ml.m5.xlarge'|'ml.m5.2xlarge'|'ml.m5.4xlarge'|'ml.m5.8xlarge'|'ml.m5.12xlarge'|'ml.m5.16xlarge'|'ml.m5.24xlarge'|'ml.t3.medium'|'ml.t3.large'|'ml.t3.xlarge'|'ml.t3.2xlarge'|'ml.g6.xlarge'|'ml.g6.2xlarge'|'ml.g6.4xlarge'|'ml.g6.8xlarge'|'ml.g6.16xlarge'|'ml.g6.12xlarge'|'ml.g6.24xlarge'|'ml.g6.48xlarge'|'ml.gr6.4xlarge'|'ml.gr6.8xlarge'|'ml.g6e.xlarge'|'ml.g6e.2xlarge'|'ml.g6e.4xlarge'|'ml.g6e.8xlarge'|'ml.g6e.16xlarge'|'ml.g6e.12xlarge'|'ml.g6e.24xlarge'|'ml.g6e.48xlarge'|'ml.p5e.48xlarge'|'ml.p5en.48xlarge'|'ml.p6-b200.48xlarge'|'ml.trn2.3xlarge'|'ml.trn2.48xlarge'|'ml.c6i.large'|'ml.c6i.xlarge'|'ml.c6i.2xlarge'|'ml.c6i.4xlarge'|'ml.c6i.8xlarge'|'ml.c6i.12xlarge'|'ml.c6i.16xlarge'|'ml.c6i.24xlarge'|'ml.c6i.32xlarge'|'ml.m6i.large'|'ml.m6i.xlarge'|'ml.m6i.2xlarge'|'ml.m6i.4xlarge'|'ml.m6i.8xlarge'|'ml.m6i.12xlarge'|'ml.m6i.16xlarge'|'ml.m6i.24xlarge'|'ml.m6i.32xlarge'|'ml.r6i.large'|'ml.r6i.xlarge'|'ml.r6i.2xlarge'|'ml.r6i.4xlarge'|'ml.r6i.8xlarge'|'ml.r6i.12xlarge'|'ml.r6i.16xlarge'|'ml.r6i.24xlarge'|'ml.r6i.32xlarge'|'ml.i3en.large'|'ml.i3en.xlarge'|'ml.i3en.2xlarge'|'ml.i3en.3xlarge'|'ml.i3en.6xlarge'|'ml.i3en.12xlarge'|'ml.i3en.24xlarge'|'ml.m7i.large'|'ml.m7i.xlarge'|'ml.m7i.2xlarge'|'ml.m7i.4xlarge'|'ml.m7i.8xlarge'|'ml.m7i.12xlarge'|'ml.m7i.16xlarge'|'ml.m7i.24xlarge'|'ml.m7i.48xlarge'|'ml.r7i.large'|'ml.r7i.xlarge'|'ml.r7i.2xlarge'|'ml.r7i.4xlarge'|'ml.r7i.8xlarge'|'ml.r7i.12xlarge'|'ml.r7i.16xlarge'|'ml.r7i.24xlarge'|'ml.r7i.48xlarge'|'ml.r5d.16xlarge'|'ml.g7e.2xlarge'|'ml.g7e.4xlarge'|'ml.g7e.8xlarge'|'ml.g7e.12xlarge'|'ml.g7e.24xlarge'|'ml.g7e.48xlarge'|'ml.p6-b300.48xlarge',
],
'DesiredInstanceTypes': [
'ml.p4d.24xlarge'|'ml.p4de.24xlarge'|'ml.p5.48xlarge'|'ml.p5.4xlarge'|'ml.p6e-gb200.36xlarge'|'ml.trn1.32xlarge'|'ml.trn1n.32xlarge'|'ml.g5.xlarge'|'ml.g5.2xlarge'|'ml.g5.4xlarge'|'ml.g5.8xlarge'|'ml.g5.12xlarge'|'ml.g5.16xlarge'|'ml.g5.24xlarge'|'ml.g5.48xlarge'|'ml.c5.large'|'ml.c5.xlarge'|'ml.c5.2xlarge'|'ml.c5.4xlarge'|'ml.c5.9xlarge'|'ml.c5.12xlarge'|'ml.c5.18xlarge'|'ml.c5.24xlarge'|'ml.c5n.large'|'ml.c5n.2xlarge'|'ml.c5n.4xlarge'|'ml.c5n.9xlarge'|'ml.c5n.18xlarge'|'ml.m5.large'|'ml.m5.xlarge'|'ml.m5.2xlarge'|'ml.m5.4xlarge'|'ml.m5.8xlarge'|'ml.m5.12xlarge'|'ml.m5.16xlarge'|'ml.m5.24xlarge'|'ml.t3.medium'|'ml.t3.large'|'ml.t3.xlarge'|'ml.t3.2xlarge'|'ml.g6.xlarge'|'ml.g6.2xlarge'|'ml.g6.4xlarge'|'ml.g6.8xlarge'|'ml.g6.16xlarge'|'ml.g6.12xlarge'|'ml.g6.24xlarge'|'ml.g6.48xlarge'|'ml.gr6.4xlarge'|'ml.gr6.8xlarge'|'ml.g6e.xlarge'|'ml.g6e.2xlarge'|'ml.g6e.4xlarge'|'ml.g6e.8xlarge'|'ml.g6e.16xlarge'|'ml.g6e.12xlarge'|'ml.g6e.24xlarge'|'ml.g6e.48xlarge'|'ml.p5e.48xlarge'|'ml.p5en.48xlarge'|'ml.p6-b200.48xlarge'|'ml.trn2.3xlarge'|'ml.trn2.48xlarge'|'ml.c6i.large'|'ml.c6i.xlarge'|'ml.c6i.2xlarge'|'ml.c6i.4xlarge'|'ml.c6i.8xlarge'|'ml.c6i.12xlarge'|'ml.c6i.16xlarge'|'ml.c6i.24xlarge'|'ml.c6i.32xlarge'|'ml.m6i.large'|'ml.m6i.xlarge'|'ml.m6i.2xlarge'|'ml.m6i.4xlarge'|'ml.m6i.8xlarge'|'ml.m6i.12xlarge'|'ml.m6i.16xlarge'|'ml.m6i.24xlarge'|'ml.m6i.32xlarge'|'ml.r6i.large'|'ml.r6i.xlarge'|'ml.r6i.2xlarge'|'ml.r6i.4xlarge'|'ml.r6i.8xlarge'|'ml.r6i.12xlarge'|'ml.r6i.16xlarge'|'ml.r6i.24xlarge'|'ml.r6i.32xlarge'|'ml.i3en.large'|'ml.i3en.xlarge'|'ml.i3en.2xlarge'|'ml.i3en.3xlarge'|'ml.i3en.6xlarge'|'ml.i3en.12xlarge'|'ml.i3en.24xlarge'|'ml.m7i.large'|'ml.m7i.xlarge'|'ml.m7i.2xlarge'|'ml.m7i.4xlarge'|'ml.m7i.8xlarge'|'ml.m7i.12xlarge'|'ml.m7i.16xlarge'|'ml.m7i.24xlarge'|'ml.m7i.48xlarge'|'ml.r7i.large'|'ml.r7i.xlarge'|'ml.r7i.2xlarge'|'ml.r7i.4xlarge'|'ml.r7i.8xlarge'|'ml.r7i.12xlarge'|'ml.r7i.16xlarge'|'ml.r7i.24xlarge'|'ml.r7i.48xlarge'|'ml.r5d.16xlarge'|'ml.g7e.2xlarge'|'ml.g7e.4xlarge'|'ml.g7e.8xlarge'|'ml.g7e.12xlarge'|'ml.g7e.24xlarge'|'ml.g7e.48xlarge'|'ml.p6-b300.48xlarge',
]
},
'InstanceTypeDetails': [
{
'InstanceType': 'ml.p4d.24xlarge'|'ml.p4de.24xlarge'|'ml.p5.48xlarge'|'ml.p5.4xlarge'|'ml.p6e-gb200.36xlarge'|'ml.trn1.32xlarge'|'ml.trn1n.32xlarge'|'ml.g5.xlarge'|'ml.g5.2xlarge'|'ml.g5.4xlarge'|'ml.g5.8xlarge'|'ml.g5.12xlarge'|'ml.g5.16xlarge'|'ml.g5.24xlarge'|'ml.g5.48xlarge'|'ml.c5.large'|'ml.c5.xlarge'|'ml.c5.2xlarge'|'ml.c5.4xlarge'|'ml.c5.9xlarge'|'ml.c5.12xlarge'|'ml.c5.18xlarge'|'ml.c5.24xlarge'|'ml.c5n.large'|'ml.c5n.2xlarge'|'ml.c5n.4xlarge'|'ml.c5n.9xlarge'|'ml.c5n.18xlarge'|'ml.m5.large'|'ml.m5.xlarge'|'ml.m5.2xlarge'|'ml.m5.4xlarge'|'ml.m5.8xlarge'|'ml.m5.12xlarge'|'ml.m5.16xlarge'|'ml.m5.24xlarge'|'ml.t3.medium'|'ml.t3.large'|'ml.t3.xlarge'|'ml.t3.2xlarge'|'ml.g6.xlarge'|'ml.g6.2xlarge'|'ml.g6.4xlarge'|'ml.g6.8xlarge'|'ml.g6.16xlarge'|'ml.g6.12xlarge'|'ml.g6.24xlarge'|'ml.g6.48xlarge'|'ml.gr6.4xlarge'|'ml.gr6.8xlarge'|'ml.g6e.xlarge'|'ml.g6e.2xlarge'|'ml.g6e.4xlarge'|'ml.g6e.8xlarge'|'ml.g6e.16xlarge'|'ml.g6e.12xlarge'|'ml.g6e.24xlarge'|'ml.g6e.48xlarge'|'ml.p5e.48xlarge'|'ml.p5en.48xlarge'|'ml.p6-b200.48xlarge'|'ml.trn2.3xlarge'|'ml.trn2.48xlarge'|'ml.c6i.large'|'ml.c6i.xlarge'|'ml.c6i.2xlarge'|'ml.c6i.4xlarge'|'ml.c6i.8xlarge'|'ml.c6i.12xlarge'|'ml.c6i.16xlarge'|'ml.c6i.24xlarge'|'ml.c6i.32xlarge'|'ml.m6i.large'|'ml.m6i.xlarge'|'ml.m6i.2xlarge'|'ml.m6i.4xlarge'|'ml.m6i.8xlarge'|'ml.m6i.12xlarge'|'ml.m6i.16xlarge'|'ml.m6i.24xlarge'|'ml.m6i.32xlarge'|'ml.r6i.large'|'ml.r6i.xlarge'|'ml.r6i.2xlarge'|'ml.r6i.4xlarge'|'ml.r6i.8xlarge'|'ml.r6i.12xlarge'|'ml.r6i.16xlarge'|'ml.r6i.24xlarge'|'ml.r6i.32xlarge'|'ml.i3en.large'|'ml.i3en.xlarge'|'ml.i3en.2xlarge'|'ml.i3en.3xlarge'|'ml.i3en.6xlarge'|'ml.i3en.12xlarge'|'ml.i3en.24xlarge'|'ml.m7i.large'|'ml.m7i.xlarge'|'ml.m7i.2xlarge'|'ml.m7i.4xlarge'|'ml.m7i.8xlarge'|'ml.m7i.12xlarge'|'ml.m7i.16xlarge'|'ml.m7i.24xlarge'|'ml.m7i.48xlarge'|'ml.r7i.large'|'ml.r7i.xlarge'|'ml.r7i.2xlarge'|'ml.r7i.4xlarge'|'ml.r7i.8xlarge'|'ml.r7i.12xlarge'|'ml.r7i.16xlarge'|'ml.r7i.24xlarge'|'ml.r7i.48xlarge'|'ml.r5d.16xlarge'|'ml.g7e.2xlarge'|'ml.g7e.4xlarge'|'ml.g7e.8xlarge'|'ml.g7e.12xlarge'|'ml.g7e.24xlarge'|'ml.g7e.48xlarge'|'ml.p6-b300.48xlarge',
'CurrentCount': 123,
'ThreadsPerCore': 123
},
],
'LifeCycleConfig': {
'SourceS3Uri': 'string',
'OnCreate': 'string'
},
'ExecutionRole': 'string',
'ThreadsPerCore': 123,
'InstanceStorageConfigs': [
{
'EbsVolumeConfig': {
'VolumeSizeInGB': 123,
'VolumeKmsKeyId': 'string',
'RootVolume': True|False
},
'FsxLustreConfig': {
'DnsName': 'string',
'MountName': 'string',
'MountPath': 'string'
},
'FsxOpenZfsConfig': {
'DnsName': 'string',
'MountPath': 'string'
}
},
],
'OnStartDeepHealthChecks': [
'InstanceStress'|'InstanceConnectivity',
],
'Status': 'InService'|'Creating'|'Updating'|'Failed'|'Degraded'|'SystemUpdating'|'Deleting',
'TrainingPlanArn': 'string',
'TrainingPlanStatus': 'string',
'OverrideVpcConfig': {
'SecurityGroupIds': [
'string',
],
'Subnets': [
'string',
]
},
'ScheduledUpdateConfig': {
'ScheduleExpression': 'string',
'DeploymentConfig': {
'RollingUpdatePolicy': {
'MaximumBatchSize': {
'Type': 'INSTANCE_COUNT'|'CAPACITY_PERCENTAGE',
'Value': 123
},
'RollbackMaximumBatchSize': {
'Type': 'INSTANCE_COUNT'|'CAPACITY_PERCENTAGE',
'Value': 123
}
},
'WaitIntervalInSeconds': 123,
'AutoRollbackConfiguration': [
{
'AlarmName': 'string'
},
]
}
},
'CurrentImageId': 'string',
'DesiredImageId': 'string',
'ActiveOperations': {
'string': 123
},
'KubernetesConfig': {
'CurrentLabels': {
'string': 'string'
},
'DesiredLabels': {
'string': 'string'
},
'CurrentTaints': [
{
'Key': 'string',
'Value': 'string',
'Effect': 'NoSchedule'|'PreferNoSchedule'|'NoExecute'
},
],
'DesiredTaints': [
{
'Key': 'string',
'Value': 'string',
'Effect': 'NoSchedule'|'PreferNoSchedule'|'NoExecute'
},
]
},
'CapacityRequirements': {
'Spot': {},
'OnDemand': {}
},
'TargetStateCount': 123,
'SoftwareUpdateStatus': 'Pending'|'InProgress'|'Succeeded'|'Failed'|'RollbackInProgress'|'RollbackComplete',
'ActiveSoftwareUpdateConfig': {
'RollingUpdatePolicy': {
'MaximumBatchSize': {
'Type': 'INSTANCE_COUNT'|'CAPACITY_PERCENTAGE',
'Value': 123
},
'RollbackMaximumBatchSize': {
'Type': 'INSTANCE_COUNT'|'CAPACITY_PERCENTAGE',
'Value': 123
}
},
'WaitIntervalInSeconds': 123,
'AutoRollbackConfiguration': [
{
'AlarmName': 'string'
},
]
},
'SlurmConfig': {
'NodeType': 'Controller'|'Login'|'Compute',
'PartitionNames': [
'string',
]
}
},
],
'RestrictedInstanceGroups': [
{
'CurrentCount': 123,
'TargetCount': 123,
'InstanceGroupName': 'string',
'InstanceType': 'ml.p4d.24xlarge'|'ml.p4de.24xlarge'|'ml.p5.48xlarge'|'ml.p5.4xlarge'|'ml.p6e-gb200.36xlarge'|'ml.trn1.32xlarge'|'ml.trn1n.32xlarge'|'ml.g5.xlarge'|'ml.g5.2xlarge'|'ml.g5.4xlarge'|'ml.g5.8xlarge'|'ml.g5.12xlarge'|'ml.g5.16xlarge'|'ml.g5.24xlarge'|'ml.g5.48xlarge'|'ml.c5.large'|'ml.c5.xlarge'|'ml.c5.2xlarge'|'ml.c5.4xlarge'|'ml.c5.9xlarge'|'ml.c5.12xlarge'|'ml.c5.18xlarge'|'ml.c5.24xlarge'|'ml.c5n.large'|'ml.c5n.2xlarge'|'ml.c5n.4xlarge'|'ml.c5n.9xlarge'|'ml.c5n.18xlarge'|'ml.m5.large'|'ml.m5.xlarge'|'ml.m5.2xlarge'|'ml.m5.4xlarge'|'ml.m5.8xlarge'|'ml.m5.12xlarge'|'ml.m5.16xlarge'|'ml.m5.24xlarge'|'ml.t3.medium'|'ml.t3.large'|'ml.t3.xlarge'|'ml.t3.2xlarge'|'ml.g6.xlarge'|'ml.g6.2xlarge'|'ml.g6.4xlarge'|'ml.g6.8xlarge'|'ml.g6.16xlarge'|'ml.g6.12xlarge'|'ml.g6.24xlarge'|'ml.g6.48xlarge'|'ml.gr6.4xlarge'|'ml.gr6.8xlarge'|'ml.g6e.xlarge'|'ml.g6e.2xlarge'|'ml.g6e.4xlarge'|'ml.g6e.8xlarge'|'ml.g6e.16xlarge'|'ml.g6e.12xlarge'|'ml.g6e.24xlarge'|'ml.g6e.48xlarge'|'ml.p5e.48xlarge'|'ml.p5en.48xlarge'|'ml.p6-b200.48xlarge'|'ml.trn2.3xlarge'|'ml.trn2.48xlarge'|'ml.c6i.large'|'ml.c6i.xlarge'|'ml.c6i.2xlarge'|'ml.c6i.4xlarge'|'ml.c6i.8xlarge'|'ml.c6i.12xlarge'|'ml.c6i.16xlarge'|'ml.c6i.24xlarge'|'ml.c6i.32xlarge'|'ml.m6i.large'|'ml.m6i.xlarge'|'ml.m6i.2xlarge'|'ml.m6i.4xlarge'|'ml.m6i.8xlarge'|'ml.m6i.12xlarge'|'ml.m6i.16xlarge'|'ml.m6i.24xlarge'|'ml.m6i.32xlarge'|'ml.r6i.large'|'ml.r6i.xlarge'|'ml.r6i.2xlarge'|'ml.r6i.4xlarge'|'ml.r6i.8xlarge'|'ml.r6i.12xlarge'|'ml.r6i.16xlarge'|'ml.r6i.24xlarge'|'ml.r6i.32xlarge'|'ml.i3en.large'|'ml.i3en.xlarge'|'ml.i3en.2xlarge'|'ml.i3en.3xlarge'|'ml.i3en.6xlarge'|'ml.i3en.12xlarge'|'ml.i3en.24xlarge'|'ml.m7i.large'|'ml.m7i.xlarge'|'ml.m7i.2xlarge'|'ml.m7i.4xlarge'|'ml.m7i.8xlarge'|'ml.m7i.12xlarge'|'ml.m7i.16xlarge'|'ml.m7i.24xlarge'|'ml.m7i.48xlarge'|'ml.r7i.large'|'ml.r7i.xlarge'|'ml.r7i.2xlarge'|'ml.r7i.4xlarge'|'ml.r7i.8xlarge'|'ml.r7i.12xlarge'|'ml.r7i.16xlarge'|'ml.r7i.24xlarge'|'ml.r7i.48xlarge'|'ml.r5d.16xlarge'|'ml.g7e.2xlarge'|'ml.g7e.4xlarge'|'ml.g7e.8xlarge'|'ml.g7e.12xlarge'|'ml.g7e.24xlarge'|'ml.g7e.48xlarge'|'ml.p6-b300.48xlarge',
'ExecutionRole': 'string',
'ThreadsPerCore': 123,
'InstanceStorageConfigs': [
{
'EbsVolumeConfig': {
'VolumeSizeInGB': 123,
'VolumeKmsKeyId': 'string',
'RootVolume': True|False
},
'FsxLustreConfig': {
'DnsName': 'string',
'MountName': 'string',
'MountPath': 'string'
},
'FsxOpenZfsConfig': {
'DnsName': 'string',
'MountPath': 'string'
}
},
],
'OnStartDeepHealthChecks': [
'InstanceStress'|'InstanceConnectivity',
],
'Status': 'InService'|'Creating'|'Updating'|'Failed'|'Degraded'|'SystemUpdating'|'Deleting',
'TrainingPlanArn': 'string',
'TrainingPlanStatus': 'string',
'OverrideVpcConfig': {
'SecurityGroupIds': [
'string',
],
'Subnets': [
'string',
]
},
'ScheduledUpdateConfig': {
'ScheduleExpression': 'string',
'DeploymentConfig': {
'RollingUpdatePolicy': {
'MaximumBatchSize': {
'Type': 'INSTANCE_COUNT'|'CAPACITY_PERCENTAGE',
'Value': 123
},
'RollbackMaximumBatchSize': {
'Type': 'INSTANCE_COUNT'|'CAPACITY_PERCENTAGE',
'Value': 123
}
},
'WaitIntervalInSeconds': 123,
'AutoRollbackConfiguration': [
{
'AlarmName': 'string'
},
]
}
},
'EnvironmentConfig': {
'FSxLustreConfig': {
'SizeInGiB': 123,
'PerUnitStorageThroughput': 123
},
'S3OutputPath': 'string'
}
},
],
'VpcConfig': {
'SecurityGroupIds': [
'string',
],
'Subnets': [
'string',
]
},
'Orchestrator': {
'Eks': {
'ClusterArn': 'string'
},
'Slurm': {
'SlurmConfigStrategy': 'Overwrite'|'Managed'|'Merge'
}
},
'TieredStorageConfig': {
'Mode': 'Enable'|'Disable',
'InstanceMemoryAllocationPercentage': 123
},
'NodeRecovery': 'Automatic'|'None',
'NodeProvisioningMode': 'Continuous',
'ClusterRole': 'string',
'AutoScaling': {
'Mode': 'Enable'|'Disable',
'AutoScalerType': 'Karpenter',
'Status': 'InService'|'Failed'|'Creating'|'Deleting',
'FailureMessage': 'string'
}
}
Response Structure
(dict) --
ClusterArn (string) --
The Amazon Resource Name (ARN) of the SageMaker HyperPod cluster.
ClusterName (string) --
The name of the SageMaker HyperPod cluster.
ClusterStatus (string) --
The status of the SageMaker HyperPod cluster.
CreationTime (datetime) --
The time when the SageMaker Cluster is created.
FailureMessage (string) --
The failure message of the SageMaker HyperPod cluster.
InstanceGroups (list) --
The instance groups of the SageMaker HyperPod cluster.
(dict) --
Details of an instance group in a SageMaker HyperPod cluster.
CurrentCount (integer) --
The number of instances that are currently in the instance group of a SageMaker HyperPod cluster.
TargetCount (integer) --
The number of instances you specified to add to the instance group of a SageMaker HyperPod cluster.
MinCount (integer) --
The minimum number of instances that must be available in the instance group of a SageMaker HyperPod cluster before it transitions to InService status.
InstanceGroupName (string) --
The name of the instance group of a SageMaker HyperPod cluster.
InstanceType (string) --
The instance type of the instance group of a SageMaker HyperPod cluster.
InstanceRequirements (dict) --
The instance requirements for the instance group, including the current and desired instance types. This field is present for flexible instance groups that support multiple instance types.
CurrentInstanceTypes (list) --
The instance types currently in use by the instance group.
(string) --
DesiredInstanceTypes (list) --
The desired instance types for the instance group, as specified in the most recent update request.
(string) --
InstanceTypeDetails (list) --
Details about the instance types in the instance group, including the count and configuration of each instance type. This field is present for flexible instance groups that support multiple instance types.
(dict) --
Details about a specific instance type within a flexible instance group, including the count and configuration.
InstanceType (string) --
The instance type.
CurrentCount (integer) --
The number of instances of this type currently running in the instance group.
ThreadsPerCore (integer) --
The number of threads per CPU core for this instance type.
LifeCycleConfig (dict) --
Details of LifeCycle configuration for the instance group.
SourceS3Uri (string) --
An Amazon S3 bucket path where your lifecycle scripts are stored.
OnCreate (string) --
The file name of the entrypoint script of lifecycle scripts under SourceS3Uri. This entrypoint script runs during cluster creation.
ExecutionRole (string) --
The execution role for the instance group to assume.
ThreadsPerCore (integer) --
The number you specified to TreadsPerCore in CreateCluster for enabling or disabling multithreading. For instance types that support multithreading, you can specify 1 for disabling multithreading and 2 for enabling multithreading. For more information, see the reference table of CPU cores and threads per CPU core per instance type in the Amazon Elastic Compute Cloud User Guide.
InstanceStorageConfigs (list) --
The additional storage configurations for the instances in the SageMaker HyperPod cluster instance group.
(dict) --
Defines the configuration for attaching additional storage to the instances in the SageMaker HyperPod cluster instance group. To learn more, see SageMaker HyperPod release notes: June 20, 2024.
EbsVolumeConfig (dict) --
Defines the configuration for attaching additional Amazon Elastic Block Store (EBS) volumes to the instances in the SageMaker HyperPod cluster instance group. The additional EBS volume is attached to each instance within the SageMaker HyperPod cluster instance group and mounted to /opt/sagemaker.
VolumeSizeInGB (integer) --
The size in gigabytes (GB) of the additional EBS volume to be attached to the instances in the SageMaker HyperPod cluster instance group. The additional EBS volume is attached to each instance within the SageMaker HyperPod cluster instance group and mounted to /opt/sagemaker.
VolumeKmsKeyId (string) --
The ID of a KMS key to encrypt the Amazon EBS volume.
RootVolume (boolean) --
Specifies whether the configuration is for the cluster's root or secondary Amazon EBS volume. You can specify two ClusterEbsVolumeConfig fields to configure both the root and secondary volumes. Set the value to True if you'd like to provide your own customer managed Amazon Web Services KMS key to encrypt the root volume. When True:
The configuration is applied to the root volume.
You can't specify the VolumeSizeInGB field. The size of the root volume is determined for you.
You must specify a KMS key ID for VolumeKmsKeyId to encrypt the root volume with your own KMS key instead of an Amazon Web Services owned KMS key.
Otherwise, by default, the value is False, and the following applies:
The configuration is applied to the secondary volume, while the root volume is encrypted with an Amazon Web Services owned key.
You must specify the VolumeSizeInGB field.
You can optionally specify the VolumeKmsKeyId to encrypt the secondary volume with your own KMS key instead of an Amazon Web Services owned KMS key.
FsxLustreConfig (dict) --
Defines the configuration for attaching an Amazon FSx for Lustre file system to the instances in the SageMaker HyperPod cluster instance group.
DnsName (string) --
The DNS name of the Amazon FSx for Lustre file system.
MountName (string) --
The mount name of the Amazon FSx for Lustre file system.
MountPath (string) --
The local path where the Amazon FSx for Lustre file system is mounted on instances.
FsxOpenZfsConfig (dict) --
Defines the configuration for attaching an Amazon FSx for OpenZFS file system to the instances in the SageMaker HyperPod cluster instance group.
DnsName (string) --
The DNS name of the Amazon FSx for OpenZFS file system.
MountPath (string) --
The local path where the Amazon FSx for OpenZFS file system is mounted on instances.
OnStartDeepHealthChecks (list) --
A flag indicating whether deep health checks should be performed when the cluster instance group is created or updated.
(string) --
Status (string) --
The current status of the cluster instance group.
InService: The instance group is active and healthy.
Creating: The instance group is being provisioned.
Updating: The instance group is being updated.
Failed: The instance group has failed to provision or is no longer healthy.
Degraded: The instance group is degraded, meaning that some instances have failed to provision or are no longer healthy.
Deleting: The instance group is being deleted.
TrainingPlanArn (string) --
The Amazon Resource Name (ARN); of the training plan associated with this cluster instance group.
For more information about how to reserve GPU capacity for your SageMaker HyperPod clusters using Amazon SageMaker Training Plan, see ``CreateTrainingPlan ``.
TrainingPlanStatus (string) --
The current status of the training plan associated with this cluster instance group.
OverrideVpcConfig (dict) --
The customized Amazon VPC configuration at the instance group level that overrides the default Amazon VPC configuration of the SageMaker HyperPod cluster.
SecurityGroupIds (list) --
The VPC security group IDs, in the form sg-xxxxxxxx. Specify the security groups for the VPC that is specified in the Subnets field.
(string) --
Subnets (list) --
The ID of the subnets in the VPC to which you want to connect your training job or model. For information about the availability of specific instance types, see Supported Instance Types and Availability Zones.
(string) --
ScheduledUpdateConfig (dict) --
The configuration object of the schedule that SageMaker follows when updating the AMI.
ScheduleExpression (string) --
A cron expression that specifies the schedule that SageMaker follows when updating the AMI.
DeploymentConfig (dict) --
The configuration to use when updating the AMI versions.
RollingUpdatePolicy (dict) --
The policy that SageMaker uses when updating the AMI versions of the cluster.
MaximumBatchSize (dict) --
The maximum amount of instances in the cluster that SageMaker can update at a time.
Type (string) --
Specifies whether SageMaker should process the update by amount or percentage of instances.
Value (integer) --
Specifies the amount or percentage of instances SageMaker updates at a time.
RollbackMaximumBatchSize (dict) --
The maximum amount of instances in the cluster that SageMaker can roll back at a time.
Type (string) --
Specifies whether SageMaker should process the update by amount or percentage of instances.
Value (integer) --
Specifies the amount or percentage of instances SageMaker updates at a time.
WaitIntervalInSeconds (integer) --
The duration in seconds that SageMaker waits before updating more instances in the cluster.
AutoRollbackConfiguration (list) --
An array that contains the alarms that SageMaker monitors to know whether to roll back the AMI update.
(dict) --
The details of the alarm to monitor during the AMI update.
AlarmName (string) --
The name of the alarm.
CurrentImageId (string) --
The ID of the Amazon Machine Image (AMI) currently in use by the instance group.
DesiredImageId (string) --
The ID of the Amazon Machine Image (AMI) desired for the instance group.
ActiveOperations (dict) --
A map indicating active operations currently in progress for the instance group of a SageMaker HyperPod cluster. When there is a scaling operation in progress, this map contains a key Scaling with value 1.
(string) --
(integer) --
KubernetesConfig (dict) --
The Kubernetes configuration for the instance group that contains labels and taints to be applied for the nodes in this instance group.
CurrentLabels (dict) --
The current labels applied to cluster nodes of an instance group.
(string) --
(string) --
DesiredLabels (dict) --
The desired labels to be applied to cluster nodes of an instance group.
(string) --
(string) --
CurrentTaints (list) --
The current taints applied to cluster nodes of an instance group.
(dict) --
A Kubernetes taint that can be applied to cluster nodes.
Key (string) --
The key of the taint.
Value (string) --
The value of the taint.
Effect (string) --
The effect of the taint. Valid values are NoSchedule, PreferNoSchedule, and NoExecute.
DesiredTaints (list) --
The desired taints to be applied to cluster nodes of an instance group.
(dict) --
A Kubernetes taint that can be applied to cluster nodes.
Key (string) --
The key of the taint.
Value (string) --
The value of the taint.
Effect (string) --
The effect of the taint. Valid values are NoSchedule, PreferNoSchedule, and NoExecute.
CapacityRequirements (dict) --
The instance capacity requirements for the instance group.
Spot (dict) --
Configuration options specific to Spot instances.
OnDemand (dict) --
Configuration options specific to On-Demand instances.
TargetStateCount (integer) --
Represents the number of running nodes using the desired Image ID.
During software update operations: This count shows the number of nodes running on the desired Image ID. If a rollback occurs, the current image ID and desired image ID (both included in the describe cluster response) swap values. The TargetStateCount then shows the number of nodes running on the newly designated desired image ID (which was previously the current image ID).
During simultaneous scaling and software update operations: This count shows the number of instances running on the desired image ID, including any new instances created as part of the scaling request. New nodes are always created using the desired image ID, so TargetStateCount reflects the total count of nodes running on the desired image ID, even during rollback scenarios.
SoftwareUpdateStatus (string) --
Status of the last software udpate request.
Status transitions follow these possible sequences:
Pending -> InProgress -> Succeeded
Pending -> InProgress -> RollbackInProgress -> RollbackComplete
Pending -> InProgress -> RollbackInProgress -> Failed
ActiveSoftwareUpdateConfig (dict) --
The configuration to use when updating the AMI versions.
RollingUpdatePolicy (dict) --
The policy that SageMaker uses when updating the AMI versions of the cluster.
MaximumBatchSize (dict) --
The maximum amount of instances in the cluster that SageMaker can update at a time.
Type (string) --
Specifies whether SageMaker should process the update by amount or percentage of instances.
Value (integer) --
Specifies the amount or percentage of instances SageMaker updates at a time.
RollbackMaximumBatchSize (dict) --
The maximum amount of instances in the cluster that SageMaker can roll back at a time.
Type (string) --
Specifies whether SageMaker should process the update by amount or percentage of instances.
Value (integer) --
Specifies the amount or percentage of instances SageMaker updates at a time.
WaitIntervalInSeconds (integer) --
The duration in seconds that SageMaker waits before updating more instances in the cluster.
AutoRollbackConfiguration (list) --
An array that contains the alarms that SageMaker monitors to know whether to roll back the AMI update.
(dict) --
The details of the alarm to monitor during the AMI update.
AlarmName (string) --
The name of the alarm.
SlurmConfig (dict) --
The Slurm configuration for the instance group.
NodeType (string) --
The type of Slurm node for the instance group. Valid values are Controller, Worker, and Login.
PartitionNames (list) --
The list of Slurm partition names that the instance group belongs to.
(string) --
RestrictedInstanceGroups (list) --
The specialized instance groups for training models like Amazon Nova to be created in the SageMaker HyperPod cluster.
(dict) --
The instance group details of the restricted instance group (RIG).
CurrentCount (integer) --
The number of instances that are currently in the restricted instance group of a SageMaker HyperPod cluster.
TargetCount (integer) --
The number of instances you specified to add to the restricted instance group of a SageMaker HyperPod cluster.
InstanceGroupName (string) --
The name of the restricted instance group of a SageMaker HyperPod cluster.
InstanceType (string) --
The instance type of the restricted instance group of a SageMaker HyperPod cluster.
ExecutionRole (string) --
The execution role for the restricted instance group to assume.
ThreadsPerCore (integer) --
The number you specified to TreadsPerCore in CreateCluster for enabling or disabling multithreading. For instance types that support multithreading, you can specify 1 for disabling multithreading and 2 for enabling multithreading. For more information, see the reference table of CPU cores and threads per CPU core per instance type in the Amazon Elastic Compute Cloud User Guide.
InstanceStorageConfigs (list) --
The additional storage configurations for the instances in the SageMaker HyperPod cluster restricted instance group.
(dict) --
Defines the configuration for attaching additional storage to the instances in the SageMaker HyperPod cluster instance group. To learn more, see SageMaker HyperPod release notes: June 20, 2024.
EbsVolumeConfig (dict) --
Defines the configuration for attaching additional Amazon Elastic Block Store (EBS) volumes to the instances in the SageMaker HyperPod cluster instance group. The additional EBS volume is attached to each instance within the SageMaker HyperPod cluster instance group and mounted to /opt/sagemaker.
VolumeSizeInGB (integer) --
The size in gigabytes (GB) of the additional EBS volume to be attached to the instances in the SageMaker HyperPod cluster instance group. The additional EBS volume is attached to each instance within the SageMaker HyperPod cluster instance group and mounted to /opt/sagemaker.
VolumeKmsKeyId (string) --
The ID of a KMS key to encrypt the Amazon EBS volume.
RootVolume (boolean) --
Specifies whether the configuration is for the cluster's root or secondary Amazon EBS volume. You can specify two ClusterEbsVolumeConfig fields to configure both the root and secondary volumes. Set the value to True if you'd like to provide your own customer managed Amazon Web Services KMS key to encrypt the root volume. When True:
The configuration is applied to the root volume.
You can't specify the VolumeSizeInGB field. The size of the root volume is determined for you.
You must specify a KMS key ID for VolumeKmsKeyId to encrypt the root volume with your own KMS key instead of an Amazon Web Services owned KMS key.
Otherwise, by default, the value is False, and the following applies:
The configuration is applied to the secondary volume, while the root volume is encrypted with an Amazon Web Services owned key.
You must specify the VolumeSizeInGB field.
You can optionally specify the VolumeKmsKeyId to encrypt the secondary volume with your own KMS key instead of an Amazon Web Services owned KMS key.
FsxLustreConfig (dict) --
Defines the configuration for attaching an Amazon FSx for Lustre file system to the instances in the SageMaker HyperPod cluster instance group.
DnsName (string) --
The DNS name of the Amazon FSx for Lustre file system.
MountName (string) --
The mount name of the Amazon FSx for Lustre file system.
MountPath (string) --
The local path where the Amazon FSx for Lustre file system is mounted on instances.
FsxOpenZfsConfig (dict) --
Defines the configuration for attaching an Amazon FSx for OpenZFS file system to the instances in the SageMaker HyperPod cluster instance group.
DnsName (string) --
The DNS name of the Amazon FSx for OpenZFS file system.
MountPath (string) --
The local path where the Amazon FSx for OpenZFS file system is mounted on instances.
OnStartDeepHealthChecks (list) --
A flag indicating whether deep health checks should be performed when the cluster's restricted instance group is created or updated.
(string) --
Status (string) --
The current status of the cluster's restricted instance group.
InService: The restricted instance group is active and healthy.
Creating: The restricted instance group is being provisioned.
Updating: The restricted instance group is being updated.
Failed: The restricted instance group has failed to provision or is no longer healthy.
Degraded: The restricted instance group is degraded, meaning that some instances have failed to provision or are no longer healthy.
Deleting: The restricted instance group is being deleted.
TrainingPlanArn (string) --
The Amazon Resource Name (ARN) of the training plan to filter clusters by. For more information about reserving GPU capacity for your SageMaker HyperPod clusters using Amazon SageMaker Training Plan, see ``CreateTrainingPlan ``.
TrainingPlanStatus (string) --
The current status of the training plan associated with this cluster restricted instance group.
OverrideVpcConfig (dict) --
Specifies an Amazon Virtual Private Cloud (VPC) that your SageMaker jobs, hosted models, and compute resources have access to. You can control access to and from your resources by configuring a VPC. For more information, see Give SageMaker Access to Resources in your Amazon VPC.
SecurityGroupIds (list) --
The VPC security group IDs, in the form sg-xxxxxxxx. Specify the security groups for the VPC that is specified in the Subnets field.
(string) --
Subnets (list) --
The ID of the subnets in the VPC to which you want to connect your training job or model. For information about the availability of specific instance types, see Supported Instance Types and Availability Zones.
(string) --
ScheduledUpdateConfig (dict) --
The configuration object of the schedule that SageMaker follows when updating the AMI.
ScheduleExpression (string) --
A cron expression that specifies the schedule that SageMaker follows when updating the AMI.
DeploymentConfig (dict) --
The configuration to use when updating the AMI versions.
RollingUpdatePolicy (dict) --
The policy that SageMaker uses when updating the AMI versions of the cluster.
MaximumBatchSize (dict) --
The maximum amount of instances in the cluster that SageMaker can update at a time.
Type (string) --
Specifies whether SageMaker should process the update by amount or percentage of instances.
Value (integer) --
Specifies the amount or percentage of instances SageMaker updates at a time.
RollbackMaximumBatchSize (dict) --
The maximum amount of instances in the cluster that SageMaker can roll back at a time.
Type (string) --
Specifies whether SageMaker should process the update by amount or percentage of instances.
Value (integer) --
Specifies the amount or percentage of instances SageMaker updates at a time.
WaitIntervalInSeconds (integer) --
The duration in seconds that SageMaker waits before updating more instances in the cluster.
AutoRollbackConfiguration (list) --
An array that contains the alarms that SageMaker monitors to know whether to roll back the AMI update.
(dict) --
The details of the alarm to monitor during the AMI update.
AlarmName (string) --
The name of the alarm.
EnvironmentConfig (dict) --
The configuration for the restricted instance groups (RIG) environment.
FSxLustreConfig (dict) --
Configuration settings for an Amazon FSx for Lustre file system to be used with the cluster.
SizeInGiB (integer) --
The storage capacity of the Amazon FSx for Lustre file system, specified in gibibytes (GiB).
PerUnitStorageThroughput (integer) --
The throughput capacity of the Amazon FSx for Lustre file system, measured in MB/s per TiB of storage.
S3OutputPath (string) --
The Amazon S3 path where output data from the restricted instance group (RIG) environment will be stored.
VpcConfig (dict) --
Specifies an Amazon Virtual Private Cloud (VPC) that your SageMaker jobs, hosted models, and compute resources have access to. You can control access to and from your resources by configuring a VPC. For more information, see Give SageMaker Access to Resources in your Amazon VPC.
SecurityGroupIds (list) --
The VPC security group IDs, in the form sg-xxxxxxxx. Specify the security groups for the VPC that is specified in the Subnets field.
(string) --
Subnets (list) --
The ID of the subnets in the VPC to which you want to connect your training job or model. For information about the availability of specific instance types, see Supported Instance Types and Availability Zones.
(string) --
Orchestrator (dict) --
The type of orchestrator used for the SageMaker HyperPod cluster.
Eks (dict) --
The Amazon EKS cluster used as the orchestrator for the SageMaker HyperPod cluster.
ClusterArn (string) --
The Amazon Resource Name (ARN) of the Amazon EKS cluster associated with the SageMaker HyperPod cluster.
Slurm (dict) --
The Slurm orchestrator configuration for the SageMaker HyperPod cluster.
SlurmConfigStrategy (string) --
The strategy for managing partitions for the Slurm configuration. Valid values are Managed, Overwrite, and Merge.
TieredStorageConfig (dict) --
The current configuration for managed tier checkpointing on the HyperPod cluster. For example, this shows whether the feature is enabled and the percentage of cluster memory allocated for checkpoint storage.
Mode (string) --
Specifies whether managed tier checkpointing is enabled or disabled for the HyperPod cluster. When set to Enable, the system installs a memory management daemon that provides disaggregated memory as a service for checkpoint storage. When set to Disable, the feature is turned off and the memory management daemon is removed from the cluster.
InstanceMemoryAllocationPercentage (integer) --
The percentage (int) of cluster memory to allocate for checkpointing.
NodeRecovery (string) --
The node recovery mode configured for the SageMaker HyperPod cluster.
NodeProvisioningMode (string) --
The mode used for provisioning nodes in the cluster.
ClusterRole (string) --
The Amazon Resource Name (ARN) of the IAM role that HyperPod uses for cluster autoscaling operations.
AutoScaling (dict) --
The current autoscaling configuration and status for the autoscaler.
Mode (string) --
Describes whether autoscaling is enabled or disabled for the cluster.
AutoScalerType (string) --
The type of autoscaler configured for the cluster.
Status (string) --
The current status of the autoscaling configuration. Valid values are InService, Failed, Creating, and Deleting.
FailureMessage (string) --
If the autoscaling status is Failed, this field contains a message describing the failure.
{'InstanceGroups': {'InstanceRequirements': {'InstanceTypes': ['ml.p4d.24xlarge '
'| '
'ml.p4de.24xlarge '
'| '
'ml.p5.48xlarge '
'| '
'ml.p5.4xlarge '
'| '
'ml.p6e-gb200.36xlarge '
'| '
'ml.trn1.32xlarge '
'| '
'ml.trn1n.32xlarge '
'| ml.g5.xlarge '
'| '
'ml.g5.2xlarge '
'| '
'ml.g5.4xlarge '
'| '
'ml.g5.8xlarge '
'| '
'ml.g5.12xlarge '
'| '
'ml.g5.16xlarge '
'| '
'ml.g5.24xlarge '
'| '
'ml.g5.48xlarge '
'| ml.c5.large '
'| ml.c5.xlarge '
'| '
'ml.c5.2xlarge '
'| '
'ml.c5.4xlarge '
'| '
'ml.c5.9xlarge '
'| '
'ml.c5.12xlarge '
'| '
'ml.c5.18xlarge '
'| '
'ml.c5.24xlarge '
'| ml.c5n.large '
'| '
'ml.c5n.2xlarge '
'| '
'ml.c5n.4xlarge '
'| '
'ml.c5n.9xlarge '
'| '
'ml.c5n.18xlarge '
'| ml.m5.large '
'| ml.m5.xlarge '
'| '
'ml.m5.2xlarge '
'| '
'ml.m5.4xlarge '
'| '
'ml.m5.8xlarge '
'| '
'ml.m5.12xlarge '
'| '
'ml.m5.16xlarge '
'| '
'ml.m5.24xlarge '
'| ml.t3.medium '
'| ml.t3.large '
'| ml.t3.xlarge '
'| '
'ml.t3.2xlarge '
'| ml.g6.xlarge '
'| '
'ml.g6.2xlarge '
'| '
'ml.g6.4xlarge '
'| '
'ml.g6.8xlarge '
'| '
'ml.g6.16xlarge '
'| '
'ml.g6.12xlarge '
'| '
'ml.g6.24xlarge '
'| '
'ml.g6.48xlarge '
'| '
'ml.gr6.4xlarge '
'| '
'ml.gr6.8xlarge '
'| '
'ml.g6e.xlarge '
'| '
'ml.g6e.2xlarge '
'| '
'ml.g6e.4xlarge '
'| '
'ml.g6e.8xlarge '
'| '
'ml.g6e.16xlarge '
'| '
'ml.g6e.12xlarge '
'| '
'ml.g6e.24xlarge '
'| '
'ml.g6e.48xlarge '
'| '
'ml.p5e.48xlarge '
'| '
'ml.p5en.48xlarge '
'| '
'ml.p6-b200.48xlarge '
'| '
'ml.trn2.3xlarge '
'| '
'ml.trn2.48xlarge '
'| ml.c6i.large '
'| '
'ml.c6i.xlarge '
'| '
'ml.c6i.2xlarge '
'| '
'ml.c6i.4xlarge '
'| '
'ml.c6i.8xlarge '
'| '
'ml.c6i.12xlarge '
'| '
'ml.c6i.16xlarge '
'| '
'ml.c6i.24xlarge '
'| '
'ml.c6i.32xlarge '
'| ml.m6i.large '
'| '
'ml.m6i.xlarge '
'| '
'ml.m6i.2xlarge '
'| '
'ml.m6i.4xlarge '
'| '
'ml.m6i.8xlarge '
'| '
'ml.m6i.12xlarge '
'| '
'ml.m6i.16xlarge '
'| '
'ml.m6i.24xlarge '
'| '
'ml.m6i.32xlarge '
'| ml.r6i.large '
'| '
'ml.r6i.xlarge '
'| '
'ml.r6i.2xlarge '
'| '
'ml.r6i.4xlarge '
'| '
'ml.r6i.8xlarge '
'| '
'ml.r6i.12xlarge '
'| '
'ml.r6i.16xlarge '
'| '
'ml.r6i.24xlarge '
'| '
'ml.r6i.32xlarge '
'| '
'ml.i3en.large '
'| '
'ml.i3en.xlarge '
'| '
'ml.i3en.2xlarge '
'| '
'ml.i3en.3xlarge '
'| '
'ml.i3en.6xlarge '
'| '
'ml.i3en.12xlarge '
'| '
'ml.i3en.24xlarge '
'| ml.m7i.large '
'| '
'ml.m7i.xlarge '
'| '
'ml.m7i.2xlarge '
'| '
'ml.m7i.4xlarge '
'| '
'ml.m7i.8xlarge '
'| '
'ml.m7i.12xlarge '
'| '
'ml.m7i.16xlarge '
'| '
'ml.m7i.24xlarge '
'| '
'ml.m7i.48xlarge '
'| ml.r7i.large '
'| '
'ml.r7i.xlarge '
'| '
'ml.r7i.2xlarge '
'| '
'ml.r7i.4xlarge '
'| '
'ml.r7i.8xlarge '
'| '
'ml.r7i.12xlarge '
'| '
'ml.r7i.16xlarge '
'| '
'ml.r7i.24xlarge '
'| '
'ml.r7i.48xlarge '
'| '
'ml.r5d.16xlarge '
'| '
'ml.g7e.2xlarge '
'| '
'ml.g7e.4xlarge '
'| '
'ml.g7e.8xlarge '
'| '
'ml.g7e.12xlarge '
'| '
'ml.g7e.24xlarge '
'| '
'ml.g7e.48xlarge '
'| '
'ml.p6-b300.48xlarge']}}}
Updates a SageMaker HyperPod cluster.
See also: AWS API Documentation
Request Syntax
client.update_cluster(
ClusterName='string',
InstanceGroups=[
{
'InstanceCount': 123,
'MinInstanceCount': 123,
'InstanceGroupName': 'string',
'InstanceType': 'ml.p4d.24xlarge'|'ml.p4de.24xlarge'|'ml.p5.48xlarge'|'ml.p5.4xlarge'|'ml.p6e-gb200.36xlarge'|'ml.trn1.32xlarge'|'ml.trn1n.32xlarge'|'ml.g5.xlarge'|'ml.g5.2xlarge'|'ml.g5.4xlarge'|'ml.g5.8xlarge'|'ml.g5.12xlarge'|'ml.g5.16xlarge'|'ml.g5.24xlarge'|'ml.g5.48xlarge'|'ml.c5.large'|'ml.c5.xlarge'|'ml.c5.2xlarge'|'ml.c5.4xlarge'|'ml.c5.9xlarge'|'ml.c5.12xlarge'|'ml.c5.18xlarge'|'ml.c5.24xlarge'|'ml.c5n.large'|'ml.c5n.2xlarge'|'ml.c5n.4xlarge'|'ml.c5n.9xlarge'|'ml.c5n.18xlarge'|'ml.m5.large'|'ml.m5.xlarge'|'ml.m5.2xlarge'|'ml.m5.4xlarge'|'ml.m5.8xlarge'|'ml.m5.12xlarge'|'ml.m5.16xlarge'|'ml.m5.24xlarge'|'ml.t3.medium'|'ml.t3.large'|'ml.t3.xlarge'|'ml.t3.2xlarge'|'ml.g6.xlarge'|'ml.g6.2xlarge'|'ml.g6.4xlarge'|'ml.g6.8xlarge'|'ml.g6.16xlarge'|'ml.g6.12xlarge'|'ml.g6.24xlarge'|'ml.g6.48xlarge'|'ml.gr6.4xlarge'|'ml.gr6.8xlarge'|'ml.g6e.xlarge'|'ml.g6e.2xlarge'|'ml.g6e.4xlarge'|'ml.g6e.8xlarge'|'ml.g6e.16xlarge'|'ml.g6e.12xlarge'|'ml.g6e.24xlarge'|'ml.g6e.48xlarge'|'ml.p5e.48xlarge'|'ml.p5en.48xlarge'|'ml.p6-b200.48xlarge'|'ml.trn2.3xlarge'|'ml.trn2.48xlarge'|'ml.c6i.large'|'ml.c6i.xlarge'|'ml.c6i.2xlarge'|'ml.c6i.4xlarge'|'ml.c6i.8xlarge'|'ml.c6i.12xlarge'|'ml.c6i.16xlarge'|'ml.c6i.24xlarge'|'ml.c6i.32xlarge'|'ml.m6i.large'|'ml.m6i.xlarge'|'ml.m6i.2xlarge'|'ml.m6i.4xlarge'|'ml.m6i.8xlarge'|'ml.m6i.12xlarge'|'ml.m6i.16xlarge'|'ml.m6i.24xlarge'|'ml.m6i.32xlarge'|'ml.r6i.large'|'ml.r6i.xlarge'|'ml.r6i.2xlarge'|'ml.r6i.4xlarge'|'ml.r6i.8xlarge'|'ml.r6i.12xlarge'|'ml.r6i.16xlarge'|'ml.r6i.24xlarge'|'ml.r6i.32xlarge'|'ml.i3en.large'|'ml.i3en.xlarge'|'ml.i3en.2xlarge'|'ml.i3en.3xlarge'|'ml.i3en.6xlarge'|'ml.i3en.12xlarge'|'ml.i3en.24xlarge'|'ml.m7i.large'|'ml.m7i.xlarge'|'ml.m7i.2xlarge'|'ml.m7i.4xlarge'|'ml.m7i.8xlarge'|'ml.m7i.12xlarge'|'ml.m7i.16xlarge'|'ml.m7i.24xlarge'|'ml.m7i.48xlarge'|'ml.r7i.large'|'ml.r7i.xlarge'|'ml.r7i.2xlarge'|'ml.r7i.4xlarge'|'ml.r7i.8xlarge'|'ml.r7i.12xlarge'|'ml.r7i.16xlarge'|'ml.r7i.24xlarge'|'ml.r7i.48xlarge'|'ml.r5d.16xlarge'|'ml.g7e.2xlarge'|'ml.g7e.4xlarge'|'ml.g7e.8xlarge'|'ml.g7e.12xlarge'|'ml.g7e.24xlarge'|'ml.g7e.48xlarge'|'ml.p6-b300.48xlarge',
'InstanceRequirements': {
'InstanceTypes': [
'ml.p4d.24xlarge'|'ml.p4de.24xlarge'|'ml.p5.48xlarge'|'ml.p5.4xlarge'|'ml.p6e-gb200.36xlarge'|'ml.trn1.32xlarge'|'ml.trn1n.32xlarge'|'ml.g5.xlarge'|'ml.g5.2xlarge'|'ml.g5.4xlarge'|'ml.g5.8xlarge'|'ml.g5.12xlarge'|'ml.g5.16xlarge'|'ml.g5.24xlarge'|'ml.g5.48xlarge'|'ml.c5.large'|'ml.c5.xlarge'|'ml.c5.2xlarge'|'ml.c5.4xlarge'|'ml.c5.9xlarge'|'ml.c5.12xlarge'|'ml.c5.18xlarge'|'ml.c5.24xlarge'|'ml.c5n.large'|'ml.c5n.2xlarge'|'ml.c5n.4xlarge'|'ml.c5n.9xlarge'|'ml.c5n.18xlarge'|'ml.m5.large'|'ml.m5.xlarge'|'ml.m5.2xlarge'|'ml.m5.4xlarge'|'ml.m5.8xlarge'|'ml.m5.12xlarge'|'ml.m5.16xlarge'|'ml.m5.24xlarge'|'ml.t3.medium'|'ml.t3.large'|'ml.t3.xlarge'|'ml.t3.2xlarge'|'ml.g6.xlarge'|'ml.g6.2xlarge'|'ml.g6.4xlarge'|'ml.g6.8xlarge'|'ml.g6.16xlarge'|'ml.g6.12xlarge'|'ml.g6.24xlarge'|'ml.g6.48xlarge'|'ml.gr6.4xlarge'|'ml.gr6.8xlarge'|'ml.g6e.xlarge'|'ml.g6e.2xlarge'|'ml.g6e.4xlarge'|'ml.g6e.8xlarge'|'ml.g6e.16xlarge'|'ml.g6e.12xlarge'|'ml.g6e.24xlarge'|'ml.g6e.48xlarge'|'ml.p5e.48xlarge'|'ml.p5en.48xlarge'|'ml.p6-b200.48xlarge'|'ml.trn2.3xlarge'|'ml.trn2.48xlarge'|'ml.c6i.large'|'ml.c6i.xlarge'|'ml.c6i.2xlarge'|'ml.c6i.4xlarge'|'ml.c6i.8xlarge'|'ml.c6i.12xlarge'|'ml.c6i.16xlarge'|'ml.c6i.24xlarge'|'ml.c6i.32xlarge'|'ml.m6i.large'|'ml.m6i.xlarge'|'ml.m6i.2xlarge'|'ml.m6i.4xlarge'|'ml.m6i.8xlarge'|'ml.m6i.12xlarge'|'ml.m6i.16xlarge'|'ml.m6i.24xlarge'|'ml.m6i.32xlarge'|'ml.r6i.large'|'ml.r6i.xlarge'|'ml.r6i.2xlarge'|'ml.r6i.4xlarge'|'ml.r6i.8xlarge'|'ml.r6i.12xlarge'|'ml.r6i.16xlarge'|'ml.r6i.24xlarge'|'ml.r6i.32xlarge'|'ml.i3en.large'|'ml.i3en.xlarge'|'ml.i3en.2xlarge'|'ml.i3en.3xlarge'|'ml.i3en.6xlarge'|'ml.i3en.12xlarge'|'ml.i3en.24xlarge'|'ml.m7i.large'|'ml.m7i.xlarge'|'ml.m7i.2xlarge'|'ml.m7i.4xlarge'|'ml.m7i.8xlarge'|'ml.m7i.12xlarge'|'ml.m7i.16xlarge'|'ml.m7i.24xlarge'|'ml.m7i.48xlarge'|'ml.r7i.large'|'ml.r7i.xlarge'|'ml.r7i.2xlarge'|'ml.r7i.4xlarge'|'ml.r7i.8xlarge'|'ml.r7i.12xlarge'|'ml.r7i.16xlarge'|'ml.r7i.24xlarge'|'ml.r7i.48xlarge'|'ml.r5d.16xlarge'|'ml.g7e.2xlarge'|'ml.g7e.4xlarge'|'ml.g7e.8xlarge'|'ml.g7e.12xlarge'|'ml.g7e.24xlarge'|'ml.g7e.48xlarge'|'ml.p6-b300.48xlarge',
]
},
'LifeCycleConfig': {
'SourceS3Uri': 'string',
'OnCreate': 'string'
},
'ExecutionRole': 'string',
'ThreadsPerCore': 123,
'InstanceStorageConfigs': [
{
'EbsVolumeConfig': {
'VolumeSizeInGB': 123,
'VolumeKmsKeyId': 'string',
'RootVolume': True|False
},
'FsxLustreConfig': {
'DnsName': 'string',
'MountName': 'string',
'MountPath': 'string'
},
'FsxOpenZfsConfig': {
'DnsName': 'string',
'MountPath': 'string'
}
},
],
'OnStartDeepHealthChecks': [
'InstanceStress'|'InstanceConnectivity',
],
'TrainingPlanArn': 'string',
'OverrideVpcConfig': {
'SecurityGroupIds': [
'string',
],
'Subnets': [
'string',
]
},
'ScheduledUpdateConfig': {
'ScheduleExpression': 'string',
'DeploymentConfig': {
'RollingUpdatePolicy': {
'MaximumBatchSize': {
'Type': 'INSTANCE_COUNT'|'CAPACITY_PERCENTAGE',
'Value': 123
},
'RollbackMaximumBatchSize': {
'Type': 'INSTANCE_COUNT'|'CAPACITY_PERCENTAGE',
'Value': 123
}
},
'WaitIntervalInSeconds': 123,
'AutoRollbackConfiguration': [
{
'AlarmName': 'string'
},
]
}
},
'ImageId': 'string',
'KubernetesConfig': {
'Labels': {
'string': 'string'
},
'Taints': [
{
'Key': 'string',
'Value': 'string',
'Effect': 'NoSchedule'|'PreferNoSchedule'|'NoExecute'
},
]
},
'SlurmConfig': {
'NodeType': 'Controller'|'Login'|'Compute',
'PartitionNames': [
'string',
]
},
'CapacityRequirements': {
'Spot': {}
,
'OnDemand': {}
}
},
],
RestrictedInstanceGroups=[
{
'InstanceCount': 123,
'InstanceGroupName': 'string',
'InstanceType': 'ml.p4d.24xlarge'|'ml.p4de.24xlarge'|'ml.p5.48xlarge'|'ml.p5.4xlarge'|'ml.p6e-gb200.36xlarge'|'ml.trn1.32xlarge'|'ml.trn1n.32xlarge'|'ml.g5.xlarge'|'ml.g5.2xlarge'|'ml.g5.4xlarge'|'ml.g5.8xlarge'|'ml.g5.12xlarge'|'ml.g5.16xlarge'|'ml.g5.24xlarge'|'ml.g5.48xlarge'|'ml.c5.large'|'ml.c5.xlarge'|'ml.c5.2xlarge'|'ml.c5.4xlarge'|'ml.c5.9xlarge'|'ml.c5.12xlarge'|'ml.c5.18xlarge'|'ml.c5.24xlarge'|'ml.c5n.large'|'ml.c5n.2xlarge'|'ml.c5n.4xlarge'|'ml.c5n.9xlarge'|'ml.c5n.18xlarge'|'ml.m5.large'|'ml.m5.xlarge'|'ml.m5.2xlarge'|'ml.m5.4xlarge'|'ml.m5.8xlarge'|'ml.m5.12xlarge'|'ml.m5.16xlarge'|'ml.m5.24xlarge'|'ml.t3.medium'|'ml.t3.large'|'ml.t3.xlarge'|'ml.t3.2xlarge'|'ml.g6.xlarge'|'ml.g6.2xlarge'|'ml.g6.4xlarge'|'ml.g6.8xlarge'|'ml.g6.16xlarge'|'ml.g6.12xlarge'|'ml.g6.24xlarge'|'ml.g6.48xlarge'|'ml.gr6.4xlarge'|'ml.gr6.8xlarge'|'ml.g6e.xlarge'|'ml.g6e.2xlarge'|'ml.g6e.4xlarge'|'ml.g6e.8xlarge'|'ml.g6e.16xlarge'|'ml.g6e.12xlarge'|'ml.g6e.24xlarge'|'ml.g6e.48xlarge'|'ml.p5e.48xlarge'|'ml.p5en.48xlarge'|'ml.p6-b200.48xlarge'|'ml.trn2.3xlarge'|'ml.trn2.48xlarge'|'ml.c6i.large'|'ml.c6i.xlarge'|'ml.c6i.2xlarge'|'ml.c6i.4xlarge'|'ml.c6i.8xlarge'|'ml.c6i.12xlarge'|'ml.c6i.16xlarge'|'ml.c6i.24xlarge'|'ml.c6i.32xlarge'|'ml.m6i.large'|'ml.m6i.xlarge'|'ml.m6i.2xlarge'|'ml.m6i.4xlarge'|'ml.m6i.8xlarge'|'ml.m6i.12xlarge'|'ml.m6i.16xlarge'|'ml.m6i.24xlarge'|'ml.m6i.32xlarge'|'ml.r6i.large'|'ml.r6i.xlarge'|'ml.r6i.2xlarge'|'ml.r6i.4xlarge'|'ml.r6i.8xlarge'|'ml.r6i.12xlarge'|'ml.r6i.16xlarge'|'ml.r6i.24xlarge'|'ml.r6i.32xlarge'|'ml.i3en.large'|'ml.i3en.xlarge'|'ml.i3en.2xlarge'|'ml.i3en.3xlarge'|'ml.i3en.6xlarge'|'ml.i3en.12xlarge'|'ml.i3en.24xlarge'|'ml.m7i.large'|'ml.m7i.xlarge'|'ml.m7i.2xlarge'|'ml.m7i.4xlarge'|'ml.m7i.8xlarge'|'ml.m7i.12xlarge'|'ml.m7i.16xlarge'|'ml.m7i.24xlarge'|'ml.m7i.48xlarge'|'ml.r7i.large'|'ml.r7i.xlarge'|'ml.r7i.2xlarge'|'ml.r7i.4xlarge'|'ml.r7i.8xlarge'|'ml.r7i.12xlarge'|'ml.r7i.16xlarge'|'ml.r7i.24xlarge'|'ml.r7i.48xlarge'|'ml.r5d.16xlarge'|'ml.g7e.2xlarge'|'ml.g7e.4xlarge'|'ml.g7e.8xlarge'|'ml.g7e.12xlarge'|'ml.g7e.24xlarge'|'ml.g7e.48xlarge'|'ml.p6-b300.48xlarge',
'ExecutionRole': 'string',
'ThreadsPerCore': 123,
'InstanceStorageConfigs': [
{
'EbsVolumeConfig': {
'VolumeSizeInGB': 123,
'VolumeKmsKeyId': 'string',
'RootVolume': True|False
},
'FsxLustreConfig': {
'DnsName': 'string',
'MountName': 'string',
'MountPath': 'string'
},
'FsxOpenZfsConfig': {
'DnsName': 'string',
'MountPath': 'string'
}
},
],
'OnStartDeepHealthChecks': [
'InstanceStress'|'InstanceConnectivity',
],
'TrainingPlanArn': 'string',
'OverrideVpcConfig': {
'SecurityGroupIds': [
'string',
],
'Subnets': [
'string',
]
},
'ScheduledUpdateConfig': {
'ScheduleExpression': 'string',
'DeploymentConfig': {
'RollingUpdatePolicy': {
'MaximumBatchSize': {
'Type': 'INSTANCE_COUNT'|'CAPACITY_PERCENTAGE',
'Value': 123
},
'RollbackMaximumBatchSize': {
'Type': 'INSTANCE_COUNT'|'CAPACITY_PERCENTAGE',
'Value': 123
}
},
'WaitIntervalInSeconds': 123,
'AutoRollbackConfiguration': [
{
'AlarmName': 'string'
},
]
}
},
'EnvironmentConfig': {
'FSxLustreConfig': {
'SizeInGiB': 123,
'PerUnitStorageThroughput': 123
}
}
},
],
TieredStorageConfig={
'Mode': 'Enable'|'Disable',
'InstanceMemoryAllocationPercentage': 123
},
NodeRecovery='Automatic'|'None',
InstanceGroupsToDelete=[
'string',
],
NodeProvisioningMode='Continuous',
ClusterRole='string',
AutoScaling={
'Mode': 'Enable'|'Disable',
'AutoScalerType': 'Karpenter'
},
Orchestrator={
'Eks': {
'ClusterArn': 'string'
},
'Slurm': {
'SlurmConfigStrategy': 'Overwrite'|'Managed'|'Merge'
}
}
)
string
[REQUIRED]
Specify the name of the SageMaker HyperPod cluster you want to update.
list
Specify the instance groups to update.
(dict) --
The specifications of an instance group that you need to define.
InstanceCount (integer) -- [REQUIRED]
Specifies the number of instances to add to the instance group of a SageMaker HyperPod cluster.
MinInstanceCount (integer) --
Defines the minimum number of instances required for an instance group to become InService. If this threshold isn't met within 3 hours, the instance group rolls back to its previous state - zero instances for new instance groups, or previous settings for existing instance groups. MinInstanceCount only affects the initial transition to InService and does not guarantee maintaining this minimum afterward.
InstanceGroupName (string) -- [REQUIRED]
Specifies the name of the instance group.
InstanceType (string) --
Specifies the instance type of the instance group.
InstanceRequirements (dict) --
The instance requirements for the instance group, including the instance types to use. Use this to create a flexible instance group that supports multiple instance types. The InstanceType and InstanceRequirements properties are mutually exclusive.
InstanceTypes (list) -- [REQUIRED]
The list of instance types that the instance group can use. The order of instance types determines the priority—HyperPod attempts to provision instances using the first instance type in the list and falls back to subsequent types if capacity is unavailable.
(string) --
LifeCycleConfig (dict) --
Specifies the LifeCycle configuration for the instance group.
SourceS3Uri (string) --
An Amazon S3 bucket path where your lifecycle scripts are stored.
OnCreate (string) --
The file name of the entrypoint script of lifecycle scripts under SourceS3Uri. This entrypoint script runs during cluster creation.
ExecutionRole (string) -- [REQUIRED]
Specifies an IAM execution role to be assumed by the instance group.
ThreadsPerCore (integer) --
Specifies the value for Threads per core. For instance types that support multithreading, you can specify 1 for disabling multithreading and 2 for enabling multithreading. For instance types that doesn't support multithreading, specify 1. For more information, see the reference table of CPU cores and threads per CPU core per instance type in the Amazon Elastic Compute Cloud User Guide.
InstanceStorageConfigs (list) --
Specifies the additional storage configurations for the instances in the SageMaker HyperPod cluster instance group.
(dict) --
Defines the configuration for attaching additional storage to the instances in the SageMaker HyperPod cluster instance group. To learn more, see SageMaker HyperPod release notes: June 20, 2024.
EbsVolumeConfig (dict) --
Defines the configuration for attaching additional Amazon Elastic Block Store (EBS) volumes to the instances in the SageMaker HyperPod cluster instance group. The additional EBS volume is attached to each instance within the SageMaker HyperPod cluster instance group and mounted to /opt/sagemaker.
VolumeSizeInGB (integer) --
The size in gigabytes (GB) of the additional EBS volume to be attached to the instances in the SageMaker HyperPod cluster instance group. The additional EBS volume is attached to each instance within the SageMaker HyperPod cluster instance group and mounted to /opt/sagemaker.
VolumeKmsKeyId (string) --
The ID of a KMS key to encrypt the Amazon EBS volume.
RootVolume (boolean) --
Specifies whether the configuration is for the cluster's root or secondary Amazon EBS volume. You can specify two ClusterEbsVolumeConfig fields to configure both the root and secondary volumes. Set the value to True if you'd like to provide your own customer managed Amazon Web Services KMS key to encrypt the root volume. When True:
The configuration is applied to the root volume.
You can't specify the VolumeSizeInGB field. The size of the root volume is determined for you.
You must specify a KMS key ID for VolumeKmsKeyId to encrypt the root volume with your own KMS key instead of an Amazon Web Services owned KMS key.
Otherwise, by default, the value is False, and the following applies:
The configuration is applied to the secondary volume, while the root volume is encrypted with an Amazon Web Services owned key.
You must specify the VolumeSizeInGB field.
You can optionally specify the VolumeKmsKeyId to encrypt the secondary volume with your own KMS key instead of an Amazon Web Services owned KMS key.
FsxLustreConfig (dict) --
Defines the configuration for attaching an Amazon FSx for Lustre file system to the instances in the SageMaker HyperPod cluster instance group.
DnsName (string) -- [REQUIRED]
The DNS name of the Amazon FSx for Lustre file system.
MountName (string) -- [REQUIRED]
The mount name of the Amazon FSx for Lustre file system.
MountPath (string) --
The local path where the Amazon FSx for Lustre file system is mounted on instances.
FsxOpenZfsConfig (dict) --
Defines the configuration for attaching an Amazon FSx for OpenZFS file system to the instances in the SageMaker HyperPod cluster instance group.
DnsName (string) -- [REQUIRED]
The DNS name of the Amazon FSx for OpenZFS file system.
MountPath (string) --
The local path where the Amazon FSx for OpenZFS file system is mounted on instances.
OnStartDeepHealthChecks (list) --
A flag indicating whether deep health checks should be performed when the cluster instance group is created or updated.
(string) --
TrainingPlanArn (string) --
The Amazon Resource Name (ARN); of the training plan to use for this cluster instance group.
For more information about how to reserve GPU capacity for your SageMaker HyperPod clusters using Amazon SageMaker Training Plan, see ``CreateTrainingPlan ``.
OverrideVpcConfig (dict) --
To configure multi-AZ deployments, customize the Amazon VPC configuration at the instance group level. You can specify different subnets and security groups across different AZs in the instance group specification to override a SageMaker HyperPod cluster's default Amazon VPC configuration. For more information about deploying a cluster in multiple AZs, see Setting up SageMaker HyperPod clusters across multiple AZs.
SecurityGroupIds (list) -- [REQUIRED]
The VPC security group IDs, in the form sg-xxxxxxxx. Specify the security groups for the VPC that is specified in the Subnets field.
(string) --
Subnets (list) -- [REQUIRED]
The ID of the subnets in the VPC to which you want to connect your training job or model. For information about the availability of specific instance types, see Supported Instance Types and Availability Zones.
(string) --
ScheduledUpdateConfig (dict) --
The configuration object of the schedule that SageMaker uses to update the AMI.
ScheduleExpression (string) -- [REQUIRED]
A cron expression that specifies the schedule that SageMaker follows when updating the AMI.
DeploymentConfig (dict) --
The configuration to use when updating the AMI versions.
RollingUpdatePolicy (dict) --
The policy that SageMaker uses when updating the AMI versions of the cluster.
MaximumBatchSize (dict) -- [REQUIRED]
The maximum amount of instances in the cluster that SageMaker can update at a time.
Type (string) -- [REQUIRED]
Specifies whether SageMaker should process the update by amount or percentage of instances.
Value (integer) -- [REQUIRED]
Specifies the amount or percentage of instances SageMaker updates at a time.
RollbackMaximumBatchSize (dict) --
The maximum amount of instances in the cluster that SageMaker can roll back at a time.
Type (string) -- [REQUIRED]
Specifies whether SageMaker should process the update by amount or percentage of instances.
Value (integer) -- [REQUIRED]
Specifies the amount or percentage of instances SageMaker updates at a time.
WaitIntervalInSeconds (integer) --
The duration in seconds that SageMaker waits before updating more instances in the cluster.
AutoRollbackConfiguration (list) --
An array that contains the alarms that SageMaker monitors to know whether to roll back the AMI update.
(dict) --
The details of the alarm to monitor during the AMI update.
AlarmName (string) -- [REQUIRED]
The name of the alarm.
ImageId (string) --
When configuring your HyperPod cluster, you can specify an image ID using one of the following options:
HyperPodPublicAmiId: Use a HyperPod public AMI
CustomAmiId: Use your custom AMI
default: Use the default latest system image
If you choose to use a custom AMI ( CustomAmiId), ensure it meets the following requirements:
Encryption: The custom AMI must be unencrypted.
Ownership: The custom AMI must be owned by the same Amazon Web Services account that is creating the HyperPod cluster.
Volume support: Only the primary AMI snapshot volume is supported; additional AMI volumes are not supported.
When updating the instance group's AMI through the UpdateClusterSoftware operation, if an instance group uses a custom AMI, you must provide an ImageId or use the default as input. Note that if you don't specify an instance group in your UpdateClusterSoftware request, then all of the instance groups are patched with the specified image.
KubernetesConfig (dict) --
Specifies the Kubernetes configuration for the instance group. You describe what you want the labels and taints to look like, and the cluster works to reconcile the actual state with the declared state for nodes in this instance group.
Labels (dict) --
Key-value pairs of labels to be applied to cluster nodes.
(string) --
(string) --
Taints (list) --
List of taints to be applied to cluster nodes.
(dict) --
A Kubernetes taint that can be applied to cluster nodes.
Key (string) -- [REQUIRED]
The key of the taint.
Value (string) --
The value of the taint.
Effect (string) -- [REQUIRED]
The effect of the taint. Valid values are NoSchedule, PreferNoSchedule, and NoExecute.
SlurmConfig (dict) --
Specifies the Slurm configuration for the instance group.
NodeType (string) -- [REQUIRED]
The type of Slurm node for the instance group. Valid values are Controller, Worker, and Login.
PartitionNames (list) --
The list of Slurm partition names that the instance group belongs to.
(string) --
CapacityRequirements (dict) --
Specifies the capacity requirements for the instance group.
Spot (dict) --
Configuration options specific to Spot instances.
OnDemand (dict) --
Configuration options specific to On-Demand instances.
list
The specialized instance groups for training models like Amazon Nova to be created in the SageMaker HyperPod cluster.
(dict) --
The specifications of a restricted instance group that you need to define.
InstanceCount (integer) -- [REQUIRED]
Specifies the number of instances to add to the restricted instance group of a SageMaker HyperPod cluster.
InstanceGroupName (string) -- [REQUIRED]
Specifies the name of the restricted instance group.
InstanceType (string) -- [REQUIRED]
Specifies the instance type of the restricted instance group.
ExecutionRole (string) -- [REQUIRED]
Specifies an IAM execution role to be assumed by the restricted instance group.
ThreadsPerCore (integer) --
The number you specified to TreadsPerCore in CreateCluster for enabling or disabling multithreading. For instance types that support multithreading, you can specify 1 for disabling multithreading and 2 for enabling multithreading. For more information, see the reference table of CPU cores and threads per CPU core per instance type in the Amazon Elastic Compute Cloud User Guide.
InstanceStorageConfigs (list) --
Specifies the additional storage configurations for the instances in the SageMaker HyperPod cluster restricted instance group.
(dict) --
Defines the configuration for attaching additional storage to the instances in the SageMaker HyperPod cluster instance group. To learn more, see SageMaker HyperPod release notes: June 20, 2024.
EbsVolumeConfig (dict) --
Defines the configuration for attaching additional Amazon Elastic Block Store (EBS) volumes to the instances in the SageMaker HyperPod cluster instance group. The additional EBS volume is attached to each instance within the SageMaker HyperPod cluster instance group and mounted to /opt/sagemaker.
VolumeSizeInGB (integer) --
The size in gigabytes (GB) of the additional EBS volume to be attached to the instances in the SageMaker HyperPod cluster instance group. The additional EBS volume is attached to each instance within the SageMaker HyperPod cluster instance group and mounted to /opt/sagemaker.
VolumeKmsKeyId (string) --
The ID of a KMS key to encrypt the Amazon EBS volume.
RootVolume (boolean) --
Specifies whether the configuration is for the cluster's root or secondary Amazon EBS volume. You can specify two ClusterEbsVolumeConfig fields to configure both the root and secondary volumes. Set the value to True if you'd like to provide your own customer managed Amazon Web Services KMS key to encrypt the root volume. When True:
The configuration is applied to the root volume.
You can't specify the VolumeSizeInGB field. The size of the root volume is determined for you.
You must specify a KMS key ID for VolumeKmsKeyId to encrypt the root volume with your own KMS key instead of an Amazon Web Services owned KMS key.
Otherwise, by default, the value is False, and the following applies:
The configuration is applied to the secondary volume, while the root volume is encrypted with an Amazon Web Services owned key.
You must specify the VolumeSizeInGB field.
You can optionally specify the VolumeKmsKeyId to encrypt the secondary volume with your own KMS key instead of an Amazon Web Services owned KMS key.
FsxLustreConfig (dict) --
Defines the configuration for attaching an Amazon FSx for Lustre file system to the instances in the SageMaker HyperPod cluster instance group.
DnsName (string) -- [REQUIRED]
The DNS name of the Amazon FSx for Lustre file system.
MountName (string) -- [REQUIRED]
The mount name of the Amazon FSx for Lustre file system.
MountPath (string) --
The local path where the Amazon FSx for Lustre file system is mounted on instances.
FsxOpenZfsConfig (dict) --
Defines the configuration for attaching an Amazon FSx for OpenZFS file system to the instances in the SageMaker HyperPod cluster instance group.
DnsName (string) -- [REQUIRED]
The DNS name of the Amazon FSx for OpenZFS file system.
MountPath (string) --
The local path where the Amazon FSx for OpenZFS file system is mounted on instances.
OnStartDeepHealthChecks (list) --
A flag indicating whether deep health checks should be performed when the cluster restricted instance group is created or updated.
(string) --
TrainingPlanArn (string) --
The Amazon Resource Name (ARN) of the training plan to filter clusters by. For more information about reserving GPU capacity for your SageMaker HyperPod clusters using Amazon SageMaker Training Plan, see ``CreateTrainingPlan ``.
OverrideVpcConfig (dict) --
Specifies an Amazon Virtual Private Cloud (VPC) that your SageMaker jobs, hosted models, and compute resources have access to. You can control access to and from your resources by configuring a VPC. For more information, see Give SageMaker Access to Resources in your Amazon VPC.
SecurityGroupIds (list) -- [REQUIRED]
The VPC security group IDs, in the form sg-xxxxxxxx. Specify the security groups for the VPC that is specified in the Subnets field.
(string) --
Subnets (list) -- [REQUIRED]
The ID of the subnets in the VPC to which you want to connect your training job or model. For information about the availability of specific instance types, see Supported Instance Types and Availability Zones.
(string) --
ScheduledUpdateConfig (dict) --
The configuration object of the schedule that SageMaker follows when updating the AMI.
ScheduleExpression (string) -- [REQUIRED]
A cron expression that specifies the schedule that SageMaker follows when updating the AMI.
DeploymentConfig (dict) --
The configuration to use when updating the AMI versions.
RollingUpdatePolicy (dict) --
The policy that SageMaker uses when updating the AMI versions of the cluster.
MaximumBatchSize (dict) -- [REQUIRED]
The maximum amount of instances in the cluster that SageMaker can update at a time.
Type (string) -- [REQUIRED]
Specifies whether SageMaker should process the update by amount or percentage of instances.
Value (integer) -- [REQUIRED]
Specifies the amount or percentage of instances SageMaker updates at a time.
RollbackMaximumBatchSize (dict) --
The maximum amount of instances in the cluster that SageMaker can roll back at a time.
Type (string) -- [REQUIRED]
Specifies whether SageMaker should process the update by amount or percentage of instances.
Value (integer) -- [REQUIRED]
Specifies the amount or percentage of instances SageMaker updates at a time.
WaitIntervalInSeconds (integer) --
The duration in seconds that SageMaker waits before updating more instances in the cluster.
AutoRollbackConfiguration (list) --
An array that contains the alarms that SageMaker monitors to know whether to roll back the AMI update.
(dict) --
The details of the alarm to monitor during the AMI update.
AlarmName (string) -- [REQUIRED]
The name of the alarm.
EnvironmentConfig (dict) -- [REQUIRED]
The configuration for the restricted instance groups (RIG) environment.
FSxLustreConfig (dict) --
Configuration settings for an Amazon FSx for Lustre file system to be used with the cluster.
SizeInGiB (integer) -- [REQUIRED]
The storage capacity of the Amazon FSx for Lustre file system, specified in gibibytes (GiB).
PerUnitStorageThroughput (integer) -- [REQUIRED]
The throughput capacity of the Amazon FSx for Lustre file system, measured in MB/s per TiB of storage.
dict
Updates the configuration for managed tier checkpointing on the HyperPod cluster. For example, you can enable or disable the feature and modify the percentage of cluster memory allocated for checkpoint storage.
Mode (string) -- [REQUIRED]
Specifies whether managed tier checkpointing is enabled or disabled for the HyperPod cluster. When set to Enable, the system installs a memory management daemon that provides disaggregated memory as a service for checkpoint storage. When set to Disable, the feature is turned off and the memory management daemon is removed from the cluster.
InstanceMemoryAllocationPercentage (integer) --
The percentage (int) of cluster memory to allocate for checkpointing.
string
The node recovery mode to be applied to the SageMaker HyperPod cluster.
list
Specify the names of the instance groups to delete. Use a single , as the separator between multiple names.
(string) --
string
Determines how instance provisioning is handled during cluster operations. In Continuous mode, the cluster provisions available instances incrementally and retries until the target count is reached. The cluster becomes operational once cluster-level resources are ready. Use CurrentCount and TargetCount in DescribeCluster to track provisioning progress.
string
The Amazon Resource Name (ARN) of the IAM role that HyperPod assumes for cluster autoscaling operations. Cannot be updated while autoscaling is enabled.
dict
Updates the autoscaling configuration for the cluster. Use to enable or disable automatic node scaling.
Mode (string) -- [REQUIRED]
Describes whether autoscaling is enabled or disabled for the cluster. Valid values are Enable and Disable.
AutoScalerType (string) --
The type of autoscaler to use. Currently supported value is Karpenter.
dict
The type of orchestrator used for the SageMaker HyperPod cluster.
Eks (dict) --
The Amazon EKS cluster used as the orchestrator for the SageMaker HyperPod cluster.
ClusterArn (string) -- [REQUIRED]
The Amazon Resource Name (ARN) of the Amazon EKS cluster associated with the SageMaker HyperPod cluster.
Slurm (dict) --
The Slurm orchestrator configuration for the SageMaker HyperPod cluster.
SlurmConfigStrategy (string) --
The strategy for managing partitions for the Slurm configuration. Valid values are Managed, Overwrite, and Merge.
dict
Response Syntax
{
'ClusterArn': 'string'
}
Response Structure
(dict) --
ClusterArn (string) --
The Amazon Resource Name (ARN) of the updated SageMaker HyperPod cluster.