2023/11/14 - Amazon EventBridge Pipes - 7 updated api methods
Changes Added support (via new LogConfiguration field in CreatePipe and UpdatePipe APIs) for logging to Amazon CloudWatch Logs, Amazon Simple Storage Service (Amazon S3), and Amazon Kinesis Data Firehose
{'LogConfiguration': {'CloudwatchLogsLogDestination': {'LogGroupArn': 'string'},
'FirehoseLogDestination': {'DeliveryStreamArn': 'string'},
'IncludeExecutionData': ['ALL'],
'Level': 'OFF | ERROR | INFO | TRACE',
'S3LogDestination': {'BucketName': 'string',
'BucketOwner': 'string',
'OutputFormat': 'json | plain | w3c',
'Prefix': 'string'}}}
Response {'CurrentState': {'CREATE_ROLLBACK_FAILED',
'DELETE_FAILED',
'DELETE_ROLLBACK_FAILED',
'UPDATE_ROLLBACK_FAILED'}}
Create a pipe. Amazon EventBridge Pipes connect event sources to targets and reduces the need for specialized knowledge and integration code.
See also: AWS API Documentation
Request Syntax
client.create_pipe(
Description='string',
DesiredState='RUNNING'|'STOPPED',
Enrichment='string',
EnrichmentParameters={
'HttpParameters': {
'HeaderParameters': {
'string': 'string'
},
'PathParameterValues': [
'string',
],
'QueryStringParameters': {
'string': 'string'
}
},
'InputTemplate': 'string'
},
LogConfiguration={
'CloudwatchLogsLogDestination': {
'LogGroupArn': 'string'
},
'FirehoseLogDestination': {
'DeliveryStreamArn': 'string'
},
'IncludeExecutionData': [
'ALL',
],
'Level': 'OFF'|'ERROR'|'INFO'|'TRACE',
'S3LogDestination': {
'BucketName': 'string',
'BucketOwner': 'string',
'OutputFormat': 'json'|'plain'|'w3c',
'Prefix': 'string'
}
},
Name='string',
RoleArn='string',
Source='string',
SourceParameters={
'ActiveMQBrokerParameters': {
'BatchSize': 123,
'Credentials': {
'BasicAuth': 'string'
},
'MaximumBatchingWindowInSeconds': 123,
'QueueName': 'string'
},
'DynamoDBStreamParameters': {
'BatchSize': 123,
'DeadLetterConfig': {
'Arn': 'string'
},
'MaximumBatchingWindowInSeconds': 123,
'MaximumRecordAgeInSeconds': 123,
'MaximumRetryAttempts': 123,
'OnPartialBatchItemFailure': 'AUTOMATIC_BISECT',
'ParallelizationFactor': 123,
'StartingPosition': 'TRIM_HORIZON'|'LATEST'
},
'FilterCriteria': {
'Filters': [
{
'Pattern': 'string'
},
]
},
'KinesisStreamParameters': {
'BatchSize': 123,
'DeadLetterConfig': {
'Arn': 'string'
},
'MaximumBatchingWindowInSeconds': 123,
'MaximumRecordAgeInSeconds': 123,
'MaximumRetryAttempts': 123,
'OnPartialBatchItemFailure': 'AUTOMATIC_BISECT',
'ParallelizationFactor': 123,
'StartingPosition': 'TRIM_HORIZON'|'LATEST'|'AT_TIMESTAMP',
'StartingPositionTimestamp': datetime(2015, 1, 1)
},
'ManagedStreamingKafkaParameters': {
'BatchSize': 123,
'ConsumerGroupID': 'string',
'Credentials': {
'ClientCertificateTlsAuth': 'string',
'SaslScram512Auth': 'string'
},
'MaximumBatchingWindowInSeconds': 123,
'StartingPosition': 'TRIM_HORIZON'|'LATEST',
'TopicName': 'string'
},
'RabbitMQBrokerParameters': {
'BatchSize': 123,
'Credentials': {
'BasicAuth': 'string'
},
'MaximumBatchingWindowInSeconds': 123,
'QueueName': 'string',
'VirtualHost': 'string'
},
'SelfManagedKafkaParameters': {
'AdditionalBootstrapServers': [
'string',
],
'BatchSize': 123,
'ConsumerGroupID': 'string',
'Credentials': {
'BasicAuth': 'string',
'ClientCertificateTlsAuth': 'string',
'SaslScram256Auth': 'string',
'SaslScram512Auth': 'string'
},
'MaximumBatchingWindowInSeconds': 123,
'ServerRootCaCertificate': 'string',
'StartingPosition': 'TRIM_HORIZON'|'LATEST',
'TopicName': 'string',
'Vpc': {
'SecurityGroup': [
'string',
],
'Subnets': [
'string',
]
}
},
'SqsQueueParameters': {
'BatchSize': 123,
'MaximumBatchingWindowInSeconds': 123
}
},
Tags={
'string': 'string'
},
Target='string',
TargetParameters={
'BatchJobParameters': {
'ArrayProperties': {
'Size': 123
},
'ContainerOverrides': {
'Command': [
'string',
],
'Environment': [
{
'Name': 'string',
'Value': 'string'
},
],
'InstanceType': 'string',
'ResourceRequirements': [
{
'Type': 'GPU'|'MEMORY'|'VCPU',
'Value': 'string'
},
]
},
'DependsOn': [
{
'JobId': 'string',
'Type': 'N_TO_N'|'SEQUENTIAL'
},
],
'JobDefinition': 'string',
'JobName': 'string',
'Parameters': {
'string': 'string'
},
'RetryStrategy': {
'Attempts': 123
}
},
'CloudWatchLogsParameters': {
'LogStreamName': 'string',
'Timestamp': 'string'
},
'EcsTaskParameters': {
'CapacityProviderStrategy': [
{
'base': 123,
'capacityProvider': 'string',
'weight': 123
},
],
'EnableECSManagedTags': True|False,
'EnableExecuteCommand': True|False,
'Group': 'string',
'LaunchType': 'EC2'|'FARGATE'|'EXTERNAL',
'NetworkConfiguration': {
'awsvpcConfiguration': {
'AssignPublicIp': 'ENABLED'|'DISABLED',
'SecurityGroups': [
'string',
],
'Subnets': [
'string',
]
}
},
'Overrides': {
'ContainerOverrides': [
{
'Command': [
'string',
],
'Cpu': 123,
'Environment': [
{
'name': 'string',
'value': 'string'
},
],
'EnvironmentFiles': [
{
'type': 's3',
'value': 'string'
},
],
'Memory': 123,
'MemoryReservation': 123,
'Name': 'string',
'ResourceRequirements': [
{
'type': 'GPU'|'InferenceAccelerator',
'value': 'string'
},
]
},
],
'Cpu': 'string',
'EphemeralStorage': {
'sizeInGiB': 123
},
'ExecutionRoleArn': 'string',
'InferenceAcceleratorOverrides': [
{
'deviceName': 'string',
'deviceType': 'string'
},
],
'Memory': 'string',
'TaskRoleArn': 'string'
},
'PlacementConstraints': [
{
'expression': 'string',
'type': 'distinctInstance'|'memberOf'
},
],
'PlacementStrategy': [
{
'field': 'string',
'type': 'random'|'spread'|'binpack'
},
],
'PlatformVersion': 'string',
'PropagateTags': 'TASK_DEFINITION',
'ReferenceId': 'string',
'Tags': [
{
'Key': 'string',
'Value': 'string'
},
],
'TaskCount': 123,
'TaskDefinitionArn': 'string'
},
'EventBridgeEventBusParameters': {
'DetailType': 'string',
'EndpointId': 'string',
'Resources': [
'string',
],
'Source': 'string',
'Time': 'string'
},
'HttpParameters': {
'HeaderParameters': {
'string': 'string'
},
'PathParameterValues': [
'string',
],
'QueryStringParameters': {
'string': 'string'
}
},
'InputTemplate': 'string',
'KinesisStreamParameters': {
'PartitionKey': 'string'
},
'LambdaFunctionParameters': {
'InvocationType': 'REQUEST_RESPONSE'|'FIRE_AND_FORGET'
},
'RedshiftDataParameters': {
'Database': 'string',
'DbUser': 'string',
'SecretManagerArn': 'string',
'Sqls': [
'string',
],
'StatementName': 'string',
'WithEvent': True|False
},
'SageMakerPipelineParameters': {
'PipelineParameterList': [
{
'Name': 'string',
'Value': 'string'
},
]
},
'SqsQueueParameters': {
'MessageDeduplicationId': 'string',
'MessageGroupId': 'string'
},
'StepFunctionStateMachineParameters': {
'InvocationType': 'REQUEST_RESPONSE'|'FIRE_AND_FORGET'
}
}
)
string
A description of the pipe.
string
The state the pipe should be in.
string
The ARN of the enrichment resource.
dict
The parameters required to set up enrichment on your pipe.
HttpParameters (dict) --
Contains the HTTP parameters to use when the target is a API Gateway REST endpoint or EventBridge ApiDestination.
If you specify an API Gateway REST API or EventBridge ApiDestination as a target, you can use this parameter to specify headers, path parameters, and query string keys/values as part of your target invoking request. If you're using ApiDestinations, the corresponding Connection can also have these values configured. In case of any conflicting keys, values from the Connection take precedence.
HeaderParameters (dict) --
The headers that need to be sent as part of request invoking the API Gateway REST API or EventBridge ApiDestination.
(string) --
(string) --
PathParameterValues (list) --
The path parameter values to be used to populate API Gateway REST API or EventBridge ApiDestination path wildcards ("*").
(string) --
QueryStringParameters (dict) --
The query string keys/values that need to be sent as part of request invoking the API Gateway REST API or EventBridge ApiDestination.
(string) --
(string) --
InputTemplate (string) --
Valid JSON text passed to the enrichment. In this case, nothing from the event itself is passed to the enrichment. For more information, see The JavaScript Object Notation (JSON) Data Interchange Format .
To remove an input template, specify an empty string.
dict
The logging configuration settings for the pipe.
CloudwatchLogsLogDestination (dict) --
The Amazon CloudWatch Logs logging configuration settings for the pipe.
LogGroupArn (string) -- [REQUIRED]
The Amazon Web Services Resource Name (ARN) for the CloudWatch log group to which EventBridge sends the log records.
FirehoseLogDestination (dict) --
The Amazon Kinesis Data Firehose logging configuration settings for the pipe.
DeliveryStreamArn (string) -- [REQUIRED]
Specifies the Amazon Resource Name (ARN) of the Kinesis Data Firehose delivery stream to which EventBridge delivers the pipe log records.
IncludeExecutionData (list) --
Specify ON to include the execution data (specifically, the payload and awsRequest fields) in the log messages for this pipe.
This applies to all log destinations for the pipe.
For more information, see Including execution data in logs in the Amazon EventBridge User Guide .
The default is OFF .
(string) --
Level (string) -- [REQUIRED]
The level of logging detail to include. This applies to all log destinations for the pipe.
For more information, see Specifying EventBridge Pipes log level in the Amazon EventBridge User Guide .
S3LogDestination (dict) --
The Amazon S3 logging configuration settings for the pipe.
BucketName (string) -- [REQUIRED]
Specifies the name of the Amazon S3 bucket to which EventBridge delivers the log records for the pipe.
BucketOwner (string) -- [REQUIRED]
Specifies the Amazon Web Services account that owns the Amazon S3 bucket to which EventBridge delivers the log records for the pipe.
OutputFormat (string) --
How EventBridge should format the log records.
json : JSON
plain : Plain text
Prefix (string) --
Specifies any prefix text with which to begin Amazon S3 log object names.
You can use prefixes to organize the data that you store in Amazon S3 buckets. A prefix is a string of characters at the beginning of the object key name. A prefix can be any length, subject to the maximum length of the object key name (1,024 bytes). For more information, see Organizing objects using prefixes in the Amazon Simple Storage Service User Guide .
string
[REQUIRED]
The name of the pipe.
string
[REQUIRED]
The ARN of the role that allows the pipe to send data to the target.
string
[REQUIRED]
The ARN of the source resource.
dict
The parameters required to set up a source for your pipe.
ActiveMQBrokerParameters (dict) --
The parameters for using an Active MQ broker as a source.
BatchSize (integer) --
The maximum number of records to include in each batch.
Credentials (dict) -- [REQUIRED]
The credentials needed to access the resource.
BasicAuth (string) --
The ARN of the Secrets Manager secret.
MaximumBatchingWindowInSeconds (integer) --
The maximum length of a time to wait for events.
QueueName (string) -- [REQUIRED]
The name of the destination queue to consume.
DynamoDBStreamParameters (dict) --
The parameters for using a DynamoDB stream as a source.
BatchSize (integer) --
The maximum number of records to include in each batch.
DeadLetterConfig (dict) --
Define the target queue to send dead-letter queue events to.
Arn (string) --
The ARN of the specified target for the dead-letter queue.
For Amazon Kinesis stream and Amazon DynamoDB stream sources, specify either an Amazon SNS topic or Amazon SQS queue ARN.
MaximumBatchingWindowInSeconds (integer) --
The maximum length of a time to wait for events.
MaximumRecordAgeInSeconds (integer) --
(Streams only) Discard records older than the specified age. The default value is -1, which sets the maximum age to infinite. When the value is set to infinite, EventBridge never discards old records.
MaximumRetryAttempts (integer) --
(Streams only) Discard records after the specified number of retries. The default value is -1, which sets the maximum number of retries to infinite. When MaximumRetryAttempts is infinite, EventBridge retries failed records until the record expires in the event source.
OnPartialBatchItemFailure (string) --
(Streams only) Define how to handle item process failures. AUTOMATIC_BISECT halves each batch and retry each half until all the records are processed or there is one failed message left in the batch.
ParallelizationFactor (integer) --
(Streams only) The number of batches to process concurrently from each shard. The default value is 1.
StartingPosition (string) -- [REQUIRED]
(Streams only) The position in a stream from which to start reading.
FilterCriteria (dict) --
The collection of event patterns used to filter events.
To remove a filter, specify a FilterCriteria object with an empty array of Filter objects.
For more information, see Events and Event Patterns in the Amazon EventBridge User Guide .
Filters (list) --
The event patterns.
(dict) --
Filter events using an event pattern. For more information, see Events and Event Patterns in the Amazon EventBridge User Guide .
Pattern (string) --
The event pattern.
KinesisStreamParameters (dict) --
The parameters for using a Kinesis stream as a source.
BatchSize (integer) --
The maximum number of records to include in each batch.
DeadLetterConfig (dict) --
Define the target queue to send dead-letter queue events to.
Arn (string) --
The ARN of the specified target for the dead-letter queue.
For Amazon Kinesis stream and Amazon DynamoDB stream sources, specify either an Amazon SNS topic or Amazon SQS queue ARN.
MaximumBatchingWindowInSeconds (integer) --
The maximum length of a time to wait for events.
MaximumRecordAgeInSeconds (integer) --
(Streams only) Discard records older than the specified age. The default value is -1, which sets the maximum age to infinite. When the value is set to infinite, EventBridge never discards old records.
MaximumRetryAttempts (integer) --
(Streams only) Discard records after the specified number of retries. The default value is -1, which sets the maximum number of retries to infinite. When MaximumRetryAttempts is infinite, EventBridge retries failed records until the record expires in the event source.
OnPartialBatchItemFailure (string) --
(Streams only) Define how to handle item process failures. AUTOMATIC_BISECT halves each batch and retry each half until all the records are processed or there is one failed message left in the batch.
ParallelizationFactor (integer) --
(Streams only) The number of batches to process concurrently from each shard. The default value is 1.
StartingPosition (string) -- [REQUIRED]
(Streams only) The position in a stream from which to start reading.
StartingPositionTimestamp (datetime) --
With StartingPosition set to AT_TIMESTAMP , the time from which to start reading, in Unix time seconds.
ManagedStreamingKafkaParameters (dict) --
The parameters for using an MSK stream as a source.
BatchSize (integer) --
The maximum number of records to include in each batch.
ConsumerGroupID (string) --
The name of the destination queue to consume.
Credentials (dict) --
The credentials needed to access the resource.
ClientCertificateTlsAuth (string) --
The ARN of the Secrets Manager secret.
SaslScram512Auth (string) --
The ARN of the Secrets Manager secret.
MaximumBatchingWindowInSeconds (integer) --
The maximum length of a time to wait for events.
StartingPosition (string) --
(Streams only) The position in a stream from which to start reading.
TopicName (string) -- [REQUIRED]
The name of the topic that the pipe will read from.
RabbitMQBrokerParameters (dict) --
The parameters for using a Rabbit MQ broker as a source.
BatchSize (integer) --
The maximum number of records to include in each batch.
Credentials (dict) -- [REQUIRED]
The credentials needed to access the resource.
BasicAuth (string) --
The ARN of the Secrets Manager secret.
MaximumBatchingWindowInSeconds (integer) --
The maximum length of a time to wait for events.
QueueName (string) -- [REQUIRED]
The name of the destination queue to consume.
VirtualHost (string) --
The name of the virtual host associated with the source broker.
SelfManagedKafkaParameters (dict) --
The parameters for using a self-managed Apache Kafka stream as a source.
AdditionalBootstrapServers (list) --
An array of server URLs.
(string) --
BatchSize (integer) --
The maximum number of records to include in each batch.
ConsumerGroupID (string) --
The name of the destination queue to consume.
Credentials (dict) --
The credentials needed to access the resource.
BasicAuth (string) --
The ARN of the Secrets Manager secret.
ClientCertificateTlsAuth (string) --
The ARN of the Secrets Manager secret.
SaslScram256Auth (string) --
The ARN of the Secrets Manager secret.
SaslScram512Auth (string) --
The ARN of the Secrets Manager secret.
MaximumBatchingWindowInSeconds (integer) --
The maximum length of a time to wait for events.
ServerRootCaCertificate (string) --
The ARN of the Secrets Manager secret used for certification.
StartingPosition (string) --
(Streams only) The position in a stream from which to start reading.
TopicName (string) -- [REQUIRED]
The name of the topic that the pipe will read from.
Vpc (dict) --
This structure specifies the VPC subnets and security groups for the stream, and whether a public IP address is to be used.
SecurityGroup (list) --
Specifies the security groups associated with the stream. These security groups must all be in the same VPC. You can specify as many as five security groups. If you do not specify a security group, the default security group for the VPC is used.
(string) --
Subnets (list) --
Specifies the subnets associated with the stream. These subnets must all be in the same VPC. You can specify as many as 16 subnets.
(string) --
SqsQueueParameters (dict) --
The parameters for using a Amazon SQS stream as a source.
BatchSize (integer) --
The maximum number of records to include in each batch.
MaximumBatchingWindowInSeconds (integer) --
The maximum length of a time to wait for events.
dict
The list of key-value pairs to associate with the pipe.
(string) --
(string) --
string
[REQUIRED]
The ARN of the target resource.
dict
The parameters required to set up a target for your pipe.
For more information about pipe target parameters, including how to use dynamic path parameters, see Target parameters in the Amazon EventBridge User Guide .
BatchJobParameters (dict) --
The parameters for using an Batch job as a target.
ArrayProperties (dict) --
The array properties for the submitted job, such as the size of the array. The array size can be between 2 and 10,000. If you specify array properties for a job, it becomes an array job. This parameter is used only if the target is an Batch job.
Size (integer) --
The size of the array, if this is an array batch job.
ContainerOverrides (dict) --
The overrides that are sent to a container.
Command (list) --
The command to send to the container that overrides the default command from the Docker image or the task definition.
(string) --
Environment (list) --
The environment variables to send to the container. You can add new environment variables, which are added to the container at launch, or you can override the existing environment variables from the Docker image or the task definition.
Note
Environment variables cannot start with "Batch ". This naming convention is reserved for variables that Batch sets.
(dict) --
The environment variables to send to the container. You can add new environment variables, which are added to the container at launch, or you can override the existing environment variables from the Docker image or the task definition.
Note
Environment variables cannot start with "Batch ". This naming convention is reserved for variables that Batch sets.
Name (string) --
The name of the key-value pair. For environment variables, this is the name of the environment variable.
Value (string) --
The value of the key-value pair. For environment variables, this is the value of the environment variable.
InstanceType (string) --
The instance type to use for a multi-node parallel job.
Note
This parameter isn't applicable to single-node container jobs or jobs that run on Fargate resources, and shouldn't be provided.
ResourceRequirements (list) --
The type and amount of resources to assign to a container. This overrides the settings in the job definition. The supported resources include GPU , MEMORY , and VCPU .
(dict) --
The type and amount of a resource to assign to a container. The supported resources include GPU , MEMORY , and VCPU .
Type (string) -- [REQUIRED]
The type of resource to assign to a container. The supported resources include GPU , MEMORY , and VCPU .
Value (string) -- [REQUIRED]
The quantity of the specified resource to reserve for the container. The values vary based on the type specified.
type="GPU"
The number of physical GPUs to reserve for the container. Make sure that the number of GPUs reserved for all containers in a job doesn't exceed the number of available GPUs on the compute resource that the job is launched on.
Note
GPUs aren't available for jobs that are running on Fargate resources.
type="MEMORY"
The memory hard limit (in MiB) present to the container. This parameter is supported for jobs that are running on EC2 resources. If your container attempts to exceed the memory specified, the container is terminated. This parameter maps to Memory in the Create a container section of the Docker Remote API and the --memory option to docker run . You must specify at least 4 MiB of memory for a job. This is required but can be specified in several places for multi-node parallel (MNP) jobs. It must be specified for each node at least once. This parameter maps to Memory in the Create a container section of the Docker Remote API and the --memory option to docker run .
Note
If you're trying to maximize your resource utilization by providing your jobs as much memory as possible for a particular instance type, see Memory management in the Batch User Guide .
For jobs that are running on Fargate resources, then value is the hard limit (in MiB), and must match one of the supported values and the VCPU values must be one of the values supported for that memory value.
value = 512
VCPU = 0.25
value = 1024
VCPU = 0.25 or 0.5
value = 2048
VCPU = 0.25, 0.5, or 1
value = 3072
VCPU = 0.5, or 1
value = 4096
VCPU = 0.5, 1, or 2
value = 5120, 6144, or 7168
VCPU = 1 or 2
value = 8192
VCPU = 1, 2, 4, or 8
value = 9216, 10240, 11264, 12288, 13312, 14336, or 15360
VCPU = 2 or 4
value = 16384
VCPU = 2, 4, or 8
value = 17408, 18432, 19456, 21504, 22528, 23552, 25600, 26624, 27648, 29696, or 30720
VCPU = 4
value = 20480, 24576, or 28672
VCPU = 4 or 8
value = 36864, 45056, 53248, or 61440
VCPU = 8
value = 32768, 40960, 49152, or 57344
VCPU = 8 or 16
value = 65536, 73728, 81920, 90112, 98304, 106496, 114688, or 122880
VCPU = 16
type="VCPU"
The number of vCPUs reserved for the container. This parameter maps to CpuShares in the Create a container section of the Docker Remote API and the --cpu-shares option to docker run . Each vCPU is equivalent to 1,024 CPU shares. For EC2 resources, you must specify at least one vCPU. This is required but can be specified in several places; it must be specified for each node at least once.
The default for the Fargate On-Demand vCPU resource count quota is 6 vCPUs. For more information about Fargate quotas, see Fargate quotas in the Amazon Web Services General Reference .
For jobs that are running on Fargate resources, then value must match one of the supported values and the MEMORY values must be one of the values supported for that VCPU value. The supported values are 0.25, 0.5, 1, 2, 4, 8, and 16
value = 0.25
MEMORY = 512, 1024, or 2048
value = 0.5
MEMORY = 1024, 2048, 3072, or 4096
value = 1
MEMORY = 2048, 3072, 4096, 5120, 6144, 7168, or 8192
value = 2
MEMORY = 4096, 5120, 6144, 7168, 8192, 9216, 10240, 11264, 12288, 13312, 14336, 15360, or 16384
value = 4
MEMORY = 8192, 9216, 10240, 11264, 12288, 13312, 14336, 15360, 16384, 17408, 18432, 19456, 20480, 21504, 22528, 23552, 24576, 25600, 26624, 27648, 28672, 29696, or 30720
value = 8
MEMORY = 16384, 20480, 24576, 28672, 32768, 36864, 40960, 45056, 49152, 53248, 57344, or 61440
value = 16
MEMORY = 32768, 40960, 49152, 57344, 65536, 73728, 81920, 90112, 98304, 106496, 114688, or 122880
DependsOn (list) --
A list of dependencies for the job. A job can depend upon a maximum of 20 jobs. You can specify a SEQUENTIAL type dependency without specifying a job ID for array jobs so that each child array job completes sequentially, starting at index 0. You can also specify an N_TO_N type dependency with a job ID for array jobs. In that case, each index child of this job must wait for the corresponding index child of each dependency to complete before it can begin.
(dict) --
An object that represents an Batch job dependency.
JobId (string) --
The job ID of the Batch job that's associated with this dependency.
Type (string) --
The type of the job dependency.
JobDefinition (string) -- [REQUIRED]
The job definition used by this job. This value can be one of name , name:revision , or the Amazon Resource Name (ARN) for the job definition. If name is specified without a revision then the latest active revision is used.
JobName (string) -- [REQUIRED]
The name of the job. It can be up to 128 letters long. The first character must be alphanumeric, can contain uppercase and lowercase letters, numbers, hyphens (-), and underscores (_).
Parameters (dict) --
Additional parameters passed to the job that replace parameter substitution placeholders that are set in the job definition. Parameters are specified as a key and value pair mapping. Parameters included here override any corresponding parameter defaults from the job definition.
(string) --
(string) --
RetryStrategy (dict) --
The retry strategy to use for failed jobs. When a retry strategy is specified here, it overrides the retry strategy defined in the job definition.
Attempts (integer) --
The number of times to move a job to the RUNNABLE status. If the value of attempts is greater than one, the job is retried on failure the same number of attempts as the value.
CloudWatchLogsParameters (dict) --
The parameters for using an CloudWatch Logs log stream as a target.
LogStreamName (string) --
The name of the log stream.
Timestamp (string) --
The time the event occurred, expressed as the number of milliseconds after Jan 1, 1970 00:00:00 UTC.
EcsTaskParameters (dict) --
The parameters for using an Amazon ECS task as a target.
CapacityProviderStrategy (list) --
The capacity provider strategy to use for the task.
If a capacityProviderStrategy is specified, the launchType parameter must be omitted. If no capacityProviderStrategy or launchType is specified, the defaultCapacityProviderStrategy for the cluster is used.
(dict) --
The details of a capacity provider strategy. To learn more, see CapacityProviderStrategyItem in the Amazon ECS API Reference.
base (integer) --
The base value designates how many tasks, at a minimum, to run on the specified capacity provider. Only one capacity provider in a capacity provider strategy can have a base defined. If no value is specified, the default value of 0 is used.
capacityProvider (string) -- [REQUIRED]
The short name of the capacity provider.
weight (integer) --
The weight value designates the relative percentage of the total number of tasks launched that should use the specified capacity provider. The weight value is taken into consideration after the base value, if defined, is satisfied.
EnableECSManagedTags (boolean) --
Specifies whether to enable Amazon ECS managed tags for the task. For more information, see Tagging Your Amazon ECS Resources in the Amazon Elastic Container Service Developer Guide.
EnableExecuteCommand (boolean) --
Whether or not to enable the execute command functionality for the containers in this task. If true, this enables execute command functionality on all containers in the task.
Group (string) --
Specifies an Amazon ECS task group for the task. The maximum length is 255 characters.
LaunchType (string) --
Specifies the launch type on which your task is running. The launch type that you specify here must match one of the launch type (compatibilities) of the target task. The FARGATE value is supported only in the Regions where Fargate with Amazon ECS is supported. For more information, see Fargate on Amazon ECS in the Amazon Elastic Container Service Developer Guide .
NetworkConfiguration (dict) --
Use this structure if the Amazon ECS task uses the awsvpc network mode. This structure specifies the VPC subnets and security groups associated with the task, and whether a public IP address is to be used. This structure is required if LaunchType is FARGATE because the awsvpc mode is required for Fargate tasks.
If you specify NetworkConfiguration when the target ECS task does not use the awsvpc network mode, the task fails.
awsvpcConfiguration (dict) --
Use this structure to specify the VPC subnets and security groups for the task, and whether a public IP address is to be used. This structure is relevant only for ECS tasks that use the awsvpc network mode.
AssignPublicIp (string) --
Specifies whether the task's elastic network interface receives a public IP address. You can specify ENABLED only when LaunchType in EcsParameters is set to FARGATE .
SecurityGroups (list) --
Specifies the security groups associated with the task. These security groups must all be in the same VPC. You can specify as many as five security groups. If you do not specify a security group, the default security group for the VPC is used.
(string) --
Subnets (list) -- [REQUIRED]
Specifies the subnets associated with the task. These subnets must all be in the same VPC. You can specify as many as 16 subnets.
(string) --
Overrides (dict) --
The overrides that are associated with a task.
ContainerOverrides (list) --
One or more container overrides that are sent to a task.
(dict) --
The overrides that are sent to a container. An empty container override can be passed in. An example of an empty container override is {"containerOverrides": [ ] } . If a non-empty container override is specified, the name parameter must be included.
Command (list) --
The command to send to the container that overrides the default command from the Docker image or the task definition. You must also specify a container name.
(string) --
Cpu (integer) --
The number of cpu units reserved for the container, instead of the default value from the task definition. You must also specify a container name.
Environment (list) --
The environment variables to send to the container. You can add new environment variables, which are added to the container at launch, or you can override the existing environment variables from the Docker image or the task definition. You must also specify a container name.
(dict) --
The environment variables to send to the container. You can add new environment variables, which are added to the container at launch, or you can override the existing environment variables from the Docker image or the task definition. You must also specify a container name.
name (string) --
The name of the key-value pair. For environment variables, this is the name of the environment variable.
value (string) --
The value of the key-value pair. For environment variables, this is the value of the environment variable.
EnvironmentFiles (list) --
A list of files containing the environment variables to pass to a container, instead of the value from the container definition.
(dict) --
A list of files containing the environment variables to pass to a container. You can specify up to ten environment files. The file must have a .env file extension. Each line in an environment file should contain an environment variable in VARIABLE=VALUE format. Lines beginning with # are treated as comments and are ignored. For more information about the environment variable file syntax, see Declare default environment variables in file .
If there are environment variables specified using the environment parameter in a container definition, they take precedence over the variables contained within an environment file. If multiple environment files are specified that contain the same variable, they're processed from the top down. We recommend that you use unique variable names. For more information, see Specifying environment variables in the Amazon Elastic Container Service Developer Guide .
This parameter is only supported for tasks hosted on Fargate using the following platform versions:
Linux platform version 1.4.0 or later.
Windows platform version 1.0.0 or later.
type (string) -- [REQUIRED]
The file type to use. The only supported value is s3 .
value (string) -- [REQUIRED]
The Amazon Resource Name (ARN) of the Amazon S3 object containing the environment variable file.
Memory (integer) --
The hard limit (in MiB) of memory to present to the container, instead of the default value from the task definition. If your container attempts to exceed the memory specified here, the container is killed. You must also specify a container name.
MemoryReservation (integer) --
The soft limit (in MiB) of memory to reserve for the container, instead of the default value from the task definition. You must also specify a container name.
Name (string) --
The name of the container that receives the override. This parameter is required if any override is specified.
ResourceRequirements (list) --
The type and amount of a resource to assign to a container, instead of the default value from the task definition. The only supported resource is a GPU.
(dict) --
The type and amount of a resource to assign to a container. The supported resource types are GPUs and Elastic Inference accelerators. For more information, see Working with GPUs on Amazon ECS or Working with Amazon Elastic Inference on Amazon ECS in the Amazon Elastic Container Service Developer Guide
type (string) -- [REQUIRED]
The type of resource to assign to a container. The supported values are GPU or InferenceAccelerator .
value (string) -- [REQUIRED]
The value for the specified resource type.
If the GPU type is used, the value is the number of physical GPUs the Amazon ECS container agent reserves for the container. The number of GPUs that's reserved for all containers in a task can't exceed the number of available GPUs on the container instance that the task is launched on.
If the InferenceAccelerator type is used, the value matches the deviceName for an InferenceAccelerator specified in a task definition.
Cpu (string) --
The cpu override for the task.
EphemeralStorage (dict) --
The ephemeral storage setting override for the task.
Note
This parameter is only supported for tasks hosted on Fargate that use the following platform versions:
Linux platform version 1.4.0 or later.
Windows platform version 1.0.0 or later.
sizeInGiB (integer) -- [REQUIRED]
The total amount, in GiB, of ephemeral storage to set for the task. The minimum supported value is 21 GiB and the maximum supported value is 200 GiB.
ExecutionRoleArn (string) --
The Amazon Resource Name (ARN) of the task execution IAM role override for the task. For more information, see Amazon ECS task execution IAM role in the Amazon Elastic Container Service Developer Guide .
InferenceAcceleratorOverrides (list) --
The Elastic Inference accelerator override for the task.
(dict) --
Details on an Elastic Inference accelerator task override. This parameter is used to override the Elastic Inference accelerator specified in the task definition. For more information, see Working with Amazon Elastic Inference on Amazon ECS in the Amazon Elastic Container Service Developer Guide .
deviceName (string) --
The Elastic Inference accelerator device name to override for the task. This parameter must match a deviceName specified in the task definition.
deviceType (string) --
The Elastic Inference accelerator type to use.
Memory (string) --
The memory override for the task.
TaskRoleArn (string) --
The Amazon Resource Name (ARN) of the IAM role that containers in this task can assume. All containers in this task are granted the permissions that are specified in this role. For more information, see IAM Role for Tasks in the Amazon Elastic Container Service Developer Guide .
PlacementConstraints (list) --
An array of placement constraint objects to use for the task. You can specify up to 10 constraints per task (including constraints in the task definition and those specified at runtime).
(dict) --
An object representing a constraint on task placement. To learn more, see Task Placement Constraints in the Amazon Elastic Container Service Developer Guide.
expression (string) --
A cluster query language expression to apply to the constraint. You cannot specify an expression if the constraint type is distinctInstance . To learn more, see Cluster Query Language in the Amazon Elastic Container Service Developer Guide.
type (string) --
The type of constraint. Use distinctInstance to ensure that each task in a particular group is running on a different container instance. Use memberOf to restrict the selection to a group of valid candidates.
PlacementStrategy (list) --
The placement strategy objects to use for the task. You can specify a maximum of five strategy rules per task.
(dict) --
The task placement strategy for a task or service. To learn more, see Task Placement Strategies in the Amazon Elastic Container Service Service Developer Guide.
field (string) --
The field to apply the placement strategy against. For the spread placement strategy, valid values are instanceId (or host, which has the same effect), or any platform or custom attribute that is applied to a container instance, such as attribute:ecs.availability-zone. For the binpack placement strategy, valid values are cpu and memory. For the random placement strategy, this field is not used.
type (string) --
The type of placement strategy. The random placement strategy randomly places tasks on available candidates. The spread placement strategy spreads placement across available candidates evenly based on the field parameter. The binpack strategy places tasks on available candidates that have the least available amount of the resource that is specified with the field parameter. For example, if you binpack on memory, a task is placed on the instance with the least amount of remaining memory (but still enough to run the task).
PlatformVersion (string) --
Specifies the platform version for the task. Specify only the numeric portion of the platform version, such as 1.1.0 .
This structure is used only if LaunchType is FARGATE . For more information about valid platform versions, see Fargate Platform Versions in the Amazon Elastic Container Service Developer Guide .
PropagateTags (string) --
Specifies whether to propagate the tags from the task definition to the task. If no value is specified, the tags are not propagated. Tags can only be propagated to the task during task creation. To add tags to a task after task creation, use the TagResource API action.
ReferenceId (string) --
The reference ID to use for the task.
Tags (list) --
The metadata that you apply to the task to help you categorize and organize them. Each tag consists of a key and an optional value, both of which you define. To learn more, see RunTask in the Amazon ECS API Reference.
(dict) --
A key-value pair associated with an Amazon Web Services resource. In EventBridge, rules and event buses support tagging.
Key (string) -- [REQUIRED]
A string you can use to assign a value. The combination of tag keys and values can help you organize and categorize your resources.
Value (string) -- [REQUIRED]
The value for the specified tag key.
TaskCount (integer) --
The number of tasks to create based on TaskDefinition . The default is 1.
TaskDefinitionArn (string) -- [REQUIRED]
The ARN of the task definition to use if the event target is an Amazon ECS task.
EventBridgeEventBusParameters (dict) --
The parameters for using an EventBridge event bus as a target.
DetailType (string) --
A free-form string, with a maximum of 128 characters, used to decide what fields to expect in the event detail.
EndpointId (string) --
The URL subdomain of the endpoint. For example, if the URL for Endpoint is https://abcde.veo.endpoints.event.amazonaws.com, then the EndpointId is abcde.veo .
Resources (list) --
Amazon Web Services resources, identified by Amazon Resource Name (ARN), which the event primarily concerns. Any number, including zero, may be present.
(string) --
Source (string) --
The source of the event.
Time (string) --
The time stamp of the event, per RFC3339 . If no time stamp is provided, the time stamp of the PutEvents call is used.
HttpParameters (dict) --
These are custom parameter to be used when the target is an API Gateway REST APIs or EventBridge ApiDestinations.
HeaderParameters (dict) --
The headers that need to be sent as part of request invoking the API Gateway REST API or EventBridge ApiDestination.
(string) --
(string) --
PathParameterValues (list) --
The path parameter values to be used to populate API Gateway REST API or EventBridge ApiDestination path wildcards ("*").
(string) --
QueryStringParameters (dict) --
The query string keys/values that need to be sent as part of request invoking the API Gateway REST API or EventBridge ApiDestination.
(string) --
(string) --
InputTemplate (string) --
Valid JSON text passed to the target. In this case, nothing from the event itself is passed to the target. For more information, see The JavaScript Object Notation (JSON) Data Interchange Format .
To remove an input template, specify an empty string.
KinesisStreamParameters (dict) --
The parameters for using a Kinesis stream as a target.
PartitionKey (string) -- [REQUIRED]
Determines which shard in the stream the data record is assigned to. Partition keys are Unicode strings with a maximum length limit of 256 characters for each key. Amazon Kinesis Data Streams uses the partition key as input to a hash function that maps the partition key and associated data to a specific shard. Specifically, an MD5 hash function is used to map partition keys to 128-bit integer values and to map associated data records to shards. As a result of this hashing mechanism, all data records with the same partition key map to the same shard within the stream.
LambdaFunctionParameters (dict) --
The parameters for using a Lambda function as a target.
InvocationType (string) --
Specify whether to invoke the function synchronously or asynchronously.
REQUEST_RESPONSE (default) - Invoke synchronously. This corresponds to the RequestResponse option in the InvocationType parameter for the Lambda Invoke API.
FIRE_AND_FORGET - Invoke asynchronously. This corresponds to the Event option in the InvocationType parameter for the Lambda Invoke API.
For more information, see Invocation types in the Amazon EventBridge User Guide .
RedshiftDataParameters (dict) --
These are custom parameters to be used when the target is a Amazon Redshift cluster to invoke the Amazon Redshift Data API BatchExecuteStatement.
Database (string) -- [REQUIRED]
The name of the database. Required when authenticating using temporary credentials.
DbUser (string) --
The database user name. Required when authenticating using temporary credentials.
SecretManagerArn (string) --
The name or ARN of the secret that enables access to the database. Required when authenticating using Secrets Manager.
Sqls (list) -- [REQUIRED]
The SQL statement text to run.
(string) --
// A single Redshift SQL
StatementName (string) --
The name of the SQL statement. You can name the SQL statement when you create it to identify the query.
WithEvent (boolean) --
Indicates whether to send an event back to EventBridge after the SQL statement runs.
SageMakerPipelineParameters (dict) --
The parameters for using a SageMaker pipeline as a target.
PipelineParameterList (list) --
List of Parameter names and values for SageMaker Model Building Pipeline execution.
(dict) --
Name/Value pair of a parameter to start execution of a SageMaker Model Building Pipeline.
Name (string) -- [REQUIRED]
Name of parameter to start execution of a SageMaker Model Building Pipeline.
Value (string) -- [REQUIRED]
Value of parameter to start execution of a SageMaker Model Building Pipeline.
SqsQueueParameters (dict) --
The parameters for using a Amazon SQS stream as a target.
MessageDeduplicationId (string) --
This parameter applies only to FIFO (first-in-first-out) queues.
The token used for deduplication of sent messages.
MessageGroupId (string) --
The FIFO message group ID to use as the target.
StepFunctionStateMachineParameters (dict) --
The parameters for using a Step Functions state machine as a target.
InvocationType (string) --
Specify whether to invoke the Step Functions state machine synchronously or asynchronously.
REQUEST_RESPONSE (default) - Invoke synchronously. For more information, see StartSyncExecution in the Step Functions API Reference .
Note
REQUEST_RESPONSE is not supported for STANDARD state machine workflows.
FIRE_AND_FORGET - Invoke asynchronously. For more information, see StartExecution in the Step Functions API Reference .
For more information, see Invocation types in the Amazon EventBridge User Guide .
dict
Response Syntax
{
'Arn': 'string',
'CreationTime': datetime(2015, 1, 1),
'CurrentState': 'RUNNING'|'STOPPED'|'CREATING'|'UPDATING'|'DELETING'|'STARTING'|'STOPPING'|'CREATE_FAILED'|'UPDATE_FAILED'|'START_FAILED'|'STOP_FAILED'|'DELETE_FAILED'|'CREATE_ROLLBACK_FAILED'|'DELETE_ROLLBACK_FAILED'|'UPDATE_ROLLBACK_FAILED',
'DesiredState': 'RUNNING'|'STOPPED',
'LastModifiedTime': datetime(2015, 1, 1),
'Name': 'string'
}
Response Structure
(dict) --
Arn (string) --
The ARN of the pipe.
CreationTime (datetime) --
The time the pipe was created.
CurrentState (string) --
The state the pipe is in.
DesiredState (string) --
The state the pipe should be in.
LastModifiedTime (datetime) --
When the pipe was last updated, in ISO-8601 format (YYYY-MM-DDThh:mm:ss.sTZD).
Name (string) --
The name of the pipe.
{'CurrentState': {'CREATE_ROLLBACK_FAILED',
'DELETE_FAILED',
'DELETE_ROLLBACK_FAILED',
'UPDATE_ROLLBACK_FAILED'}}
Delete an existing pipe. For more information about pipes, see Amazon EventBridge Pipes in the Amazon EventBridge User Guide.
See also: AWS API Documentation
Request Syntax
client.delete_pipe(
Name='string'
)
string
[REQUIRED]
The name of the pipe.
dict
Response Syntax
{
'Arn': 'string',
'CreationTime': datetime(2015, 1, 1),
'CurrentState': 'RUNNING'|'STOPPED'|'CREATING'|'UPDATING'|'DELETING'|'STARTING'|'STOPPING'|'CREATE_FAILED'|'UPDATE_FAILED'|'START_FAILED'|'STOP_FAILED'|'DELETE_FAILED'|'CREATE_ROLLBACK_FAILED'|'DELETE_ROLLBACK_FAILED'|'UPDATE_ROLLBACK_FAILED',
'DesiredState': 'RUNNING'|'STOPPED'|'DELETED',
'LastModifiedTime': datetime(2015, 1, 1),
'Name': 'string'
}
Response Structure
(dict) --
Arn (string) --
The ARN of the pipe.
CreationTime (datetime) --
The time the pipe was created.
CurrentState (string) --
The state the pipe is in.
DesiredState (string) --
The state the pipe should be in.
LastModifiedTime (datetime) --
When the pipe was last updated, in ISO-8601 format (YYYY-MM-DDThh:mm:ss.sTZD).
Name (string) --
The name of the pipe.
{'CurrentState': {'CREATE_ROLLBACK_FAILED',
'DELETE_FAILED',
'DELETE_ROLLBACK_FAILED',
'UPDATE_ROLLBACK_FAILED'},
'LogConfiguration': {'CloudwatchLogsLogDestination': {'LogGroupArn': 'string'},
'FirehoseLogDestination': {'DeliveryStreamArn': 'string'},
'IncludeExecutionData': ['ALL'],
'Level': 'OFF | ERROR | INFO | TRACE',
'S3LogDestination': {'BucketName': 'string',
'BucketOwner': 'string',
'OutputFormat': 'json | plain | w3c',
'Prefix': 'string'}}}
Get the information about an existing pipe. For more information about pipes, see Amazon EventBridge Pipes in the Amazon EventBridge User Guide.
See also: AWS API Documentation
Request Syntax
client.describe_pipe(
Name='string'
)
string
[REQUIRED]
The name of the pipe.
dict
Response Syntax
{
'Arn': 'string',
'CreationTime': datetime(2015, 1, 1),
'CurrentState': 'RUNNING'|'STOPPED'|'CREATING'|'UPDATING'|'DELETING'|'STARTING'|'STOPPING'|'CREATE_FAILED'|'UPDATE_FAILED'|'START_FAILED'|'STOP_FAILED'|'DELETE_FAILED'|'CREATE_ROLLBACK_FAILED'|'DELETE_ROLLBACK_FAILED'|'UPDATE_ROLLBACK_FAILED',
'Description': 'string',
'DesiredState': 'RUNNING'|'STOPPED'|'DELETED',
'Enrichment': 'string',
'EnrichmentParameters': {
'HttpParameters': {
'HeaderParameters': {
'string': 'string'
},
'PathParameterValues': [
'string',
],
'QueryStringParameters': {
'string': 'string'
}
},
'InputTemplate': 'string'
},
'LastModifiedTime': datetime(2015, 1, 1),
'LogConfiguration': {
'CloudwatchLogsLogDestination': {
'LogGroupArn': 'string'
},
'FirehoseLogDestination': {
'DeliveryStreamArn': 'string'
},
'IncludeExecutionData': [
'ALL',
],
'Level': 'OFF'|'ERROR'|'INFO'|'TRACE',
'S3LogDestination': {
'BucketName': 'string',
'BucketOwner': 'string',
'OutputFormat': 'json'|'plain'|'w3c',
'Prefix': 'string'
}
},
'Name': 'string',
'RoleArn': 'string',
'Source': 'string',
'SourceParameters': {
'ActiveMQBrokerParameters': {
'BatchSize': 123,
'Credentials': {
'BasicAuth': 'string'
},
'MaximumBatchingWindowInSeconds': 123,
'QueueName': 'string'
},
'DynamoDBStreamParameters': {
'BatchSize': 123,
'DeadLetterConfig': {
'Arn': 'string'
},
'MaximumBatchingWindowInSeconds': 123,
'MaximumRecordAgeInSeconds': 123,
'MaximumRetryAttempts': 123,
'OnPartialBatchItemFailure': 'AUTOMATIC_BISECT',
'ParallelizationFactor': 123,
'StartingPosition': 'TRIM_HORIZON'|'LATEST'
},
'FilterCriteria': {
'Filters': [
{
'Pattern': 'string'
},
]
},
'KinesisStreamParameters': {
'BatchSize': 123,
'DeadLetterConfig': {
'Arn': 'string'
},
'MaximumBatchingWindowInSeconds': 123,
'MaximumRecordAgeInSeconds': 123,
'MaximumRetryAttempts': 123,
'OnPartialBatchItemFailure': 'AUTOMATIC_BISECT',
'ParallelizationFactor': 123,
'StartingPosition': 'TRIM_HORIZON'|'LATEST'|'AT_TIMESTAMP',
'StartingPositionTimestamp': datetime(2015, 1, 1)
},
'ManagedStreamingKafkaParameters': {
'BatchSize': 123,
'ConsumerGroupID': 'string',
'Credentials': {
'ClientCertificateTlsAuth': 'string',
'SaslScram512Auth': 'string'
},
'MaximumBatchingWindowInSeconds': 123,
'StartingPosition': 'TRIM_HORIZON'|'LATEST',
'TopicName': 'string'
},
'RabbitMQBrokerParameters': {
'BatchSize': 123,
'Credentials': {
'BasicAuth': 'string'
},
'MaximumBatchingWindowInSeconds': 123,
'QueueName': 'string',
'VirtualHost': 'string'
},
'SelfManagedKafkaParameters': {
'AdditionalBootstrapServers': [
'string',
],
'BatchSize': 123,
'ConsumerGroupID': 'string',
'Credentials': {
'BasicAuth': 'string',
'ClientCertificateTlsAuth': 'string',
'SaslScram256Auth': 'string',
'SaslScram512Auth': 'string'
},
'MaximumBatchingWindowInSeconds': 123,
'ServerRootCaCertificate': 'string',
'StartingPosition': 'TRIM_HORIZON'|'LATEST',
'TopicName': 'string',
'Vpc': {
'SecurityGroup': [
'string',
],
'Subnets': [
'string',
]
}
},
'SqsQueueParameters': {
'BatchSize': 123,
'MaximumBatchingWindowInSeconds': 123
}
},
'StateReason': 'string',
'Tags': {
'string': 'string'
},
'Target': 'string',
'TargetParameters': {
'BatchJobParameters': {
'ArrayProperties': {
'Size': 123
},
'ContainerOverrides': {
'Command': [
'string',
],
'Environment': [
{
'Name': 'string',
'Value': 'string'
},
],
'InstanceType': 'string',
'ResourceRequirements': [
{
'Type': 'GPU'|'MEMORY'|'VCPU',
'Value': 'string'
},
]
},
'DependsOn': [
{
'JobId': 'string',
'Type': 'N_TO_N'|'SEQUENTIAL'
},
],
'JobDefinition': 'string',
'JobName': 'string',
'Parameters': {
'string': 'string'
},
'RetryStrategy': {
'Attempts': 123
}
},
'CloudWatchLogsParameters': {
'LogStreamName': 'string',
'Timestamp': 'string'
},
'EcsTaskParameters': {
'CapacityProviderStrategy': [
{
'base': 123,
'capacityProvider': 'string',
'weight': 123
},
],
'EnableECSManagedTags': True|False,
'EnableExecuteCommand': True|False,
'Group': 'string',
'LaunchType': 'EC2'|'FARGATE'|'EXTERNAL',
'NetworkConfiguration': {
'awsvpcConfiguration': {
'AssignPublicIp': 'ENABLED'|'DISABLED',
'SecurityGroups': [
'string',
],
'Subnets': [
'string',
]
}
},
'Overrides': {
'ContainerOverrides': [
{
'Command': [
'string',
],
'Cpu': 123,
'Environment': [
{
'name': 'string',
'value': 'string'
},
],
'EnvironmentFiles': [
{
'type': 's3',
'value': 'string'
},
],
'Memory': 123,
'MemoryReservation': 123,
'Name': 'string',
'ResourceRequirements': [
{
'type': 'GPU'|'InferenceAccelerator',
'value': 'string'
},
]
},
],
'Cpu': 'string',
'EphemeralStorage': {
'sizeInGiB': 123
},
'ExecutionRoleArn': 'string',
'InferenceAcceleratorOverrides': [
{
'deviceName': 'string',
'deviceType': 'string'
},
],
'Memory': 'string',
'TaskRoleArn': 'string'
},
'PlacementConstraints': [
{
'expression': 'string',
'type': 'distinctInstance'|'memberOf'
},
],
'PlacementStrategy': [
{
'field': 'string',
'type': 'random'|'spread'|'binpack'
},
],
'PlatformVersion': 'string',
'PropagateTags': 'TASK_DEFINITION',
'ReferenceId': 'string',
'Tags': [
{
'Key': 'string',
'Value': 'string'
},
],
'TaskCount': 123,
'TaskDefinitionArn': 'string'
},
'EventBridgeEventBusParameters': {
'DetailType': 'string',
'EndpointId': 'string',
'Resources': [
'string',
],
'Source': 'string',
'Time': 'string'
},
'HttpParameters': {
'HeaderParameters': {
'string': 'string'
},
'PathParameterValues': [
'string',
],
'QueryStringParameters': {
'string': 'string'
}
},
'InputTemplate': 'string',
'KinesisStreamParameters': {
'PartitionKey': 'string'
},
'LambdaFunctionParameters': {
'InvocationType': 'REQUEST_RESPONSE'|'FIRE_AND_FORGET'
},
'RedshiftDataParameters': {
'Database': 'string',
'DbUser': 'string',
'SecretManagerArn': 'string',
'Sqls': [
'string',
],
'StatementName': 'string',
'WithEvent': True|False
},
'SageMakerPipelineParameters': {
'PipelineParameterList': [
{
'Name': 'string',
'Value': 'string'
},
]
},
'SqsQueueParameters': {
'MessageDeduplicationId': 'string',
'MessageGroupId': 'string'
},
'StepFunctionStateMachineParameters': {
'InvocationType': 'REQUEST_RESPONSE'|'FIRE_AND_FORGET'
}
}
}
Response Structure
(dict) --
Arn (string) --
The ARN of the pipe.
CreationTime (datetime) --
The time the pipe was created.
CurrentState (string) --
The state the pipe is in.
Description (string) --
A description of the pipe.
DesiredState (string) --
The state the pipe should be in.
Enrichment (string) --
The ARN of the enrichment resource.
EnrichmentParameters (dict) --
The parameters required to set up enrichment on your pipe.
HttpParameters (dict) --
Contains the HTTP parameters to use when the target is a API Gateway REST endpoint or EventBridge ApiDestination.
If you specify an API Gateway REST API or EventBridge ApiDestination as a target, you can use this parameter to specify headers, path parameters, and query string keys/values as part of your target invoking request. If you're using ApiDestinations, the corresponding Connection can also have these values configured. In case of any conflicting keys, values from the Connection take precedence.
HeaderParameters (dict) --
The headers that need to be sent as part of request invoking the API Gateway REST API or EventBridge ApiDestination.
(string) --
(string) --
PathParameterValues (list) --
The path parameter values to be used to populate API Gateway REST API or EventBridge ApiDestination path wildcards ("*").
(string) --
QueryStringParameters (dict) --
The query string keys/values that need to be sent as part of request invoking the API Gateway REST API or EventBridge ApiDestination.
(string) --
(string) --
InputTemplate (string) --
Valid JSON text passed to the enrichment. In this case, nothing from the event itself is passed to the enrichment. For more information, see The JavaScript Object Notation (JSON) Data Interchange Format .
To remove an input template, specify an empty string.
LastModifiedTime (datetime) --
When the pipe was last updated, in ISO-8601 format (YYYY-MM-DDThh:mm:ss.sTZD).
LogConfiguration (dict) --
The logging configuration settings for the pipe.
CloudwatchLogsLogDestination (dict) --
The Amazon CloudWatch Logs logging configuration settings for the pipe.
LogGroupArn (string) --
The Amazon Web Services Resource Name (ARN) for the CloudWatch log group to which EventBridge sends the log records.
FirehoseLogDestination (dict) --
The Amazon Kinesis Data Firehose logging configuration settings for the pipe.
DeliveryStreamArn (string) --
The Amazon Resource Name (ARN) of the Kinesis Data Firehose delivery stream to which EventBridge delivers the pipe log records.
IncludeExecutionData (list) --
Whether the execution data (specifically, the payload , awsRequest , and awsResponse fields) is included in the log messages for this pipe.
This applies to all log destinations for the pipe.
For more information, see Including execution data in logs in the Amazon EventBridge User Guide .
(string) --
Level (string) --
The level of logging detail to include. This applies to all log destinations for the pipe.
S3LogDestination (dict) --
The Amazon S3 logging configuration settings for the pipe.
BucketName (string) --
The name of the Amazon S3 bucket to which EventBridge delivers the log records for the pipe.
BucketOwner (string) --
The Amazon Web Services account that owns the Amazon S3 bucket to which EventBridge delivers the log records for the pipe.
OutputFormat (string) --
The format EventBridge uses for the log records.
json : JSON
plain : Plain text
Prefix (string) --
The prefix text with which to begin Amazon S3 log object names.
For more information, see Organizing objects using prefixes in the Amazon Simple Storage Service User Guide .
Name (string) --
The name of the pipe.
RoleArn (string) --
The ARN of the role that allows the pipe to send data to the target.
Source (string) --
The ARN of the source resource.
SourceParameters (dict) --
The parameters required to set up a source for your pipe.
ActiveMQBrokerParameters (dict) --
The parameters for using an Active MQ broker as a source.
BatchSize (integer) --
The maximum number of records to include in each batch.
Credentials (dict) --
The credentials needed to access the resource.
BasicAuth (string) --
The ARN of the Secrets Manager secret.
MaximumBatchingWindowInSeconds (integer) --
The maximum length of a time to wait for events.
QueueName (string) --
The name of the destination queue to consume.
DynamoDBStreamParameters (dict) --
The parameters for using a DynamoDB stream as a source.
BatchSize (integer) --
The maximum number of records to include in each batch.
DeadLetterConfig (dict) --
Define the target queue to send dead-letter queue events to.
Arn (string) --
The ARN of the specified target for the dead-letter queue.
For Amazon Kinesis stream and Amazon DynamoDB stream sources, specify either an Amazon SNS topic or Amazon SQS queue ARN.
MaximumBatchingWindowInSeconds (integer) --
The maximum length of a time to wait for events.
MaximumRecordAgeInSeconds (integer) --
(Streams only) Discard records older than the specified age. The default value is -1, which sets the maximum age to infinite. When the value is set to infinite, EventBridge never discards old records.
MaximumRetryAttempts (integer) --
(Streams only) Discard records after the specified number of retries. The default value is -1, which sets the maximum number of retries to infinite. When MaximumRetryAttempts is infinite, EventBridge retries failed records until the record expires in the event source.
OnPartialBatchItemFailure (string) --
(Streams only) Define how to handle item process failures. AUTOMATIC_BISECT halves each batch and retry each half until all the records are processed or there is one failed message left in the batch.
ParallelizationFactor (integer) --
(Streams only) The number of batches to process concurrently from each shard. The default value is 1.
StartingPosition (string) --
(Streams only) The position in a stream from which to start reading.
FilterCriteria (dict) --
The collection of event patterns used to filter events.
To remove a filter, specify a FilterCriteria object with an empty array of Filter objects.
For more information, see Events and Event Patterns in the Amazon EventBridge User Guide .
Filters (list) --
The event patterns.
(dict) --
Filter events using an event pattern. For more information, see Events and Event Patterns in the Amazon EventBridge User Guide .
Pattern (string) --
The event pattern.
KinesisStreamParameters (dict) --
The parameters for using a Kinesis stream as a source.
BatchSize (integer) --
The maximum number of records to include in each batch.
DeadLetterConfig (dict) --
Define the target queue to send dead-letter queue events to.
Arn (string) --
The ARN of the specified target for the dead-letter queue.
For Amazon Kinesis stream and Amazon DynamoDB stream sources, specify either an Amazon SNS topic or Amazon SQS queue ARN.
MaximumBatchingWindowInSeconds (integer) --
The maximum length of a time to wait for events.
MaximumRecordAgeInSeconds (integer) --
(Streams only) Discard records older than the specified age. The default value is -1, which sets the maximum age to infinite. When the value is set to infinite, EventBridge never discards old records.
MaximumRetryAttempts (integer) --
(Streams only) Discard records after the specified number of retries. The default value is -1, which sets the maximum number of retries to infinite. When MaximumRetryAttempts is infinite, EventBridge retries failed records until the record expires in the event source.
OnPartialBatchItemFailure (string) --
(Streams only) Define how to handle item process failures. AUTOMATIC_BISECT halves each batch and retry each half until all the records are processed or there is one failed message left in the batch.
ParallelizationFactor (integer) --
(Streams only) The number of batches to process concurrently from each shard. The default value is 1.
StartingPosition (string) --
(Streams only) The position in a stream from which to start reading.
StartingPositionTimestamp (datetime) --
With StartingPosition set to AT_TIMESTAMP , the time from which to start reading, in Unix time seconds.
ManagedStreamingKafkaParameters (dict) --
The parameters for using an MSK stream as a source.
BatchSize (integer) --
The maximum number of records to include in each batch.
ConsumerGroupID (string) --
The name of the destination queue to consume.
Credentials (dict) --
The credentials needed to access the resource.
ClientCertificateTlsAuth (string) --
The ARN of the Secrets Manager secret.
SaslScram512Auth (string) --
The ARN of the Secrets Manager secret.
MaximumBatchingWindowInSeconds (integer) --
The maximum length of a time to wait for events.
StartingPosition (string) --
(Streams only) The position in a stream from which to start reading.
TopicName (string) --
The name of the topic that the pipe will read from.
RabbitMQBrokerParameters (dict) --
The parameters for using a Rabbit MQ broker as a source.
BatchSize (integer) --
The maximum number of records to include in each batch.
Credentials (dict) --
The credentials needed to access the resource.
BasicAuth (string) --
The ARN of the Secrets Manager secret.
MaximumBatchingWindowInSeconds (integer) --
The maximum length of a time to wait for events.
QueueName (string) --
The name of the destination queue to consume.
VirtualHost (string) --
The name of the virtual host associated with the source broker.
SelfManagedKafkaParameters (dict) --
The parameters for using a self-managed Apache Kafka stream as a source.
AdditionalBootstrapServers (list) --
An array of server URLs.
(string) --
BatchSize (integer) --
The maximum number of records to include in each batch.
ConsumerGroupID (string) --
The name of the destination queue to consume.
Credentials (dict) --
The credentials needed to access the resource.
BasicAuth (string) --
The ARN of the Secrets Manager secret.
ClientCertificateTlsAuth (string) --
The ARN of the Secrets Manager secret.
SaslScram256Auth (string) --
The ARN of the Secrets Manager secret.
SaslScram512Auth (string) --
The ARN of the Secrets Manager secret.
MaximumBatchingWindowInSeconds (integer) --
The maximum length of a time to wait for events.
ServerRootCaCertificate (string) --
The ARN of the Secrets Manager secret used for certification.
StartingPosition (string) --
(Streams only) The position in a stream from which to start reading.
TopicName (string) --
The name of the topic that the pipe will read from.
Vpc (dict) --
This structure specifies the VPC subnets and security groups for the stream, and whether a public IP address is to be used.
SecurityGroup (list) --
Specifies the security groups associated with the stream. These security groups must all be in the same VPC. You can specify as many as five security groups. If you do not specify a security group, the default security group for the VPC is used.
(string) --
Subnets (list) --
Specifies the subnets associated with the stream. These subnets must all be in the same VPC. You can specify as many as 16 subnets.
(string) --
SqsQueueParameters (dict) --
The parameters for using a Amazon SQS stream as a source.
BatchSize (integer) --
The maximum number of records to include in each batch.
MaximumBatchingWindowInSeconds (integer) --
The maximum length of a time to wait for events.
StateReason (string) --
The reason the pipe is in its current state.
Tags (dict) --
The list of key-value pairs to associate with the pipe.
(string) --
(string) --
Target (string) --
The ARN of the target resource.
TargetParameters (dict) --
The parameters required to set up a target for your pipe.
For more information about pipe target parameters, including how to use dynamic path parameters, see Target parameters in the Amazon EventBridge User Guide .
BatchJobParameters (dict) --
The parameters for using an Batch job as a target.
ArrayProperties (dict) --
The array properties for the submitted job, such as the size of the array. The array size can be between 2 and 10,000. If you specify array properties for a job, it becomes an array job. This parameter is used only if the target is an Batch job.
Size (integer) --
The size of the array, if this is an array batch job.
ContainerOverrides (dict) --
The overrides that are sent to a container.
Command (list) --
The command to send to the container that overrides the default command from the Docker image or the task definition.
(string) --
Environment (list) --
The environment variables to send to the container. You can add new environment variables, which are added to the container at launch, or you can override the existing environment variables from the Docker image or the task definition.
Note
Environment variables cannot start with "Batch ". This naming convention is reserved for variables that Batch sets.
(dict) --
The environment variables to send to the container. You can add new environment variables, which are added to the container at launch, or you can override the existing environment variables from the Docker image or the task definition.
Note
Environment variables cannot start with "Batch ". This naming convention is reserved for variables that Batch sets.
Name (string) --
The name of the key-value pair. For environment variables, this is the name of the environment variable.
Value (string) --
The value of the key-value pair. For environment variables, this is the value of the environment variable.
InstanceType (string) --
The instance type to use for a multi-node parallel job.
Note
This parameter isn't applicable to single-node container jobs or jobs that run on Fargate resources, and shouldn't be provided.
ResourceRequirements (list) --
The type and amount of resources to assign to a container. This overrides the settings in the job definition. The supported resources include GPU , MEMORY , and VCPU .
(dict) --
The type and amount of a resource to assign to a container. The supported resources include GPU , MEMORY , and VCPU .
Type (string) --
The type of resource to assign to a container. The supported resources include GPU , MEMORY , and VCPU .
Value (string) --
The quantity of the specified resource to reserve for the container. The values vary based on the type specified.
type="GPU"
The number of physical GPUs to reserve for the container. Make sure that the number of GPUs reserved for all containers in a job doesn't exceed the number of available GPUs on the compute resource that the job is launched on.
Note
GPUs aren't available for jobs that are running on Fargate resources.
type="MEMORY"
The memory hard limit (in MiB) present to the container. This parameter is supported for jobs that are running on EC2 resources. If your container attempts to exceed the memory specified, the container is terminated. This parameter maps to Memory in the Create a container section of the Docker Remote API and the --memory option to docker run . You must specify at least 4 MiB of memory for a job. This is required but can be specified in several places for multi-node parallel (MNP) jobs. It must be specified for each node at least once. This parameter maps to Memory in the Create a container section of the Docker Remote API and the --memory option to docker run .
Note
If you're trying to maximize your resource utilization by providing your jobs as much memory as possible for a particular instance type, see Memory management in the Batch User Guide .
For jobs that are running on Fargate resources, then value is the hard limit (in MiB), and must match one of the supported values and the VCPU values must be one of the values supported for that memory value.
value = 512
VCPU = 0.25
value = 1024
VCPU = 0.25 or 0.5
value = 2048
VCPU = 0.25, 0.5, or 1
value = 3072
VCPU = 0.5, or 1
value = 4096
VCPU = 0.5, 1, or 2
value = 5120, 6144, or 7168
VCPU = 1 or 2
value = 8192
VCPU = 1, 2, 4, or 8
value = 9216, 10240, 11264, 12288, 13312, 14336, or 15360
VCPU = 2 or 4
value = 16384
VCPU = 2, 4, or 8
value = 17408, 18432, 19456, 21504, 22528, 23552, 25600, 26624, 27648, 29696, or 30720
VCPU = 4
value = 20480, 24576, or 28672
VCPU = 4 or 8
value = 36864, 45056, 53248, or 61440
VCPU = 8
value = 32768, 40960, 49152, or 57344
VCPU = 8 or 16
value = 65536, 73728, 81920, 90112, 98304, 106496, 114688, or 122880
VCPU = 16
type="VCPU"
The number of vCPUs reserved for the container. This parameter maps to CpuShares in the Create a container section of the Docker Remote API and the --cpu-shares option to docker run . Each vCPU is equivalent to 1,024 CPU shares. For EC2 resources, you must specify at least one vCPU. This is required but can be specified in several places; it must be specified for each node at least once.
The default for the Fargate On-Demand vCPU resource count quota is 6 vCPUs. For more information about Fargate quotas, see Fargate quotas in the Amazon Web Services General Reference .
For jobs that are running on Fargate resources, then value must match one of the supported values and the MEMORY values must be one of the values supported for that VCPU value. The supported values are 0.25, 0.5, 1, 2, 4, 8, and 16
value = 0.25
MEMORY = 512, 1024, or 2048
value = 0.5
MEMORY = 1024, 2048, 3072, or 4096
value = 1
MEMORY = 2048, 3072, 4096, 5120, 6144, 7168, or 8192
value = 2
MEMORY = 4096, 5120, 6144, 7168, 8192, 9216, 10240, 11264, 12288, 13312, 14336, 15360, or 16384
value = 4
MEMORY = 8192, 9216, 10240, 11264, 12288, 13312, 14336, 15360, 16384, 17408, 18432, 19456, 20480, 21504, 22528, 23552, 24576, 25600, 26624, 27648, 28672, 29696, or 30720
value = 8
MEMORY = 16384, 20480, 24576, 28672, 32768, 36864, 40960, 45056, 49152, 53248, 57344, or 61440
value = 16
MEMORY = 32768, 40960, 49152, 57344, 65536, 73728, 81920, 90112, 98304, 106496, 114688, or 122880
DependsOn (list) --
A list of dependencies for the job. A job can depend upon a maximum of 20 jobs. You can specify a SEQUENTIAL type dependency without specifying a job ID for array jobs so that each child array job completes sequentially, starting at index 0. You can also specify an N_TO_N type dependency with a job ID for array jobs. In that case, each index child of this job must wait for the corresponding index child of each dependency to complete before it can begin.
(dict) --
An object that represents an Batch job dependency.
JobId (string) --
The job ID of the Batch job that's associated with this dependency.
Type (string) --
The type of the job dependency.
JobDefinition (string) --
The job definition used by this job. This value can be one of name , name:revision , or the Amazon Resource Name (ARN) for the job definition. If name is specified without a revision then the latest active revision is used.
JobName (string) --
The name of the job. It can be up to 128 letters long. The first character must be alphanumeric, can contain uppercase and lowercase letters, numbers, hyphens (-), and underscores (_).
Parameters (dict) --
Additional parameters passed to the job that replace parameter substitution placeholders that are set in the job definition. Parameters are specified as a key and value pair mapping. Parameters included here override any corresponding parameter defaults from the job definition.
(string) --
(string) --
RetryStrategy (dict) --
The retry strategy to use for failed jobs. When a retry strategy is specified here, it overrides the retry strategy defined in the job definition.
Attempts (integer) --
The number of times to move a job to the RUNNABLE status. If the value of attempts is greater than one, the job is retried on failure the same number of attempts as the value.
CloudWatchLogsParameters (dict) --
The parameters for using an CloudWatch Logs log stream as a target.
LogStreamName (string) --
The name of the log stream.
Timestamp (string) --
The time the event occurred, expressed as the number of milliseconds after Jan 1, 1970 00:00:00 UTC.
EcsTaskParameters (dict) --
The parameters for using an Amazon ECS task as a target.
CapacityProviderStrategy (list) --
The capacity provider strategy to use for the task.
If a capacityProviderStrategy is specified, the launchType parameter must be omitted. If no capacityProviderStrategy or launchType is specified, the defaultCapacityProviderStrategy for the cluster is used.
(dict) --
The details of a capacity provider strategy. To learn more, see CapacityProviderStrategyItem in the Amazon ECS API Reference.
base (integer) --
The base value designates how many tasks, at a minimum, to run on the specified capacity provider. Only one capacity provider in a capacity provider strategy can have a base defined. If no value is specified, the default value of 0 is used.
capacityProvider (string) --
The short name of the capacity provider.
weight (integer) --
The weight value designates the relative percentage of the total number of tasks launched that should use the specified capacity provider. The weight value is taken into consideration after the base value, if defined, is satisfied.
EnableECSManagedTags (boolean) --
Specifies whether to enable Amazon ECS managed tags for the task. For more information, see Tagging Your Amazon ECS Resources in the Amazon Elastic Container Service Developer Guide.
EnableExecuteCommand (boolean) --
Whether or not to enable the execute command functionality for the containers in this task. If true, this enables execute command functionality on all containers in the task.
Group (string) --
Specifies an Amazon ECS task group for the task. The maximum length is 255 characters.
LaunchType (string) --
Specifies the launch type on which your task is running. The launch type that you specify here must match one of the launch type (compatibilities) of the target task. The FARGATE value is supported only in the Regions where Fargate with Amazon ECS is supported. For more information, see Fargate on Amazon ECS in the Amazon Elastic Container Service Developer Guide .
NetworkConfiguration (dict) --
Use this structure if the Amazon ECS task uses the awsvpc network mode. This structure specifies the VPC subnets and security groups associated with the task, and whether a public IP address is to be used. This structure is required if LaunchType is FARGATE because the awsvpc mode is required for Fargate tasks.
If you specify NetworkConfiguration when the target ECS task does not use the awsvpc network mode, the task fails.
awsvpcConfiguration (dict) --
Use this structure to specify the VPC subnets and security groups for the task, and whether a public IP address is to be used. This structure is relevant only for ECS tasks that use the awsvpc network mode.
AssignPublicIp (string) --
Specifies whether the task's elastic network interface receives a public IP address. You can specify ENABLED only when LaunchType in EcsParameters is set to FARGATE .
SecurityGroups (list) --
Specifies the security groups associated with the task. These security groups must all be in the same VPC. You can specify as many as five security groups. If you do not specify a security group, the default security group for the VPC is used.
(string) --
Subnets (list) --
Specifies the subnets associated with the task. These subnets must all be in the same VPC. You can specify as many as 16 subnets.
(string) --
Overrides (dict) --
The overrides that are associated with a task.
ContainerOverrides (list) --
One or more container overrides that are sent to a task.
(dict) --
The overrides that are sent to a container. An empty container override can be passed in. An example of an empty container override is {"containerOverrides": [ ] } . If a non-empty container override is specified, the name parameter must be included.
Command (list) --
The command to send to the container that overrides the default command from the Docker image or the task definition. You must also specify a container name.
(string) --
Cpu (integer) --
The number of cpu units reserved for the container, instead of the default value from the task definition. You must also specify a container name.
Environment (list) --
The environment variables to send to the container. You can add new environment variables, which are added to the container at launch, or you can override the existing environment variables from the Docker image or the task definition. You must also specify a container name.
(dict) --
The environment variables to send to the container. You can add new environment variables, which are added to the container at launch, or you can override the existing environment variables from the Docker image or the task definition. You must also specify a container name.
name (string) --
The name of the key-value pair. For environment variables, this is the name of the environment variable.
value (string) --
The value of the key-value pair. For environment variables, this is the value of the environment variable.
EnvironmentFiles (list) --
A list of files containing the environment variables to pass to a container, instead of the value from the container definition.
(dict) --
A list of files containing the environment variables to pass to a container. You can specify up to ten environment files. The file must have a .env file extension. Each line in an environment file should contain an environment variable in VARIABLE=VALUE format. Lines beginning with # are treated as comments and are ignored. For more information about the environment variable file syntax, see Declare default environment variables in file .
If there are environment variables specified using the environment parameter in a container definition, they take precedence over the variables contained within an environment file. If multiple environment files are specified that contain the same variable, they're processed from the top down. We recommend that you use unique variable names. For more information, see Specifying environment variables in the Amazon Elastic Container Service Developer Guide .
This parameter is only supported for tasks hosted on Fargate using the following platform versions:
Linux platform version 1.4.0 or later.
Windows platform version 1.0.0 or later.
type (string) --
The file type to use. The only supported value is s3 .
value (string) --
The Amazon Resource Name (ARN) of the Amazon S3 object containing the environment variable file.
Memory (integer) --
The hard limit (in MiB) of memory to present to the container, instead of the default value from the task definition. If your container attempts to exceed the memory specified here, the container is killed. You must also specify a container name.
MemoryReservation (integer) --
The soft limit (in MiB) of memory to reserve for the container, instead of the default value from the task definition. You must also specify a container name.
Name (string) --
The name of the container that receives the override. This parameter is required if any override is specified.
ResourceRequirements (list) --
The type and amount of a resource to assign to a container, instead of the default value from the task definition. The only supported resource is a GPU.
(dict) --
The type and amount of a resource to assign to a container. The supported resource types are GPUs and Elastic Inference accelerators. For more information, see Working with GPUs on Amazon ECS or Working with Amazon Elastic Inference on Amazon ECS in the Amazon Elastic Container Service Developer Guide
type (string) --
The type of resource to assign to a container. The supported values are GPU or InferenceAccelerator .
value (string) --
The value for the specified resource type.
If the GPU type is used, the value is the number of physical GPUs the Amazon ECS container agent reserves for the container. The number of GPUs that's reserved for all containers in a task can't exceed the number of available GPUs on the container instance that the task is launched on.
If the InferenceAccelerator type is used, the value matches the deviceName for an InferenceAccelerator specified in a task definition.
Cpu (string) --
The cpu override for the task.
EphemeralStorage (dict) --
The ephemeral storage setting override for the task.
Note
This parameter is only supported for tasks hosted on Fargate that use the following platform versions:
Linux platform version 1.4.0 or later.
Windows platform version 1.0.0 or later.
sizeInGiB (integer) --
The total amount, in GiB, of ephemeral storage to set for the task. The minimum supported value is 21 GiB and the maximum supported value is 200 GiB.
ExecutionRoleArn (string) --
The Amazon Resource Name (ARN) of the task execution IAM role override for the task. For more information, see Amazon ECS task execution IAM role in the Amazon Elastic Container Service Developer Guide .
InferenceAcceleratorOverrides (list) --
The Elastic Inference accelerator override for the task.
(dict) --
Details on an Elastic Inference accelerator task override. This parameter is used to override the Elastic Inference accelerator specified in the task definition. For more information, see Working with Amazon Elastic Inference on Amazon ECS in the Amazon Elastic Container Service Developer Guide .
deviceName (string) --
The Elastic Inference accelerator device name to override for the task. This parameter must match a deviceName specified in the task definition.
deviceType (string) --
The Elastic Inference accelerator type to use.
Memory (string) --
The memory override for the task.
TaskRoleArn (string) --
The Amazon Resource Name (ARN) of the IAM role that containers in this task can assume. All containers in this task are granted the permissions that are specified in this role. For more information, see IAM Role for Tasks in the Amazon Elastic Container Service Developer Guide .
PlacementConstraints (list) --
An array of placement constraint objects to use for the task. You can specify up to 10 constraints per task (including constraints in the task definition and those specified at runtime).
(dict) --
An object representing a constraint on task placement. To learn more, see Task Placement Constraints in the Amazon Elastic Container Service Developer Guide.
expression (string) --
A cluster query language expression to apply to the constraint. You cannot specify an expression if the constraint type is distinctInstance . To learn more, see Cluster Query Language in the Amazon Elastic Container Service Developer Guide.
type (string) --
The type of constraint. Use distinctInstance to ensure that each task in a particular group is running on a different container instance. Use memberOf to restrict the selection to a group of valid candidates.
PlacementStrategy (list) --
The placement strategy objects to use for the task. You can specify a maximum of five strategy rules per task.
(dict) --
The task placement strategy for a task or service. To learn more, see Task Placement Strategies in the Amazon Elastic Container Service Service Developer Guide.
field (string) --
The field to apply the placement strategy against. For the spread placement strategy, valid values are instanceId (or host, which has the same effect), or any platform or custom attribute that is applied to a container instance, such as attribute:ecs.availability-zone. For the binpack placement strategy, valid values are cpu and memory. For the random placement strategy, this field is not used.
type (string) --
The type of placement strategy. The random placement strategy randomly places tasks on available candidates. The spread placement strategy spreads placement across available candidates evenly based on the field parameter. The binpack strategy places tasks on available candidates that have the least available amount of the resource that is specified with the field parameter. For example, if you binpack on memory, a task is placed on the instance with the least amount of remaining memory (but still enough to run the task).
PlatformVersion (string) --
Specifies the platform version for the task. Specify only the numeric portion of the platform version, such as 1.1.0 .
This structure is used only if LaunchType is FARGATE . For more information about valid platform versions, see Fargate Platform Versions in the Amazon Elastic Container Service Developer Guide .
PropagateTags (string) --
Specifies whether to propagate the tags from the task definition to the task. If no value is specified, the tags are not propagated. Tags can only be propagated to the task during task creation. To add tags to a task after task creation, use the TagResource API action.
ReferenceId (string) --
The reference ID to use for the task.
Tags (list) --
The metadata that you apply to the task to help you categorize and organize them. Each tag consists of a key and an optional value, both of which you define. To learn more, see RunTask in the Amazon ECS API Reference.
(dict) --
A key-value pair associated with an Amazon Web Services resource. In EventBridge, rules and event buses support tagging.
Key (string) --
A string you can use to assign a value. The combination of tag keys and values can help you organize and categorize your resources.
Value (string) --
The value for the specified tag key.
TaskCount (integer) --
The number of tasks to create based on TaskDefinition . The default is 1.
TaskDefinitionArn (string) --
The ARN of the task definition to use if the event target is an Amazon ECS task.
EventBridgeEventBusParameters (dict) --
The parameters for using an EventBridge event bus as a target.
DetailType (string) --
A free-form string, with a maximum of 128 characters, used to decide what fields to expect in the event detail.
EndpointId (string) --
The URL subdomain of the endpoint. For example, if the URL for Endpoint is https://abcde.veo.endpoints.event.amazonaws.com, then the EndpointId is abcde.veo .
Resources (list) --
Amazon Web Services resources, identified by Amazon Resource Name (ARN), which the event primarily concerns. Any number, including zero, may be present.
(string) --
Source (string) --
The source of the event.
Time (string) --
The time stamp of the event, per RFC3339 . If no time stamp is provided, the time stamp of the PutEvents call is used.
HttpParameters (dict) --
These are custom parameter to be used when the target is an API Gateway REST APIs or EventBridge ApiDestinations.
HeaderParameters (dict) --
The headers that need to be sent as part of request invoking the API Gateway REST API or EventBridge ApiDestination.
(string) --
(string) --
PathParameterValues (list) --
The path parameter values to be used to populate API Gateway REST API or EventBridge ApiDestination path wildcards ("*").
(string) --
QueryStringParameters (dict) --
The query string keys/values that need to be sent as part of request invoking the API Gateway REST API or EventBridge ApiDestination.
(string) --
(string) --
InputTemplate (string) --
Valid JSON text passed to the target. In this case, nothing from the event itself is passed to the target. For more information, see The JavaScript Object Notation (JSON) Data Interchange Format .
To remove an input template, specify an empty string.
KinesisStreamParameters (dict) --
The parameters for using a Kinesis stream as a target.
PartitionKey (string) --
Determines which shard in the stream the data record is assigned to. Partition keys are Unicode strings with a maximum length limit of 256 characters for each key. Amazon Kinesis Data Streams uses the partition key as input to a hash function that maps the partition key and associated data to a specific shard. Specifically, an MD5 hash function is used to map partition keys to 128-bit integer values and to map associated data records to shards. As a result of this hashing mechanism, all data records with the same partition key map to the same shard within the stream.
LambdaFunctionParameters (dict) --
The parameters for using a Lambda function as a target.
InvocationType (string) --
Specify whether to invoke the function synchronously or asynchronously.
REQUEST_RESPONSE (default) - Invoke synchronously. This corresponds to the RequestResponse option in the InvocationType parameter for the Lambda Invoke API.
FIRE_AND_FORGET - Invoke asynchronously. This corresponds to the Event option in the InvocationType parameter for the Lambda Invoke API.
For more information, see Invocation types in the Amazon EventBridge User Guide .
RedshiftDataParameters (dict) --
These are custom parameters to be used when the target is a Amazon Redshift cluster to invoke the Amazon Redshift Data API BatchExecuteStatement.
Database (string) --
The name of the database. Required when authenticating using temporary credentials.
DbUser (string) --
The database user name. Required when authenticating using temporary credentials.
SecretManagerArn (string) --
The name or ARN of the secret that enables access to the database. Required when authenticating using Secrets Manager.
Sqls (list) --
The SQL statement text to run.
(string) --
// A single Redshift SQL
StatementName (string) --
The name of the SQL statement. You can name the SQL statement when you create it to identify the query.
WithEvent (boolean) --
Indicates whether to send an event back to EventBridge after the SQL statement runs.
SageMakerPipelineParameters (dict) --
The parameters for using a SageMaker pipeline as a target.
PipelineParameterList (list) --
List of Parameter names and values for SageMaker Model Building Pipeline execution.
(dict) --
Name/Value pair of a parameter to start execution of a SageMaker Model Building Pipeline.
Name (string) --
Name of parameter to start execution of a SageMaker Model Building Pipeline.
Value (string) --
Value of parameter to start execution of a SageMaker Model Building Pipeline.
SqsQueueParameters (dict) --
The parameters for using a Amazon SQS stream as a target.
MessageDeduplicationId (string) --
This parameter applies only to FIFO (first-in-first-out) queues.
The token used for deduplication of sent messages.
MessageGroupId (string) --
The FIFO message group ID to use as the target.
StepFunctionStateMachineParameters (dict) --
The parameters for using a Step Functions state machine as a target.
InvocationType (string) --
Specify whether to invoke the Step Functions state machine synchronously or asynchronously.
REQUEST_RESPONSE (default) - Invoke synchronously. For more information, see StartSyncExecution in the Step Functions API Reference .
Note
REQUEST_RESPONSE is not supported for STANDARD state machine workflows.
FIRE_AND_FORGET - Invoke asynchronously. For more information, see StartExecution in the Step Functions API Reference .
For more information, see Invocation types in the Amazon EventBridge User Guide .
{'CurrentState': {'CREATE_ROLLBACK_FAILED',
'DELETE_FAILED',
'DELETE_ROLLBACK_FAILED',
'UPDATE_ROLLBACK_FAILED'}}
Response {'Pipes': {'CurrentState': {'CREATE_ROLLBACK_FAILED',
'DELETE_FAILED',
'DELETE_ROLLBACK_FAILED',
'UPDATE_ROLLBACK_FAILED'}}}
Get the pipes associated with this account. For more information about pipes, see Amazon EventBridge Pipes in the Amazon EventBridge User Guide.
See also: AWS API Documentation
Request Syntax
client.list_pipes(
CurrentState='RUNNING'|'STOPPED'|'CREATING'|'UPDATING'|'DELETING'|'STARTING'|'STOPPING'|'CREATE_FAILED'|'UPDATE_FAILED'|'START_FAILED'|'STOP_FAILED'|'DELETE_FAILED'|'CREATE_ROLLBACK_FAILED'|'DELETE_ROLLBACK_FAILED'|'UPDATE_ROLLBACK_FAILED',
DesiredState='RUNNING'|'STOPPED',
Limit=123,
NamePrefix='string',
NextToken='string',
SourcePrefix='string',
TargetPrefix='string'
)
string
The state the pipe is in.
string
The state the pipe should be in.
integer
The maximum number of pipes to include in the response.
string
A value that will return a subset of the pipes associated with this account. For example, "NamePrefix": "ABC" will return all endpoints with "ABC" in the name.
string
If nextToken is returned, there are more results available. The value of nextToken is a unique pagination token for each page. Make the call again using the returned token to retrieve the next page. Keep all other arguments unchanged. Each pagination token expires after 24 hours. Using an expired pagination token will return an HTTP 400 InvalidToken error.
string
The prefix matching the pipe source.
string
The prefix matching the pipe target.
dict
Response Syntax
{
'NextToken': 'string',
'Pipes': [
{
'Arn': 'string',
'CreationTime': datetime(2015, 1, 1),
'CurrentState': 'RUNNING'|'STOPPED'|'CREATING'|'UPDATING'|'DELETING'|'STARTING'|'STOPPING'|'CREATE_FAILED'|'UPDATE_FAILED'|'START_FAILED'|'STOP_FAILED'|'DELETE_FAILED'|'CREATE_ROLLBACK_FAILED'|'DELETE_ROLLBACK_FAILED'|'UPDATE_ROLLBACK_FAILED',
'DesiredState': 'RUNNING'|'STOPPED',
'Enrichment': 'string',
'LastModifiedTime': datetime(2015, 1, 1),
'Name': 'string',
'Source': 'string',
'StateReason': 'string',
'Target': 'string'
},
]
}
Response Structure
(dict) --
NextToken (string) --
If nextToken is returned, there are more results available. The value of nextToken is a unique pagination token for each page. Make the call again using the returned token to retrieve the next page. Keep all other arguments unchanged. Each pagination token expires after 24 hours. Using an expired pagination token will return an HTTP 400 InvalidToken error.
Pipes (list) --
The pipes returned by the call.
(dict) --
An object that represents a pipe. Amazon EventBridgePipes connect event sources to targets and reduces the need for specialized knowledge and integration code.
Arn (string) --
The ARN of the pipe.
CreationTime (datetime) --
The time the pipe was created.
CurrentState (string) --
The state the pipe is in.
DesiredState (string) --
The state the pipe should be in.
Enrichment (string) --
The ARN of the enrichment resource.
LastModifiedTime (datetime) --
When the pipe was last updated, in ISO-8601 format (YYYY-MM-DDThh:mm:ss.sTZD).
Name (string) --
The name of the pipe.
Source (string) --
The ARN of the source resource.
StateReason (string) --
The reason the pipe is in its current state.
Target (string) --
The ARN of the target resource.
{'CurrentState': {'CREATE_ROLLBACK_FAILED',
'DELETE_FAILED',
'DELETE_ROLLBACK_FAILED',
'UPDATE_ROLLBACK_FAILED'}}
Start an existing pipe.
See also: AWS API Documentation
Request Syntax
client.start_pipe(
Name='string'
)
string
[REQUIRED]
The name of the pipe.
dict
Response Syntax
{
'Arn': 'string',
'CreationTime': datetime(2015, 1, 1),
'CurrentState': 'RUNNING'|'STOPPED'|'CREATING'|'UPDATING'|'DELETING'|'STARTING'|'STOPPING'|'CREATE_FAILED'|'UPDATE_FAILED'|'START_FAILED'|'STOP_FAILED'|'DELETE_FAILED'|'CREATE_ROLLBACK_FAILED'|'DELETE_ROLLBACK_FAILED'|'UPDATE_ROLLBACK_FAILED',
'DesiredState': 'RUNNING'|'STOPPED',
'LastModifiedTime': datetime(2015, 1, 1),
'Name': 'string'
}
Response Structure
(dict) --
Arn (string) --
The ARN of the pipe.
CreationTime (datetime) --
The time the pipe was created.
CurrentState (string) --
The state the pipe is in.
DesiredState (string) --
The state the pipe should be in.
LastModifiedTime (datetime) --
When the pipe was last updated, in ISO-8601 format (YYYY-MM-DDThh:mm:ss.sTZD).
Name (string) --
The name of the pipe.
{'CurrentState': {'CREATE_ROLLBACK_FAILED',
'DELETE_FAILED',
'DELETE_ROLLBACK_FAILED',
'UPDATE_ROLLBACK_FAILED'}}
Stop an existing pipe.
See also: AWS API Documentation
Request Syntax
client.stop_pipe(
Name='string'
)
string
[REQUIRED]
The name of the pipe.
dict
Response Syntax
{
'Arn': 'string',
'CreationTime': datetime(2015, 1, 1),
'CurrentState': 'RUNNING'|'STOPPED'|'CREATING'|'UPDATING'|'DELETING'|'STARTING'|'STOPPING'|'CREATE_FAILED'|'UPDATE_FAILED'|'START_FAILED'|'STOP_FAILED'|'DELETE_FAILED'|'CREATE_ROLLBACK_FAILED'|'DELETE_ROLLBACK_FAILED'|'UPDATE_ROLLBACK_FAILED',
'DesiredState': 'RUNNING'|'STOPPED',
'LastModifiedTime': datetime(2015, 1, 1),
'Name': 'string'
}
Response Structure
(dict) --
Arn (string) --
The ARN of the pipe.
CreationTime (datetime) --
The time the pipe was created.
CurrentState (string) --
The state the pipe is in.
DesiredState (string) --
The state the pipe should be in.
LastModifiedTime (datetime) --
When the pipe was last updated, in ISO-8601 format (YYYY-MM-DDThh:mm:ss.sTZD).
Name (string) --
The name of the pipe.
{'LogConfiguration': {'CloudwatchLogsLogDestination': {'LogGroupArn': 'string'},
'FirehoseLogDestination': {'DeliveryStreamArn': 'string'},
'IncludeExecutionData': ['ALL'],
'Level': 'OFF | ERROR | INFO | TRACE',
'S3LogDestination': {'BucketName': 'string',
'BucketOwner': 'string',
'OutputFormat': 'json | plain | w3c',
'Prefix': 'string'}}}
Response {'CurrentState': {'CREATE_ROLLBACK_FAILED',
'DELETE_FAILED',
'DELETE_ROLLBACK_FAILED',
'UPDATE_ROLLBACK_FAILED'}}
Update an existing pipe. When you call UpdatePipe , EventBridge only the updates fields you have specified in the request; the rest remain unchanged. The exception to this is if you modify any Amazon Web Services-service specific fields in the SourceParameters , EnrichmentParameters , or TargetParameters objects. For example, DynamoDBStreamParameters or EventBridgeEventBusParameters . EventBridge updates the fields in these objects atomically as one and overrides existing values. This is by design, and means that if you don't specify an optional field in one of these Parameters objects, EventBridge sets that field to its system-default value during the update.
For more information about pipes, see Amazon EventBridge Pipes in the Amazon EventBridge User Guide.
See also: AWS API Documentation
Request Syntax
client.update_pipe(
Description='string',
DesiredState='RUNNING'|'STOPPED',
Enrichment='string',
EnrichmentParameters={
'HttpParameters': {
'HeaderParameters': {
'string': 'string'
},
'PathParameterValues': [
'string',
],
'QueryStringParameters': {
'string': 'string'
}
},
'InputTemplate': 'string'
},
LogConfiguration={
'CloudwatchLogsLogDestination': {
'LogGroupArn': 'string'
},
'FirehoseLogDestination': {
'DeliveryStreamArn': 'string'
},
'IncludeExecutionData': [
'ALL',
],
'Level': 'OFF'|'ERROR'|'INFO'|'TRACE',
'S3LogDestination': {
'BucketName': 'string',
'BucketOwner': 'string',
'OutputFormat': 'json'|'plain'|'w3c',
'Prefix': 'string'
}
},
Name='string',
RoleArn='string',
SourceParameters={
'ActiveMQBrokerParameters': {
'BatchSize': 123,
'Credentials': {
'BasicAuth': 'string'
},
'MaximumBatchingWindowInSeconds': 123
},
'DynamoDBStreamParameters': {
'BatchSize': 123,
'DeadLetterConfig': {
'Arn': 'string'
},
'MaximumBatchingWindowInSeconds': 123,
'MaximumRecordAgeInSeconds': 123,
'MaximumRetryAttempts': 123,
'OnPartialBatchItemFailure': 'AUTOMATIC_BISECT',
'ParallelizationFactor': 123
},
'FilterCriteria': {
'Filters': [
{
'Pattern': 'string'
},
]
},
'KinesisStreamParameters': {
'BatchSize': 123,
'DeadLetterConfig': {
'Arn': 'string'
},
'MaximumBatchingWindowInSeconds': 123,
'MaximumRecordAgeInSeconds': 123,
'MaximumRetryAttempts': 123,
'OnPartialBatchItemFailure': 'AUTOMATIC_BISECT',
'ParallelizationFactor': 123
},
'ManagedStreamingKafkaParameters': {
'BatchSize': 123,
'Credentials': {
'ClientCertificateTlsAuth': 'string',
'SaslScram512Auth': 'string'
},
'MaximumBatchingWindowInSeconds': 123
},
'RabbitMQBrokerParameters': {
'BatchSize': 123,
'Credentials': {
'BasicAuth': 'string'
},
'MaximumBatchingWindowInSeconds': 123
},
'SelfManagedKafkaParameters': {
'BatchSize': 123,
'Credentials': {
'BasicAuth': 'string',
'ClientCertificateTlsAuth': 'string',
'SaslScram256Auth': 'string',
'SaslScram512Auth': 'string'
},
'MaximumBatchingWindowInSeconds': 123,
'ServerRootCaCertificate': 'string',
'Vpc': {
'SecurityGroup': [
'string',
],
'Subnets': [
'string',
]
}
},
'SqsQueueParameters': {
'BatchSize': 123,
'MaximumBatchingWindowInSeconds': 123
}
},
Target='string',
TargetParameters={
'BatchJobParameters': {
'ArrayProperties': {
'Size': 123
},
'ContainerOverrides': {
'Command': [
'string',
],
'Environment': [
{
'Name': 'string',
'Value': 'string'
},
],
'InstanceType': 'string',
'ResourceRequirements': [
{
'Type': 'GPU'|'MEMORY'|'VCPU',
'Value': 'string'
},
]
},
'DependsOn': [
{
'JobId': 'string',
'Type': 'N_TO_N'|'SEQUENTIAL'
},
],
'JobDefinition': 'string',
'JobName': 'string',
'Parameters': {
'string': 'string'
},
'RetryStrategy': {
'Attempts': 123
}
},
'CloudWatchLogsParameters': {
'LogStreamName': 'string',
'Timestamp': 'string'
},
'EcsTaskParameters': {
'CapacityProviderStrategy': [
{
'base': 123,
'capacityProvider': 'string',
'weight': 123
},
],
'EnableECSManagedTags': True|False,
'EnableExecuteCommand': True|False,
'Group': 'string',
'LaunchType': 'EC2'|'FARGATE'|'EXTERNAL',
'NetworkConfiguration': {
'awsvpcConfiguration': {
'AssignPublicIp': 'ENABLED'|'DISABLED',
'SecurityGroups': [
'string',
],
'Subnets': [
'string',
]
}
},
'Overrides': {
'ContainerOverrides': [
{
'Command': [
'string',
],
'Cpu': 123,
'Environment': [
{
'name': 'string',
'value': 'string'
},
],
'EnvironmentFiles': [
{
'type': 's3',
'value': 'string'
},
],
'Memory': 123,
'MemoryReservation': 123,
'Name': 'string',
'ResourceRequirements': [
{
'type': 'GPU'|'InferenceAccelerator',
'value': 'string'
},
]
},
],
'Cpu': 'string',
'EphemeralStorage': {
'sizeInGiB': 123
},
'ExecutionRoleArn': 'string',
'InferenceAcceleratorOverrides': [
{
'deviceName': 'string',
'deviceType': 'string'
},
],
'Memory': 'string',
'TaskRoleArn': 'string'
},
'PlacementConstraints': [
{
'expression': 'string',
'type': 'distinctInstance'|'memberOf'
},
],
'PlacementStrategy': [
{
'field': 'string',
'type': 'random'|'spread'|'binpack'
},
],
'PlatformVersion': 'string',
'PropagateTags': 'TASK_DEFINITION',
'ReferenceId': 'string',
'Tags': [
{
'Key': 'string',
'Value': 'string'
},
],
'TaskCount': 123,
'TaskDefinitionArn': 'string'
},
'EventBridgeEventBusParameters': {
'DetailType': 'string',
'EndpointId': 'string',
'Resources': [
'string',
],
'Source': 'string',
'Time': 'string'
},
'HttpParameters': {
'HeaderParameters': {
'string': 'string'
},
'PathParameterValues': [
'string',
],
'QueryStringParameters': {
'string': 'string'
}
},
'InputTemplate': 'string',
'KinesisStreamParameters': {
'PartitionKey': 'string'
},
'LambdaFunctionParameters': {
'InvocationType': 'REQUEST_RESPONSE'|'FIRE_AND_FORGET'
},
'RedshiftDataParameters': {
'Database': 'string',
'DbUser': 'string',
'SecretManagerArn': 'string',
'Sqls': [
'string',
],
'StatementName': 'string',
'WithEvent': True|False
},
'SageMakerPipelineParameters': {
'PipelineParameterList': [
{
'Name': 'string',
'Value': 'string'
},
]
},
'SqsQueueParameters': {
'MessageDeduplicationId': 'string',
'MessageGroupId': 'string'
},
'StepFunctionStateMachineParameters': {
'InvocationType': 'REQUEST_RESPONSE'|'FIRE_AND_FORGET'
}
}
)
string
A description of the pipe.
string
The state the pipe should be in.
string
The ARN of the enrichment resource.
dict
The parameters required to set up enrichment on your pipe.
HttpParameters (dict) --
Contains the HTTP parameters to use when the target is a API Gateway REST endpoint or EventBridge ApiDestination.
If you specify an API Gateway REST API or EventBridge ApiDestination as a target, you can use this parameter to specify headers, path parameters, and query string keys/values as part of your target invoking request. If you're using ApiDestinations, the corresponding Connection can also have these values configured. In case of any conflicting keys, values from the Connection take precedence.
HeaderParameters (dict) --
The headers that need to be sent as part of request invoking the API Gateway REST API or EventBridge ApiDestination.
(string) --
(string) --
PathParameterValues (list) --
The path parameter values to be used to populate API Gateway REST API or EventBridge ApiDestination path wildcards ("*").
(string) --
QueryStringParameters (dict) --
The query string keys/values that need to be sent as part of request invoking the API Gateway REST API or EventBridge ApiDestination.
(string) --
(string) --
InputTemplate (string) --
Valid JSON text passed to the enrichment. In this case, nothing from the event itself is passed to the enrichment. For more information, see The JavaScript Object Notation (JSON) Data Interchange Format .
To remove an input template, specify an empty string.
dict
The logging configuration settings for the pipe.
CloudwatchLogsLogDestination (dict) --
The Amazon CloudWatch Logs logging configuration settings for the pipe.
LogGroupArn (string) -- [REQUIRED]
The Amazon Web Services Resource Name (ARN) for the CloudWatch log group to which EventBridge sends the log records.
FirehoseLogDestination (dict) --
The Amazon Kinesis Data Firehose logging configuration settings for the pipe.
DeliveryStreamArn (string) -- [REQUIRED]
Specifies the Amazon Resource Name (ARN) of the Kinesis Data Firehose delivery stream to which EventBridge delivers the pipe log records.
IncludeExecutionData (list) --
Specify ON to include the execution data (specifically, the payload and awsRequest fields) in the log messages for this pipe.
This applies to all log destinations for the pipe.
For more information, see Including execution data in logs in the Amazon EventBridge User Guide .
The default is OFF .
(string) --
Level (string) -- [REQUIRED]
The level of logging detail to include. This applies to all log destinations for the pipe.
For more information, see Specifying EventBridge Pipes log level in the Amazon EventBridge User Guide .
S3LogDestination (dict) --
The Amazon S3 logging configuration settings for the pipe.
BucketName (string) -- [REQUIRED]
Specifies the name of the Amazon S3 bucket to which EventBridge delivers the log records for the pipe.
BucketOwner (string) -- [REQUIRED]
Specifies the Amazon Web Services account that owns the Amazon S3 bucket to which EventBridge delivers the log records for the pipe.
OutputFormat (string) --
How EventBridge should format the log records.
json : JSON
plain : Plain text
Prefix (string) --
Specifies any prefix text with which to begin Amazon S3 log object names.
You can use prefixes to organize the data that you store in Amazon S3 buckets. A prefix is a string of characters at the beginning of the object key name. A prefix can be any length, subject to the maximum length of the object key name (1,024 bytes). For more information, see Organizing objects using prefixes in the Amazon Simple Storage Service User Guide .
string
[REQUIRED]
The name of the pipe.
string
[REQUIRED]
The ARN of the role that allows the pipe to send data to the target.
dict
The parameters required to set up a source for your pipe.
ActiveMQBrokerParameters (dict) --
The parameters for using an Active MQ broker as a source.
BatchSize (integer) --
The maximum number of records to include in each batch.
Credentials (dict) -- [REQUIRED]
The credentials needed to access the resource.
BasicAuth (string) --
The ARN of the Secrets Manager secret.
MaximumBatchingWindowInSeconds (integer) --
The maximum length of a time to wait for events.
DynamoDBStreamParameters (dict) --
The parameters for using a DynamoDB stream as a source.
BatchSize (integer) --
The maximum number of records to include in each batch.
DeadLetterConfig (dict) --
Define the target queue to send dead-letter queue events to.
Arn (string) --
The ARN of the specified target for the dead-letter queue.
For Amazon Kinesis stream and Amazon DynamoDB stream sources, specify either an Amazon SNS topic or Amazon SQS queue ARN.
MaximumBatchingWindowInSeconds (integer) --
The maximum length of a time to wait for events.
MaximumRecordAgeInSeconds (integer) --
(Streams only) Discard records older than the specified age. The default value is -1, which sets the maximum age to infinite. When the value is set to infinite, EventBridge never discards old records.
MaximumRetryAttempts (integer) --
(Streams only) Discard records after the specified number of retries. The default value is -1, which sets the maximum number of retries to infinite. When MaximumRetryAttempts is infinite, EventBridge retries failed records until the record expires in the event source.
OnPartialBatchItemFailure (string) --
(Streams only) Define how to handle item process failures. AUTOMATIC_BISECT halves each batch and retry each half until all the records are processed or there is one failed message left in the batch.
ParallelizationFactor (integer) --
(Streams only) The number of batches to process concurrently from each shard. The default value is 1.
FilterCriteria (dict) --
The collection of event patterns used to filter events.
To remove a filter, specify a FilterCriteria object with an empty array of Filter objects.
For more information, see Events and Event Patterns in the Amazon EventBridge User Guide .
Filters (list) --
The event patterns.
(dict) --
Filter events using an event pattern. For more information, see Events and Event Patterns in the Amazon EventBridge User Guide .
Pattern (string) --
The event pattern.
KinesisStreamParameters (dict) --
The parameters for using a Kinesis stream as a source.
BatchSize (integer) --
The maximum number of records to include in each batch.
DeadLetterConfig (dict) --
Define the target queue to send dead-letter queue events to.
Arn (string) --
The ARN of the specified target for the dead-letter queue.
For Amazon Kinesis stream and Amazon DynamoDB stream sources, specify either an Amazon SNS topic or Amazon SQS queue ARN.
MaximumBatchingWindowInSeconds (integer) --
The maximum length of a time to wait for events.
MaximumRecordAgeInSeconds (integer) --
(Streams only) Discard records older than the specified age. The default value is -1, which sets the maximum age to infinite. When the value is set to infinite, EventBridge never discards old records.
MaximumRetryAttempts (integer) --
(Streams only) Discard records after the specified number of retries. The default value is -1, which sets the maximum number of retries to infinite. When MaximumRetryAttempts is infinite, EventBridge retries failed records until the record expires in the event source.
OnPartialBatchItemFailure (string) --
(Streams only) Define how to handle item process failures. AUTOMATIC_BISECT halves each batch and retry each half until all the records are processed or there is one failed message left in the batch.
ParallelizationFactor (integer) --
(Streams only) The number of batches to process concurrently from each shard. The default value is 1.
ManagedStreamingKafkaParameters (dict) --
The parameters for using an MSK stream as a source.
BatchSize (integer) --
The maximum number of records to include in each batch.
Credentials (dict) --
The credentials needed to access the resource.
ClientCertificateTlsAuth (string) --
The ARN of the Secrets Manager secret.
SaslScram512Auth (string) --
The ARN of the Secrets Manager secret.
MaximumBatchingWindowInSeconds (integer) --
The maximum length of a time to wait for events.
RabbitMQBrokerParameters (dict) --
The parameters for using a Rabbit MQ broker as a source.
BatchSize (integer) --
The maximum number of records to include in each batch.
Credentials (dict) -- [REQUIRED]
The credentials needed to access the resource.
BasicAuth (string) --
The ARN of the Secrets Manager secret.
MaximumBatchingWindowInSeconds (integer) --
The maximum length of a time to wait for events.
SelfManagedKafkaParameters (dict) --
The parameters for using a self-managed Apache Kafka stream as a source.
BatchSize (integer) --
The maximum number of records to include in each batch.
Credentials (dict) --
The credentials needed to access the resource.
BasicAuth (string) --
The ARN of the Secrets Manager secret.
ClientCertificateTlsAuth (string) --
The ARN of the Secrets Manager secret.
SaslScram256Auth (string) --
The ARN of the Secrets Manager secret.
SaslScram512Auth (string) --
The ARN of the Secrets Manager secret.
MaximumBatchingWindowInSeconds (integer) --
The maximum length of a time to wait for events.
ServerRootCaCertificate (string) --
The ARN of the Secrets Manager secret used for certification.
Vpc (dict) --
This structure specifies the VPC subnets and security groups for the stream, and whether a public IP address is to be used.
SecurityGroup (list) --
Specifies the security groups associated with the stream. These security groups must all be in the same VPC. You can specify as many as five security groups. If you do not specify a security group, the default security group for the VPC is used.
(string) --
Subnets (list) --
Specifies the subnets associated with the stream. These subnets must all be in the same VPC. You can specify as many as 16 subnets.
(string) --
SqsQueueParameters (dict) --
The parameters for using a Amazon SQS stream as a source.
BatchSize (integer) --
The maximum number of records to include in each batch.
MaximumBatchingWindowInSeconds (integer) --
The maximum length of a time to wait for events.
string
The ARN of the target resource.
dict
The parameters required to set up a target for your pipe.
For more information about pipe target parameters, including how to use dynamic path parameters, see Target parameters in the Amazon EventBridge User Guide .
BatchJobParameters (dict) --
The parameters for using an Batch job as a target.
ArrayProperties (dict) --
The array properties for the submitted job, such as the size of the array. The array size can be between 2 and 10,000. If you specify array properties for a job, it becomes an array job. This parameter is used only if the target is an Batch job.
Size (integer) --
The size of the array, if this is an array batch job.
ContainerOverrides (dict) --
The overrides that are sent to a container.
Command (list) --
The command to send to the container that overrides the default command from the Docker image or the task definition.
(string) --
Environment (list) --
The environment variables to send to the container. You can add new environment variables, which are added to the container at launch, or you can override the existing environment variables from the Docker image or the task definition.
Note
Environment variables cannot start with "Batch ". This naming convention is reserved for variables that Batch sets.
(dict) --
The environment variables to send to the container. You can add new environment variables, which are added to the container at launch, or you can override the existing environment variables from the Docker image or the task definition.
Note
Environment variables cannot start with "Batch ". This naming convention is reserved for variables that Batch sets.
Name (string) --
The name of the key-value pair. For environment variables, this is the name of the environment variable.
Value (string) --
The value of the key-value pair. For environment variables, this is the value of the environment variable.
InstanceType (string) --
The instance type to use for a multi-node parallel job.
Note
This parameter isn't applicable to single-node container jobs or jobs that run on Fargate resources, and shouldn't be provided.
ResourceRequirements (list) --
The type and amount of resources to assign to a container. This overrides the settings in the job definition. The supported resources include GPU , MEMORY , and VCPU .
(dict) --
The type and amount of a resource to assign to a container. The supported resources include GPU , MEMORY , and VCPU .
Type (string) -- [REQUIRED]
The type of resource to assign to a container. The supported resources include GPU , MEMORY , and VCPU .
Value (string) -- [REQUIRED]
The quantity of the specified resource to reserve for the container. The values vary based on the type specified.
type="GPU"
The number of physical GPUs to reserve for the container. Make sure that the number of GPUs reserved for all containers in a job doesn't exceed the number of available GPUs on the compute resource that the job is launched on.
Note
GPUs aren't available for jobs that are running on Fargate resources.
type="MEMORY"
The memory hard limit (in MiB) present to the container. This parameter is supported for jobs that are running on EC2 resources. If your container attempts to exceed the memory specified, the container is terminated. This parameter maps to Memory in the Create a container section of the Docker Remote API and the --memory option to docker run . You must specify at least 4 MiB of memory for a job. This is required but can be specified in several places for multi-node parallel (MNP) jobs. It must be specified for each node at least once. This parameter maps to Memory in the Create a container section of the Docker Remote API and the --memory option to docker run .
Note
If you're trying to maximize your resource utilization by providing your jobs as much memory as possible for a particular instance type, see Memory management in the Batch User Guide .
For jobs that are running on Fargate resources, then value is the hard limit (in MiB), and must match one of the supported values and the VCPU values must be one of the values supported for that memory value.
value = 512
VCPU = 0.25
value = 1024
VCPU = 0.25 or 0.5
value = 2048
VCPU = 0.25, 0.5, or 1
value = 3072
VCPU = 0.5, or 1
value = 4096
VCPU = 0.5, 1, or 2
value = 5120, 6144, or 7168
VCPU = 1 or 2
value = 8192
VCPU = 1, 2, 4, or 8
value = 9216, 10240, 11264, 12288, 13312, 14336, or 15360
VCPU = 2 or 4
value = 16384
VCPU = 2, 4, or 8
value = 17408, 18432, 19456, 21504, 22528, 23552, 25600, 26624, 27648, 29696, or 30720
VCPU = 4
value = 20480, 24576, or 28672
VCPU = 4 or 8
value = 36864, 45056, 53248, or 61440
VCPU = 8
value = 32768, 40960, 49152, or 57344
VCPU = 8 or 16
value = 65536, 73728, 81920, 90112, 98304, 106496, 114688, or 122880
VCPU = 16
type="VCPU"
The number of vCPUs reserved for the container. This parameter maps to CpuShares in the Create a container section of the Docker Remote API and the --cpu-shares option to docker run . Each vCPU is equivalent to 1,024 CPU shares. For EC2 resources, you must specify at least one vCPU. This is required but can be specified in several places; it must be specified for each node at least once.
The default for the Fargate On-Demand vCPU resource count quota is 6 vCPUs. For more information about Fargate quotas, see Fargate quotas in the Amazon Web Services General Reference .
For jobs that are running on Fargate resources, then value must match one of the supported values and the MEMORY values must be one of the values supported for that VCPU value. The supported values are 0.25, 0.5, 1, 2, 4, 8, and 16
value = 0.25
MEMORY = 512, 1024, or 2048
value = 0.5
MEMORY = 1024, 2048, 3072, or 4096
value = 1
MEMORY = 2048, 3072, 4096, 5120, 6144, 7168, or 8192
value = 2
MEMORY = 4096, 5120, 6144, 7168, 8192, 9216, 10240, 11264, 12288, 13312, 14336, 15360, or 16384
value = 4
MEMORY = 8192, 9216, 10240, 11264, 12288, 13312, 14336, 15360, 16384, 17408, 18432, 19456, 20480, 21504, 22528, 23552, 24576, 25600, 26624, 27648, 28672, 29696, or 30720
value = 8
MEMORY = 16384, 20480, 24576, 28672, 32768, 36864, 40960, 45056, 49152, 53248, 57344, or 61440
value = 16
MEMORY = 32768, 40960, 49152, 57344, 65536, 73728, 81920, 90112, 98304, 106496, 114688, or 122880
DependsOn (list) --
A list of dependencies for the job. A job can depend upon a maximum of 20 jobs. You can specify a SEQUENTIAL type dependency without specifying a job ID for array jobs so that each child array job completes sequentially, starting at index 0. You can also specify an N_TO_N type dependency with a job ID for array jobs. In that case, each index child of this job must wait for the corresponding index child of each dependency to complete before it can begin.
(dict) --
An object that represents an Batch job dependency.
JobId (string) --
The job ID of the Batch job that's associated with this dependency.
Type (string) --
The type of the job dependency.
JobDefinition (string) -- [REQUIRED]
The job definition used by this job. This value can be one of name , name:revision , or the Amazon Resource Name (ARN) for the job definition. If name is specified without a revision then the latest active revision is used.
JobName (string) -- [REQUIRED]
The name of the job. It can be up to 128 letters long. The first character must be alphanumeric, can contain uppercase and lowercase letters, numbers, hyphens (-), and underscores (_).
Parameters (dict) --
Additional parameters passed to the job that replace parameter substitution placeholders that are set in the job definition. Parameters are specified as a key and value pair mapping. Parameters included here override any corresponding parameter defaults from the job definition.
(string) --
(string) --
RetryStrategy (dict) --
The retry strategy to use for failed jobs. When a retry strategy is specified here, it overrides the retry strategy defined in the job definition.
Attempts (integer) --
The number of times to move a job to the RUNNABLE status. If the value of attempts is greater than one, the job is retried on failure the same number of attempts as the value.
CloudWatchLogsParameters (dict) --
The parameters for using an CloudWatch Logs log stream as a target.
LogStreamName (string) --
The name of the log stream.
Timestamp (string) --
The time the event occurred, expressed as the number of milliseconds after Jan 1, 1970 00:00:00 UTC.
EcsTaskParameters (dict) --
The parameters for using an Amazon ECS task as a target.
CapacityProviderStrategy (list) --
The capacity provider strategy to use for the task.
If a capacityProviderStrategy is specified, the launchType parameter must be omitted. If no capacityProviderStrategy or launchType is specified, the defaultCapacityProviderStrategy for the cluster is used.
(dict) --
The details of a capacity provider strategy. To learn more, see CapacityProviderStrategyItem in the Amazon ECS API Reference.
base (integer) --
The base value designates how many tasks, at a minimum, to run on the specified capacity provider. Only one capacity provider in a capacity provider strategy can have a base defined. If no value is specified, the default value of 0 is used.
capacityProvider (string) -- [REQUIRED]
The short name of the capacity provider.
weight (integer) --
The weight value designates the relative percentage of the total number of tasks launched that should use the specified capacity provider. The weight value is taken into consideration after the base value, if defined, is satisfied.
EnableECSManagedTags (boolean) --
Specifies whether to enable Amazon ECS managed tags for the task. For more information, see Tagging Your Amazon ECS Resources in the Amazon Elastic Container Service Developer Guide.
EnableExecuteCommand (boolean) --
Whether or not to enable the execute command functionality for the containers in this task. If true, this enables execute command functionality on all containers in the task.
Group (string) --
Specifies an Amazon ECS task group for the task. The maximum length is 255 characters.
LaunchType (string) --
Specifies the launch type on which your task is running. The launch type that you specify here must match one of the launch type (compatibilities) of the target task. The FARGATE value is supported only in the Regions where Fargate with Amazon ECS is supported. For more information, see Fargate on Amazon ECS in the Amazon Elastic Container Service Developer Guide .
NetworkConfiguration (dict) --
Use this structure if the Amazon ECS task uses the awsvpc network mode. This structure specifies the VPC subnets and security groups associated with the task, and whether a public IP address is to be used. This structure is required if LaunchType is FARGATE because the awsvpc mode is required for Fargate tasks.
If you specify NetworkConfiguration when the target ECS task does not use the awsvpc network mode, the task fails.
awsvpcConfiguration (dict) --
Use this structure to specify the VPC subnets and security groups for the task, and whether a public IP address is to be used. This structure is relevant only for ECS tasks that use the awsvpc network mode.
AssignPublicIp (string) --
Specifies whether the task's elastic network interface receives a public IP address. You can specify ENABLED only when LaunchType in EcsParameters is set to FARGATE .
SecurityGroups (list) --
Specifies the security groups associated with the task. These security groups must all be in the same VPC. You can specify as many as five security groups. If you do not specify a security group, the default security group for the VPC is used.
(string) --
Subnets (list) -- [REQUIRED]
Specifies the subnets associated with the task. These subnets must all be in the same VPC. You can specify as many as 16 subnets.
(string) --
Overrides (dict) --
The overrides that are associated with a task.
ContainerOverrides (list) --
One or more container overrides that are sent to a task.
(dict) --
The overrides that are sent to a container. An empty container override can be passed in. An example of an empty container override is {"containerOverrides": [ ] } . If a non-empty container override is specified, the name parameter must be included.
Command (list) --
The command to send to the container that overrides the default command from the Docker image or the task definition. You must also specify a container name.
(string) --
Cpu (integer) --
The number of cpu units reserved for the container, instead of the default value from the task definition. You must also specify a container name.
Environment (list) --
The environment variables to send to the container. You can add new environment variables, which are added to the container at launch, or you can override the existing environment variables from the Docker image or the task definition. You must also specify a container name.
(dict) --
The environment variables to send to the container. You can add new environment variables, which are added to the container at launch, or you can override the existing environment variables from the Docker image or the task definition. You must also specify a container name.
name (string) --
The name of the key-value pair. For environment variables, this is the name of the environment variable.
value (string) --
The value of the key-value pair. For environment variables, this is the value of the environment variable.
EnvironmentFiles (list) --
A list of files containing the environment variables to pass to a container, instead of the value from the container definition.
(dict) --
A list of files containing the environment variables to pass to a container. You can specify up to ten environment files. The file must have a .env file extension. Each line in an environment file should contain an environment variable in VARIABLE=VALUE format. Lines beginning with # are treated as comments and are ignored. For more information about the environment variable file syntax, see Declare default environment variables in file .
If there are environment variables specified using the environment parameter in a container definition, they take precedence over the variables contained within an environment file. If multiple environment files are specified that contain the same variable, they're processed from the top down. We recommend that you use unique variable names. For more information, see Specifying environment variables in the Amazon Elastic Container Service Developer Guide .
This parameter is only supported for tasks hosted on Fargate using the following platform versions:
Linux platform version 1.4.0 or later.
Windows platform version 1.0.0 or later.
type (string) -- [REQUIRED]
The file type to use. The only supported value is s3 .
value (string) -- [REQUIRED]
The Amazon Resource Name (ARN) of the Amazon S3 object containing the environment variable file.
Memory (integer) --
The hard limit (in MiB) of memory to present to the container, instead of the default value from the task definition. If your container attempts to exceed the memory specified here, the container is killed. You must also specify a container name.
MemoryReservation (integer) --
The soft limit (in MiB) of memory to reserve for the container, instead of the default value from the task definition. You must also specify a container name.
Name (string) --
The name of the container that receives the override. This parameter is required if any override is specified.
ResourceRequirements (list) --
The type and amount of a resource to assign to a container, instead of the default value from the task definition. The only supported resource is a GPU.
(dict) --
The type and amount of a resource to assign to a container. The supported resource types are GPUs and Elastic Inference accelerators. For more information, see Working with GPUs on Amazon ECS or Working with Amazon Elastic Inference on Amazon ECS in the Amazon Elastic Container Service Developer Guide
type (string) -- [REQUIRED]
The type of resource to assign to a container. The supported values are GPU or InferenceAccelerator .
value (string) -- [REQUIRED]
The value for the specified resource type.
If the GPU type is used, the value is the number of physical GPUs the Amazon ECS container agent reserves for the container. The number of GPUs that's reserved for all containers in a task can't exceed the number of available GPUs on the container instance that the task is launched on.
If the InferenceAccelerator type is used, the value matches the deviceName for an InferenceAccelerator specified in a task definition.
Cpu (string) --
The cpu override for the task.
EphemeralStorage (dict) --
The ephemeral storage setting override for the task.
Note
This parameter is only supported for tasks hosted on Fargate that use the following platform versions:
Linux platform version 1.4.0 or later.
Windows platform version 1.0.0 or later.
sizeInGiB (integer) -- [REQUIRED]
The total amount, in GiB, of ephemeral storage to set for the task. The minimum supported value is 21 GiB and the maximum supported value is 200 GiB.
ExecutionRoleArn (string) --
The Amazon Resource Name (ARN) of the task execution IAM role override for the task. For more information, see Amazon ECS task execution IAM role in the Amazon Elastic Container Service Developer Guide .
InferenceAcceleratorOverrides (list) --
The Elastic Inference accelerator override for the task.
(dict) --
Details on an Elastic Inference accelerator task override. This parameter is used to override the Elastic Inference accelerator specified in the task definition. For more information, see Working with Amazon Elastic Inference on Amazon ECS in the Amazon Elastic Container Service Developer Guide .
deviceName (string) --
The Elastic Inference accelerator device name to override for the task. This parameter must match a deviceName specified in the task definition.
deviceType (string) --
The Elastic Inference accelerator type to use.
Memory (string) --
The memory override for the task.
TaskRoleArn (string) --
The Amazon Resource Name (ARN) of the IAM role that containers in this task can assume. All containers in this task are granted the permissions that are specified in this role. For more information, see IAM Role for Tasks in the Amazon Elastic Container Service Developer Guide .
PlacementConstraints (list) --
An array of placement constraint objects to use for the task. You can specify up to 10 constraints per task (including constraints in the task definition and those specified at runtime).
(dict) --
An object representing a constraint on task placement. To learn more, see Task Placement Constraints in the Amazon Elastic Container Service Developer Guide.
expression (string) --
A cluster query language expression to apply to the constraint. You cannot specify an expression if the constraint type is distinctInstance . To learn more, see Cluster Query Language in the Amazon Elastic Container Service Developer Guide.
type (string) --
The type of constraint. Use distinctInstance to ensure that each task in a particular group is running on a different container instance. Use memberOf to restrict the selection to a group of valid candidates.
PlacementStrategy (list) --
The placement strategy objects to use for the task. You can specify a maximum of five strategy rules per task.
(dict) --
The task placement strategy for a task or service. To learn more, see Task Placement Strategies in the Amazon Elastic Container Service Service Developer Guide.
field (string) --
The field to apply the placement strategy against. For the spread placement strategy, valid values are instanceId (or host, which has the same effect), or any platform or custom attribute that is applied to a container instance, such as attribute:ecs.availability-zone. For the binpack placement strategy, valid values are cpu and memory. For the random placement strategy, this field is not used.
type (string) --
The type of placement strategy. The random placement strategy randomly places tasks on available candidates. The spread placement strategy spreads placement across available candidates evenly based on the field parameter. The binpack strategy places tasks on available candidates that have the least available amount of the resource that is specified with the field parameter. For example, if you binpack on memory, a task is placed on the instance with the least amount of remaining memory (but still enough to run the task).
PlatformVersion (string) --
Specifies the platform version for the task. Specify only the numeric portion of the platform version, such as 1.1.0 .
This structure is used only if LaunchType is FARGATE . For more information about valid platform versions, see Fargate Platform Versions in the Amazon Elastic Container Service Developer Guide .
PropagateTags (string) --
Specifies whether to propagate the tags from the task definition to the task. If no value is specified, the tags are not propagated. Tags can only be propagated to the task during task creation. To add tags to a task after task creation, use the TagResource API action.
ReferenceId (string) --
The reference ID to use for the task.
Tags (list) --
The metadata that you apply to the task to help you categorize and organize them. Each tag consists of a key and an optional value, both of which you define. To learn more, see RunTask in the Amazon ECS API Reference.
(dict) --
A key-value pair associated with an Amazon Web Services resource. In EventBridge, rules and event buses support tagging.
Key (string) -- [REQUIRED]
A string you can use to assign a value. The combination of tag keys and values can help you organize and categorize your resources.
Value (string) -- [REQUIRED]
The value for the specified tag key.
TaskCount (integer) --
The number of tasks to create based on TaskDefinition . The default is 1.
TaskDefinitionArn (string) -- [REQUIRED]
The ARN of the task definition to use if the event target is an Amazon ECS task.
EventBridgeEventBusParameters (dict) --
The parameters for using an EventBridge event bus as a target.
DetailType (string) --
A free-form string, with a maximum of 128 characters, used to decide what fields to expect in the event detail.
EndpointId (string) --
The URL subdomain of the endpoint. For example, if the URL for Endpoint is https://abcde.veo.endpoints.event.amazonaws.com, then the EndpointId is abcde.veo .
Resources (list) --
Amazon Web Services resources, identified by Amazon Resource Name (ARN), which the event primarily concerns. Any number, including zero, may be present.
(string) --
Source (string) --
The source of the event.
Time (string) --
The time stamp of the event, per RFC3339 . If no time stamp is provided, the time stamp of the PutEvents call is used.
HttpParameters (dict) --
These are custom parameter to be used when the target is an API Gateway REST APIs or EventBridge ApiDestinations.
HeaderParameters (dict) --
The headers that need to be sent as part of request invoking the API Gateway REST API or EventBridge ApiDestination.
(string) --
(string) --
PathParameterValues (list) --
The path parameter values to be used to populate API Gateway REST API or EventBridge ApiDestination path wildcards ("*").
(string) --
QueryStringParameters (dict) --
The query string keys/values that need to be sent as part of request invoking the API Gateway REST API or EventBridge ApiDestination.
(string) --
(string) --
InputTemplate (string) --
Valid JSON text passed to the target. In this case, nothing from the event itself is passed to the target. For more information, see The JavaScript Object Notation (JSON) Data Interchange Format .
To remove an input template, specify an empty string.
KinesisStreamParameters (dict) --
The parameters for using a Kinesis stream as a target.
PartitionKey (string) -- [REQUIRED]
Determines which shard in the stream the data record is assigned to. Partition keys are Unicode strings with a maximum length limit of 256 characters for each key. Amazon Kinesis Data Streams uses the partition key as input to a hash function that maps the partition key and associated data to a specific shard. Specifically, an MD5 hash function is used to map partition keys to 128-bit integer values and to map associated data records to shards. As a result of this hashing mechanism, all data records with the same partition key map to the same shard within the stream.
LambdaFunctionParameters (dict) --
The parameters for using a Lambda function as a target.
InvocationType (string) --
Specify whether to invoke the function synchronously or asynchronously.
REQUEST_RESPONSE (default) - Invoke synchronously. This corresponds to the RequestResponse option in the InvocationType parameter for the Lambda Invoke API.
FIRE_AND_FORGET - Invoke asynchronously. This corresponds to the Event option in the InvocationType parameter for the Lambda Invoke API.
For more information, see Invocation types in the Amazon EventBridge User Guide .
RedshiftDataParameters (dict) --
These are custom parameters to be used when the target is a Amazon Redshift cluster to invoke the Amazon Redshift Data API BatchExecuteStatement.
Database (string) -- [REQUIRED]
The name of the database. Required when authenticating using temporary credentials.
DbUser (string) --
The database user name. Required when authenticating using temporary credentials.
SecretManagerArn (string) --
The name or ARN of the secret that enables access to the database. Required when authenticating using Secrets Manager.
Sqls (list) -- [REQUIRED]
The SQL statement text to run.
(string) --
// A single Redshift SQL
StatementName (string) --
The name of the SQL statement. You can name the SQL statement when you create it to identify the query.
WithEvent (boolean) --
Indicates whether to send an event back to EventBridge after the SQL statement runs.
SageMakerPipelineParameters (dict) --
The parameters for using a SageMaker pipeline as a target.
PipelineParameterList (list) --
List of Parameter names and values for SageMaker Model Building Pipeline execution.
(dict) --
Name/Value pair of a parameter to start execution of a SageMaker Model Building Pipeline.
Name (string) -- [REQUIRED]
Name of parameter to start execution of a SageMaker Model Building Pipeline.
Value (string) -- [REQUIRED]
Value of parameter to start execution of a SageMaker Model Building Pipeline.
SqsQueueParameters (dict) --
The parameters for using a Amazon SQS stream as a target.
MessageDeduplicationId (string) --
This parameter applies only to FIFO (first-in-first-out) queues.
The token used for deduplication of sent messages.
MessageGroupId (string) --
The FIFO message group ID to use as the target.
StepFunctionStateMachineParameters (dict) --
The parameters for using a Step Functions state machine as a target.
InvocationType (string) --
Specify whether to invoke the Step Functions state machine synchronously or asynchronously.
REQUEST_RESPONSE (default) - Invoke synchronously. For more information, see StartSyncExecution in the Step Functions API Reference .
Note
REQUEST_RESPONSE is not supported for STANDARD state machine workflows.
FIRE_AND_FORGET - Invoke asynchronously. For more information, see StartExecution in the Step Functions API Reference .
For more information, see Invocation types in the Amazon EventBridge User Guide .
dict
Response Syntax
{
'Arn': 'string',
'CreationTime': datetime(2015, 1, 1),
'CurrentState': 'RUNNING'|'STOPPED'|'CREATING'|'UPDATING'|'DELETING'|'STARTING'|'STOPPING'|'CREATE_FAILED'|'UPDATE_FAILED'|'START_FAILED'|'STOP_FAILED'|'DELETE_FAILED'|'CREATE_ROLLBACK_FAILED'|'DELETE_ROLLBACK_FAILED'|'UPDATE_ROLLBACK_FAILED',
'DesiredState': 'RUNNING'|'STOPPED',
'LastModifiedTime': datetime(2015, 1, 1),
'Name': 'string'
}
Response Structure
(dict) --
Arn (string) --
The ARN of the pipe.
CreationTime (datetime) --
The time the pipe was created.
CurrentState (string) --
The state the pipe is in.
DesiredState (string) --
The state the pipe should be in.
LastModifiedTime (datetime) --
When the pipe was last updated, in ISO-8601 format (YYYY-MM-DDThh:mm:ss.sTZD).
Name (string) --
The name of the pipe.