2022/03/01 - Managed Streaming for Kafka Connect - 1 new 2 updated api methods
Changes Adds operation for custom plugin deletion (DeleteCustomPlugin) and adds new StateDescription field to DescribeCustomPlugin and DescribeConnector responses to return errors from asynchronous resource creation.
Deletes a custom plugin.
See also: AWS API Documentation
Request Syntax
client.delete_custom_plugin(
customPluginArn='string'
)
string
[REQUIRED]
The Amazon Resource Name (ARN) of the custom plugin that you want to delete.
dict
Response Syntax
{
'customPluginArn': 'string',
'customPluginState': 'CREATING'|'CREATE_FAILED'|'ACTIVE'|'UPDATING'|'UPDATE_FAILED'|'DELETING'
}
Response Structure
(dict) --
customPluginArn (string) --
The Amazon Resource Name (ARN) of the custom plugin that you requested to delete.
customPluginState (string) --
The state of the custom plugin.
{'stateDescription': {'code': 'string', 'message': 'string'}}
Returns summary information about the connector.
See also: AWS API Documentation
Request Syntax
client.describe_connector(
connectorArn='string'
)
string
[REQUIRED]
The Amazon Resource Name (ARN) of the connector that you want to describe.
dict
Response Syntax
{
'capacity': {
'autoScaling': {
'maxWorkerCount': 123,
'mcuCount': 123,
'minWorkerCount': 123,
'scaleInPolicy': {
'cpuUtilizationPercentage': 123
},
'scaleOutPolicy': {
'cpuUtilizationPercentage': 123
}
},
'provisionedCapacity': {
'mcuCount': 123,
'workerCount': 123
}
},
'connectorArn': 'string',
'connectorConfiguration': {
'string': 'string'
},
'connectorDescription': 'string',
'connectorName': 'string',
'connectorState': 'RUNNING'|'CREATING'|'UPDATING'|'DELETING'|'FAILED',
'creationTime': datetime(2015, 1, 1),
'currentVersion': 'string',
'kafkaCluster': {
'apacheKafkaCluster': {
'bootstrapServers': 'string',
'vpc': {
'securityGroups': [
'string',
],
'subnets': [
'string',
]
}
}
},
'kafkaClusterClientAuthentication': {
'authenticationType': 'NONE'|'IAM'
},
'kafkaClusterEncryptionInTransit': {
'encryptionType': 'PLAINTEXT'|'TLS'
},
'kafkaConnectVersion': 'string',
'logDelivery': {
'workerLogDelivery': {
'cloudWatchLogs': {
'enabled': True|False,
'logGroup': 'string'
},
'firehose': {
'deliveryStream': 'string',
'enabled': True|False
},
's3': {
'bucket': 'string',
'enabled': True|False,
'prefix': 'string'
}
}
},
'plugins': [
{
'customPlugin': {
'customPluginArn': 'string',
'revision': 123
}
},
],
'serviceExecutionRoleArn': 'string',
'stateDescription': {
'code': 'string',
'message': 'string'
},
'workerConfiguration': {
'revision': 123,
'workerConfigurationArn': 'string'
}
}
Response Structure
(dict) --
capacity (dict) --
Information about the capacity of the connector, whether it is auto scaled or provisioned.
autoScaling (dict) --
Describes the connector's auto scaling capacity.
maxWorkerCount (integer) --
The maximum number of workers allocated to the connector.
mcuCount (integer) --
The number of microcontroller units (MCUs) allocated to each connector worker. The valid values are 1,2,4,8.
minWorkerCount (integer) --
The minimum number of workers allocated to the connector.
scaleInPolicy (dict) --
The sacle-in policy for the connector.
cpuUtilizationPercentage (integer) --
Specifies the CPU utilization percentage threshold at which you want connector scale in to be triggered.
scaleOutPolicy (dict) --
The sacle-out policy for the connector.>
cpuUtilizationPercentage (integer) --
The CPU utilization percentage threshold at which you want connector scale out to be triggered.
provisionedCapacity (dict) --
Describes a connector's provisioned capacity.
mcuCount (integer) --
The number of microcontroller units (MCUs) allocated to each connector worker. The valid values are 1,2,4,8.
workerCount (integer) --
The number of workers that are allocated to the connector.
connectorArn (string) --
The Amazon Resource Name (ARN) of the connector.
connectorConfiguration (dict) --
A map of keys to values that represent the configuration for the connector.
(string) --
(string) --
connectorDescription (string) --
A summary description of the connector.
connectorName (string) --
The name of the connector.
connectorState (string) --
The state of the connector.
creationTime (datetime) --
The time the connector was created.
currentVersion (string) --
The current version of the connector.
kafkaCluster (dict) --
The Apache Kafka cluster that the connector is connected to.
apacheKafkaCluster (dict) --
The Apache Kafka cluster to which the connector is connected.
bootstrapServers (string) --
The bootstrap servers of the cluster.
vpc (dict) --
Details of an Amazon VPC which has network connectivity to the Apache Kafka cluster.
securityGroups (list) --
The security groups for the connector.
(string) --
subnets (list) --
The subnets for the connector.
(string) --
kafkaClusterClientAuthentication (dict) --
The type of client authentication used to connect to the Apache Kafka cluster. The value is NONE when no client authentication is used.
authenticationType (string) --
The type of client authentication used to connect to the Apache Kafka cluster. Value NONE means that no client authentication is used.
kafkaClusterEncryptionInTransit (dict) --
Details of encryption in transit to the Apache Kafka cluster.
encryptionType (string) --
The type of encryption in transit to the Apache Kafka cluster.
kafkaConnectVersion (string) --
The version of Kafka Connect. It has to be compatible with both the Apache Kafka cluster's version and the plugins.
logDelivery (dict) --
Details about delivering logs to Amazon CloudWatch Logs.
workerLogDelivery (dict) --
The workers can send worker logs to different destination types. This configuration specifies the details of these destinations.
cloudWatchLogs (dict) --
Details about delivering logs to Amazon CloudWatch Logs.
enabled (boolean) --
Whether log delivery to Amazon CloudWatch Logs is enabled.
logGroup (string) --
The name of the CloudWatch log group that is the destination for log delivery.
firehose (dict) --
Details about delivering logs to Amazon Kinesis Data Firehose.
deliveryStream (string) --
The name of the Kinesis Data Firehose delivery stream that is the destination for log delivery.
enabled (boolean) --
Specifies whether connector logs get delivered to Amazon Kinesis Data Firehose.
s3 (dict) --
Details about delivering logs to Amazon S3.
bucket (string) --
The name of the S3 bucket that is the destination for log delivery.
enabled (boolean) --
Specifies whether connector logs get sent to the specified Amazon S3 destination.
prefix (string) --
The S3 prefix that is the destination for log delivery.
plugins (list) --
Specifies which plugins were used for this connector.
(dict) --
The description of the plugin.
customPlugin (dict) --
Details about a custom plugin.
customPluginArn (string) --
The Amazon Resource Name (ARN) of the custom plugin.
revision (integer) --
The revision of the custom plugin.
serviceExecutionRoleArn (string) --
The Amazon Resource Name (ARN) of the IAM role used by the connector to access Amazon Web Services resources.
stateDescription (dict) --
Details about the state of a connector.
code (string) --
A code that describes the state of a resource.
message (string) --
A message that describes the state of a resource.
workerConfiguration (dict) --
Specifies which worker configuration was used for the connector.
revision (integer) --
The revision of the worker configuration.
workerConfigurationArn (string) --
The Amazon Resource Name (ARN) of the worker configuration.
{'stateDescription': {'code': 'string', 'message': 'string'}}
A summary description of the custom plugin.
See also: AWS API Documentation
Request Syntax
client.describe_custom_plugin(
customPluginArn='string'
)
string
[REQUIRED]
Returns information about a custom plugin.
dict
Response Syntax
{
'creationTime': datetime(2015, 1, 1),
'customPluginArn': 'string',
'customPluginState': 'CREATING'|'CREATE_FAILED'|'ACTIVE'|'UPDATING'|'UPDATE_FAILED'|'DELETING',
'description': 'string',
'latestRevision': {
'contentType': 'JAR'|'ZIP',
'creationTime': datetime(2015, 1, 1),
'description': 'string',
'fileDescription': {
'fileMd5': 'string',
'fileSize': 123
},
'location': {
's3Location': {
'bucketArn': 'string',
'fileKey': 'string',
'objectVersion': 'string'
}
},
'revision': 123
},
'name': 'string',
'stateDescription': {
'code': 'string',
'message': 'string'
}
}
Response Structure
(dict) --
creationTime (datetime) --
The time that the custom plugin was created.
customPluginArn (string) --
The Amazon Resource Name (ARN) of the custom plugin.
customPluginState (string) --
The state of the custom plugin.
description (string) --
The description of the custom plugin.
latestRevision (dict) --
The latest successfully created revision of the custom plugin. If there are no successfully created revisions, this field will be absent.
contentType (string) --
The format of the plugin file.
creationTime (datetime) --
The time that the custom plugin was created.
description (string) --
The description of the custom plugin.
fileDescription (dict) --
Details about the custom plugin file.
fileMd5 (string) --
The hex-encoded MD5 checksum of the custom plugin file. You can use it to validate the file.
fileSize (integer) --
The size in bytes of the custom plugin file. You can use it to validate the file.
location (dict) --
Information about the location of the custom plugin.
s3Location (dict) --
The S3 bucket Amazon Resource Name (ARN), file key, and object version of the plugin file stored in Amazon S3.
bucketArn (string) --
The Amazon Resource Name (ARN) of an S3 bucket.
fileKey (string) --
The file key for an object in an S3 bucket.
objectVersion (string) --
The version of an object in an S3 bucket.
revision (integer) --
The revision of the custom plugin.
name (string) --
The name of the custom plugin.
stateDescription (dict) --
Details about the state of a custom plugin.
code (string) --
A code that describes the state of a resource.
message (string) --
A message that describes the state of a resource.