Amazon CloudWatch Logs

2024/01/10 - Amazon CloudWatch Logs - 3 updated api methods

Changes  Add support for account level subscription filter policies to PutAccountPolicy, DescribeAccountPolicies, and DeleteAccountPolicy APIs. Additionally, PutAccountPolicy has been modified with new optional "selectionCriteria" parameter for resource selection.

DeleteAccountPolicy (updated) Link ¶
Changes (request) 
{'policyType': {'SUBSCRIPTION_FILTER_POLICY'}}

Deletes a CloudWatch Logs account policy. This stops the policy from applying to all log groups or a subset of log groups in the account. Log-group level policies will still be in effect.

To use this operation, you must be signed on with the correct permissions depending on the type of policy that you are deleting.

  • To delete a data protection policy, you must have the logs:DeleteDataProtectionPolicy and logs:DeleteAccountPolicy permissions.

  • To delete a subscription filter policy, you must have the logs:DeleteSubscriptionFilter and logs:DeleteAccountPolicy permissions.

See also: AWS API Documentation

Request Syntax

client.delete_account_policy(
    policyName='string',
    policyType='DATA_PROTECTION_POLICY'|'SUBSCRIPTION_FILTER_POLICY'
)
type policyName

string

param policyName

[REQUIRED]

The name of the policy to delete.

type policyType

string

param policyType

[REQUIRED]

The type of policy to delete.

returns

None

DescribeAccountPolicies (updated) Link ¶
Changes (request, response)
Request 
{'policyType': {'SUBSCRIPTION_FILTER_POLICY'}}
Response 
{'accountPolicies': {'policyType': {'SUBSCRIPTION_FILTER_POLICY'},
                     'selectionCriteria': 'string'}}

Returns a list of all CloudWatch Logs account policies in the account.

See also: AWS API Documentation

Request Syntax

client.describe_account_policies(
    policyType='DATA_PROTECTION_POLICY'|'SUBSCRIPTION_FILTER_POLICY',
    policyName='string',
    accountIdentifiers=[
        'string',
    ]
)
type policyType

string

param policyType

[REQUIRED]

Use this parameter to limit the returned policies to only the policies that match the policy type that you specify.

type policyName

string

param policyName

Use this parameter to limit the returned policies to only the policy with the name that you specify.

type accountIdentifiers

list

param accountIdentifiers

If you are using an account that is set up as a monitoring account for CloudWatch unified cross-account observability, you can use this to specify the account ID of a source account. If you do, the operation returns the account policy for the specified account. Currently, you can specify only one account ID in this parameter.

If you omit this parameter, only the policy in the current account is returned.

  • (string) --

rtype

dict

returns

Response Syntax

{
    'accountPolicies': [
        {
            'policyName': 'string',
            'policyDocument': 'string',
            'lastUpdatedTime': 123,
            'policyType': 'DATA_PROTECTION_POLICY'|'SUBSCRIPTION_FILTER_POLICY',
            'scope': 'ALL',
            'selectionCriteria': 'string',
            'accountId': 'string'
        },
    ]
}

Response Structure

  • (dict) --

    • accountPolicies (list) --

      An array of structures that contain information about the CloudWatch Logs account policies that match the specified filters.

      • (dict) --

        A structure that contains information about one CloudWatch Logs account policy.

        • policyName (string) --

          The name of the account policy.

        • policyDocument (string) --

          The policy document for this account policy.

          The JSON specified in policyDocument can be up to 30,720 characters.

        • lastUpdatedTime (integer) --

          The date and time that this policy was most recently updated.

        • policyType (string) --

          The type of policy for this account policy.

        • scope (string) --

          The scope of the account policy.

        • selectionCriteria (string) --

          The log group selection criteria for this subscription filter policy.

        • accountId (string) --

          The Amazon Web Services account ID that the policy applies to.

PutAccountPolicy (updated) Link ¶
Changes (request, response)
Request 
{'policyType': {'SUBSCRIPTION_FILTER_POLICY'}, 'selectionCriteria': 'string'}
Response 
{'accountPolicy': {'policyType': {'SUBSCRIPTION_FILTER_POLICY'},
                   'selectionCriteria': 'string'}}

Creates an account-level data protection policy or subscription filter policy that applies to all log groups or a subset of log groups in the account.

Data protection policy

A data protection policy can help safeguard sensitive data that's ingested by your log groups by auditing and masking the sensitive log data. Each account can have only one account-level data protection policy.

Warning

Sensitive data is detected and masked when it is ingested into a log group. When you set a data protection policy, log events ingested into the log groups before that time are not masked.

If you use PutAccountPolicy to create a data protection policy for your whole account, it applies to both existing log groups and all log groups that are created later in this account. The account-level policy is applied to existing log groups with eventual consistency. It might take up to 5 minutes before sensitive data in existing log groups begins to be masked.

By default, when a user views a log event that includes masked data, the sensitive data is replaced by asterisks. A user who has the logs:Unmask permission can use a GetLogEvents or FilterLogEvents operation with the unmask parameter set to true to view the unmasked log events. Users with the logs:Unmask can also view unmasked data in the CloudWatch Logs console by running a CloudWatch Logs Insights query with the unmask query command.

For more information, including a list of types of data that can be audited and masked, see Protect sensitive log data with masking .

To use the PutAccountPolicy operation for a data protection policy, you must be signed on with the logs:PutDataProtectionPolicy and logs:PutAccountPolicy permissions.

The PutAccountPolicy operation applies to all log groups in the account. You can use PutDataProtectionPolicy to create a data protection policy that applies to just one log group. If a log group has its own data protection policy and the account also has an account-level data protection policy, then the two policies are cumulative. Any sensitive term specified in either policy is masked.

Subscription filter policy

A subscription filter policy sets up a real-time feed of log events from CloudWatch Logs to other Amazon Web Services services. Account-level subscription filter policies apply to both existing log groups and log groups that are created later in this account. Supported destinations are Kinesis Data Streams, Kinesis Data Firehose, and Lambda. When log events are sent to the receiving service, they are Base64 encoded and compressed with the GZIP format.

The following destinations are supported for subscription filters:

  • An Kinesis Data Streams data stream in the same account as the subscription policy, for same-account delivery.

  • An Kinesis Data Firehose data stream in the same account as the subscription policy, for same-account delivery.

  • A Lambda function in the same account as the subscription policy, for same-account delivery.

  • A logical destination in a different account created with PutDestination , for cross-account delivery. Kinesis Data Streams and Kinesis Data Firehose are supported as logical destinations.

Each account can have one account-level subscription filter policy. If you are updating an existing filter, you must specify the correct name in PolicyName . To perform a PutAccountPolicy subscription filter operation for any destination except a Lambda function, you must also have the iam:PassRole permission.

See also: AWS API Documentation

Request Syntax

client.put_account_policy(
    policyName='string',
    policyDocument='string',
    policyType='DATA_PROTECTION_POLICY'|'SUBSCRIPTION_FILTER_POLICY',
    scope='ALL',
    selectionCriteria='string'
)
type policyName

string

param policyName

[REQUIRED]

A name for the policy. This must be unique within the account.

type policyDocument

string

param policyDocument

[REQUIRED]

Specify the policy, in JSON.

Data protection policy

A data protection policy must include two JSON blocks:

  • The first block must include both a DataIdentifer array and an Operation property with an Audit action. The DataIdentifer array lists the types of sensitive data that you want to mask. For more information about the available options, see Types of data that you can mask . The Operation property with an Audit action is required to find the sensitive data terms. This Audit action must contain a FindingsDestination object. You can optionally use that FindingsDestination object to list one or more destinations to send audit findings to. If you specify destinations such as log groups, Kinesis Data Firehose streams, and S3 buckets, they must already exist.

  • The second block must include both a DataIdentifer array and an Operation property with an Deidentify action. The DataIdentifer array must exactly match the DataIdentifer array in the first block of the policy. The Operation property with the Deidentify action is what actually masks the data, and it must contain the "MaskConfig": {} object. The "MaskConfig": {} object must be empty.

For an example data protection policy, see the Examples section on this page.

Warning

The contents of the two DataIdentifer arrays must match exactly.

In addition to the two JSON blocks, the policyDocument can also include Name , Description , and Version fields. The Name is different than the operation's policyName parameter, and is used as a dimension when CloudWatch Logs reports audit findings metrics to CloudWatch.

The JSON specified in policyDocument can be up to 30,720 characters long.

Subscription filter policy

A subscription filter policy can include the following attributes in a JSON block:

  • DestinationArn The ARN of the destination to deliver log events to. Supported destinations are:

    • An Kinesis Data Streams data stream in the same account as the subscription policy, for same-account delivery.

    • An Kinesis Data Firehose data stream in the same account as the subscription policy, for same-account delivery.

    • A Lambda function in the same account as the subscription policy, for same-account delivery.

    • A logical destination in a different account created with PutDestination , for cross-account delivery. Kinesis Data Streams and Kinesis Data Firehose are supported as logical destinations.

  • RoleArn The ARN of an IAM role that grants CloudWatch Logs permissions to deliver ingested log events to the destination stream. You don't need to provide the ARN when you are working with a logical destination for cross-account delivery.

  • FilterPattern A filter pattern for subscribing to a filtered stream of log events.

  • Distribution The method used to distribute log data to the destination. By default, log data is grouped by log stream, but the grouping can be set to Random for a more even distribution. This property is only applicable when the destination is an Kinesis Data Streams data stream.

type policyType

string

param policyType

[REQUIRED]

The type of policy that you're creating or updating.

type scope

string

param scope

Currently the only valid value for this parameter is ALL , which specifies that the data protection policy applies to all log groups in the account. If you omit this parameter, the default of ALL is used.

type selectionCriteria

string

param selectionCriteria

Use this parameter to apply the subscription filter policy to a subset of log groups in the account. Currently, the only supported filter is LogGroupName NOT IN [] . The selectionCriteria string can be up to 25KB in length. The length is determined by using its UTF-8 bytes.

Using the selectionCriteria parameter is useful to help prevent infinite loops. For more information, see Log recursion prevention .

Specifing selectionCriteria is valid only when you specify SUBSCRIPTION_FILTER_POLICY for policyType .

rtype

dict

returns

Response Syntax

{
    'accountPolicy': {
        'policyName': 'string',
        'policyDocument': 'string',
        'lastUpdatedTime': 123,
        'policyType': 'DATA_PROTECTION_POLICY'|'SUBSCRIPTION_FILTER_POLICY',
        'scope': 'ALL',
        'selectionCriteria': 'string',
        'accountId': 'string'
    }
}

Response Structure

  • (dict) --

    • accountPolicy (dict) --

      The account policy that you created.

      • policyName (string) --

        The name of the account policy.

      • policyDocument (string) --

        The policy document for this account policy.

        The JSON specified in policyDocument can be up to 30,720 characters.

      • lastUpdatedTime (integer) --

        The date and time that this policy was most recently updated.

      • policyType (string) --

        The type of policy for this account policy.

      • scope (string) --

        The scope of the account policy.

      • selectionCriteria (string) --

        The log group selection criteria for this subscription filter policy.

      • accountId (string) --

        The Amazon Web Services account ID that the policy applies to.