AWS Lake Formation

2021/11/30 - AWS Lake Formation - 19 new 9 updated api methods

Changes  This release adds support for row and cell-based access control in Lake Formation. It also adds support for Lake Formation Governed Tables, which support ACID transactions and automatic storage optimizations.

ExtendTransaction (new) Link ¶

Indicates to the service that the specified transaction is still active and should not be treated as idle and aborted.

Write transactions that remain idle for a long period are automatically aborted unless explicitly extended.

See also: AWS API Documentation

Request Syntax

client.extend_transaction(
    TransactionId='string'
)
type TransactionId

string

param TransactionId

The transaction to extend.

rtype

dict

returns

Response Syntax

{}

Response Structure

  • (dict) --

DeleteDataCellsFilter (new) Link ¶

Deletes a data cell filter.

See also: AWS API Documentation

Request Syntax

client.delete_data_cells_filter(
    TableCatalogId='string',
    DatabaseName='string',
    TableName='string',
    Name='string'
)
type TableCatalogId

string

param TableCatalogId

The ID of the catalog to which the table belongs.

type DatabaseName

string

param DatabaseName

A database in the Glue Data Catalog.

type TableName

string

param TableName

A table in the database.

type Name

string

param Name

The name given by the user to the data filter cell.

rtype

dict

returns

Response Syntax

{}

Response Structure

  • (dict) --

ListDataCellsFilter (new) Link ¶

Lists all the data cell filters on a table.

See also: AWS API Documentation

Request Syntax

client.list_data_cells_filter(
    Table={
        'CatalogId': 'string',
        'DatabaseName': 'string',
        'Name': 'string',
        'TableWildcard': {}

    },
    NextToken='string',
    MaxResults=123
)
type Table

dict

param Table

A table in the Glue Data Catalog.

  • CatalogId (string) --

    The identifier for the Data Catalog. By default, it is the account ID of the caller.

  • DatabaseName (string) -- [REQUIRED]

    The name of the database for the table. Unique to a Data Catalog. A database is a set of associated table definitions organized into a logical group. You can Grant and Revoke database privileges to a principal.

  • Name (string) --

    The name of the table.

  • TableWildcard (dict) --

    A wildcard object representing every table under a database.

    At least one of TableResource$Name or TableResource$TableWildcard is required.

type NextToken

string

param NextToken

A continuation token, if this is a continuation call.

type MaxResults

integer

param MaxResults

The maximum size of the response.

rtype

dict

returns

Response Syntax

{
    'DataCellsFilters': [
        {
            'TableCatalogId': 'string',
            'DatabaseName': 'string',
            'TableName': 'string',
            'Name': 'string',
            'RowFilter': {
                'FilterExpression': 'string',
                'AllRowsWildcard': {}
            },
            'ColumnNames': [
                'string',
            ],
            'ColumnWildcard': {
                'ExcludedColumnNames': [
                    'string',
                ]
            }
        },
    ],
    'NextToken': 'string'
}

Response Structure

  • (dict) --

    • DataCellsFilters (list) --

      A list of DataCellFilter structures.

      • (dict) --

        A structure that describes certain columns on certain rows.

        • TableCatalogId (string) --

          The ID of the catalog to which the table belongs.

        • DatabaseName (string) --

          A database in the Glue Data Catalog.

        • TableName (string) --

          A table in the database.

        • Name (string) --

          The name given by the user to the data filter cell.

        • RowFilter (dict) --

          A PartiQL predicate.

          • FilterExpression (string) --

            A filter expression.

          • AllRowsWildcard (dict) --

            A wildcard for all rows.

        • ColumnNames (list) --

          A list of column names.

          • (string) --

        • ColumnWildcard (dict) --

          A wildcard with exclusions.

          • ExcludedColumnNames (list) --

            Excludes column names. Any column with this name will be excluded.

            • (string) --

    • NextToken (string) --

      A continuation token, if not all requested data cell filters have been returned.

DescribeTransaction (new) Link ¶

Returns the details of a single transaction.

See also: AWS API Documentation

Request Syntax

client.describe_transaction(
    TransactionId='string'
)
type TransactionId

string

param TransactionId

[REQUIRED]

The transaction for which to return status.

rtype

dict

returns

Response Syntax

{
    'TransactionDescription': {
        'TransactionId': 'string',
        'TransactionStatus': 'ACTIVE'|'COMMITTED'|'ABORTED'|'COMMIT_IN_PROGRESS',
        'TransactionStartTime': datetime(2015, 1, 1),
        'TransactionEndTime': datetime(2015, 1, 1)
    }
}

Response Structure

  • (dict) --

    • TransactionDescription (dict) --

      Returns a TransactionDescription object containing information about the transaction.

      • TransactionId (string) --

        The ID of the transaction.

      • TransactionStatus (string) --

        A status of ACTIVE, COMMITTED, or ABORTED.

      • TransactionStartTime (datetime) --

        The time when the transaction started.

      • TransactionEndTime (datetime) --

        The time when the transaction committed or aborted, if it is not currently active.

ListTableStorageOptimizers (new) Link ¶

Returns the configuration of all storage optimizers associated with a specified table.

See also: AWS API Documentation

Request Syntax

client.list_table_storage_optimizers(
    CatalogId='string',
    DatabaseName='string',
    TableName='string',
    StorageOptimizerType='COMPACTION'|'GARBAGE_COLLECTION'|'ALL',
    MaxResults=123,
    NextToken='string'
)
type CatalogId

string

param CatalogId

The Catalog ID of the table.

type DatabaseName

string

param DatabaseName

[REQUIRED]

Name of the database where the table is present.

type TableName

string

param TableName

[REQUIRED]

Name of the table.

type StorageOptimizerType

string

param StorageOptimizerType

The specific type of storage optimizers to list. The supported value is compaction .

type MaxResults

integer

param MaxResults

The number of storage optimizers to return on each call.

type NextToken

string

param NextToken

A continuation token, if this is a continuation call.

rtype

dict

returns

Response Syntax

{
    'StorageOptimizerList': [
        {
            'StorageOptimizerType': 'COMPACTION'|'GARBAGE_COLLECTION'|'ALL',
            'Config': {
                'string': 'string'
            },
            'ErrorMessage': 'string',
            'Warnings': 'string',
            'LastRunDetails': 'string'
        },
    ],
    'NextToken': 'string'
}

Response Structure

  • (dict) --

    • StorageOptimizerList (list) --

      A list of the storage optimizers associated with a table.

      • (dict) --

        A structure describing the configuration and details of a storage optimizer.

        • StorageOptimizerType (string) --

          The specific type of storage optimizer. The supported value is compaction .

        • Config (dict) --

          A map of the storage optimizer configuration. Currently contains only one key-value pair: is_enabled indicates true or false for acceleration.

          • (string) --

            • (string) --

        • ErrorMessage (string) --

          A message that contains information about any error (if present).

          When an acceleration result has an enabled status, the error message is empty.

          When an acceleration result has a disabled status, the message describes an error or simply indicates "disabled by the user".

        • Warnings (string) --

          A message that contains information about any warnings (if present).

        • LastRunDetails (string) --

          When an acceleration result has an enabled status, contains the details of the last job run.

    • NextToken (string) --

      A continuation token for paginating the returned list of tokens, returned if the current segment of the list is not the last.

StartQueryPlanning (new) Link ¶

Submits a request to process a query statement.

This operation generates work units that can be retrieved with the GetWorkUnits operation as soon as the query state is WORKUNITS_AVAILABLE or FINISHED.

See also: AWS API Documentation

Request Syntax

client.start_query_planning(
    QueryPlanningContext={
        'CatalogId': 'string',
        'DatabaseName': 'string',
        'QueryAsOfTime': datetime(2015, 1, 1),
        'QueryParameters': {
            'string': 'string'
        },
        'TransactionId': 'string'
    },
    QueryString='string'
)
type QueryPlanningContext

dict

param QueryPlanningContext

[REQUIRED]

A structure containing information about the query plan.

  • CatalogId (string) --

    The ID of the Data Catalog where the partition in question resides. If none is provided, the Amazon Web Services account ID is used by default.

  • DatabaseName (string) -- [REQUIRED]

    The database containing the table.

  • QueryAsOfTime (datetime) --

    The time as of when to read the table contents. If not set, the most recent transaction commit time will be used. Cannot be specified along with TransactionId .

  • QueryParameters (dict) --

    A map consisting of key-value pairs.

    • (string) --

      • (string) --

  • TransactionId (string) --

    The transaction ID at which to read the table contents. If this transaction is not committed, the read will be treated as part of that transaction and will see its writes. If this transaction has aborted, an error will be returned. If not set, defaults to the most recent committed transaction. Cannot be specified along with QueryAsOfTime .

type QueryString

string

param QueryString

[REQUIRED]

A PartiQL query statement used as an input to the planner service.

rtype

dict

returns

Response Syntax

{
    'QueryId': 'string'
}

Response Structure

  • (dict) --

    A structure for the output.

    • QueryId (string) --

      The ID of the plan query operation can be used to fetch the actual work unit descriptors that are produced as the result of the operation. The ID is also used to get the query state and as an input to the Execute operation.

GetWorkUnitResults (new) Link ¶

Returns the work units resulting from the query. Work units can be executed in any order and in parallel.

See also: AWS API Documentation

Request Syntax

client.get_work_unit_results(
    QueryId='string',
    WorkUnitId=123,
    WorkUnitToken='string'
)
type QueryId

string

param QueryId

[REQUIRED]

The ID of the plan query operation for which to get results.

type WorkUnitId

integer

param WorkUnitId

[REQUIRED]

The work unit ID for which to get results. Value generated by enumerating WorkUnitIdMin to WorkUnitIdMax (inclusive) from the WorkUnitRange in the output of GetWorkUnits .

type WorkUnitToken

string

param WorkUnitToken

[REQUIRED]

A work token used to query the execution service. Token output from GetWorkUnits .

rtype

dict

returns

Response Syntax

{
    'ResultStream': StreamingBody()
}

Response Structure

  • (dict) --

    A structure for the output.

    • ResultStream (:class:`.StreamingBody`) --

      Rows returned from the GetWorkUnitResults operation as a stream of Apache Arrow v1.0 messages.

UpdateTableStorageOptimizer (new) Link ¶

Updates the configuration of the storage optimizers for a table.

See also: AWS API Documentation

Request Syntax

client.update_table_storage_optimizer(
    CatalogId='string',
    DatabaseName='string',
    TableName='string',
    StorageOptimizerConfig={
        'string': {
            'string': 'string'
        }
    }
)
type CatalogId

string

param CatalogId

The Catalog ID of the table.

type DatabaseName

string

param DatabaseName

[REQUIRED]

Name of the database where the table is present.

type TableName

string

param TableName

[REQUIRED]

Name of the table for which to enable the storage optimizer.

type StorageOptimizerConfig

dict

param StorageOptimizerConfig

[REQUIRED]

Name of the table for which to enable the storage optimizer.

  • (string) --

    • (dict) --

      • (string) --

        • (string) --

rtype

dict

returns

Response Syntax

{
    'Result': 'string'
}

Response Structure

  • (dict) --

    • Result (string) --

      A response indicating the success of failure of the operation.

ListTransactions (new) Link ¶

Returns metadata about transactions and their status. To prevent the response from growing indefinitely, only uncommitted transactions and those available for time-travel queries are returned.

This operation can help you identify uncommitted transactions or to get information about transactions.

See also: AWS API Documentation

Request Syntax

client.list_transactions(
    CatalogId='string',
    StatusFilter='ALL'|'COMPLETED'|'ACTIVE'|'COMMITTED'|'ABORTED',
    MaxResults=123,
    NextToken='string'
)
type CatalogId

string

param CatalogId

The catalog for which to list transactions. Defaults to the account ID of the caller.

type StatusFilter

string

param StatusFilter

A filter indicating the status of transactions to return. Options are ALL | COMPLETED | COMMITTED | ABORTED | ACTIVE. The default is ALL .

type MaxResults

integer

param MaxResults

The maximum number of transactions to return in a single call.

type NextToken

string

param NextToken

A continuation token if this is not the first call to retrieve transactions.

rtype

dict

returns

Response Syntax

{
    'Transactions': [
        {
            'TransactionId': 'string',
            'TransactionStatus': 'ACTIVE'|'COMMITTED'|'ABORTED'|'COMMIT_IN_PROGRESS',
            'TransactionStartTime': datetime(2015, 1, 1),
            'TransactionEndTime': datetime(2015, 1, 1)
        },
    ],
    'NextToken': 'string'
}

Response Structure

  • (dict) --

    • Transactions (list) --

      A list of transactions. The record for each transaction is a TransactionDescription object.

      • (dict) --

        A structure that contains information about a transaction.

        • TransactionId (string) --

          The ID of the transaction.

        • TransactionStatus (string) --

          A status of ACTIVE, COMMITTED, or ABORTED.

        • TransactionStartTime (datetime) --

          The time when the transaction started.

        • TransactionEndTime (datetime) --

          The time when the transaction committed or aborted, if it is not currently active.

    • NextToken (string) --

      A continuation token indicating whether additional data is available.

CancelTransaction (new) Link ¶

Attempts to cancel the specified transaction. Returns an exception if the transaction was previously committed.

See also: AWS API Documentation

Request Syntax

client.cancel_transaction(
    TransactionId='string'
)
type TransactionId

string

param TransactionId

[REQUIRED]

The transaction to cancel.

rtype

dict

returns

Response Syntax

{}

Response Structure

  • (dict) --

CommitTransaction (new) Link ¶

Attempts to commit the specified transaction. Returns an exception if the transaction was previously aborted. This API action is idempotent if called multiple times for the same transaction.

See also: AWS API Documentation

Request Syntax

client.commit_transaction(
    TransactionId='string'
)
type TransactionId

string

param TransactionId

[REQUIRED]

The transaction to commit.

rtype

dict

returns

Response Syntax

{
    'TransactionStatus': 'ACTIVE'|'COMMITTED'|'ABORTED'|'COMMIT_IN_PROGRESS'
}

Response Structure

  • (dict) --

    • TransactionStatus (string) --

      The status of the transaction.

DeleteObjectsOnCancel (new) Link ¶

For a specific governed table, provides a list of Amazon S3 objects that will be written during the current transaction and that can be automatically deleted if the transaction is canceled. Without this call, no Amazon S3 objects are automatically deleted when a transaction cancels.

The Glue ETL library function write_dynamic_frame.from_catalog() includes an option to automatically call DeleteObjectsOnCancel before writes. For more information, see Rolling Back Amazon S3 Writes .

See also: AWS API Documentation

Request Syntax

client.delete_objects_on_cancel(
    CatalogId='string',
    DatabaseName='string',
    TableName='string',
    TransactionId='string',
    Objects=[
        {
            'Uri': 'string',
            'ETag': 'string'
        },
    ]
)
type CatalogId

string

param CatalogId

The Glue data catalog that contains the governed table. Defaults to the current account ID.

type DatabaseName

string

param DatabaseName

[REQUIRED]

The database that contains the governed table.

type TableName

string

param TableName

[REQUIRED]

The name of the governed table.

type TransactionId

string

param TransactionId

[REQUIRED]

ID of the transaction that the writes occur in.

type Objects

list

param Objects

[REQUIRED]

A list of VirtualObject structures, which indicates the Amazon S3 objects to be deleted if the transaction cancels.

  • (dict) --

    An object that defines an Amazon S3 object to be deleted if a transaction cancels, provided that VirtualPut was called before writing the object.

    • Uri (string) -- [REQUIRED]

      The path to the Amazon S3 object. Must start with s3://

    • ETag (string) --

      The ETag of the Amazon S3 object.

rtype

dict

returns

Response Syntax

{}

Response Structure

  • (dict) --

CreateDataCellsFilter (new) Link ¶

Creates a data cell filter to allow one to grant access to certain columns on certain rows.

See also: AWS API Documentation

Request Syntax

client.create_data_cells_filter(
    TableData={
        'TableCatalogId': 'string',
        'DatabaseName': 'string',
        'TableName': 'string',
        'Name': 'string',
        'RowFilter': {
            'FilterExpression': 'string',
            'AllRowsWildcard': {}

        },
        'ColumnNames': [
            'string',
        ],
        'ColumnWildcard': {
            'ExcludedColumnNames': [
                'string',
            ]
        }
    }
)
type TableData

dict

param TableData

[REQUIRED]

A DataCellsFilter structure containing information about the data cells filter.

  • TableCatalogId (string) -- [REQUIRED]

    The ID of the catalog to which the table belongs.

  • DatabaseName (string) -- [REQUIRED]

    A database in the Glue Data Catalog.

  • TableName (string) -- [REQUIRED]

    A table in the database.

  • Name (string) -- [REQUIRED]

    The name given by the user to the data filter cell.

  • RowFilter (dict) --

    A PartiQL predicate.

    • FilterExpression (string) --

      A filter expression.

    • AllRowsWildcard (dict) --

      A wildcard for all rows.

  • ColumnNames (list) --

    A list of column names.

    • (string) --

  • ColumnWildcard (dict) --

    A wildcard with exclusions.

    • ExcludedColumnNames (list) --

      Excludes column names. Any column with this name will be excluded.

      • (string) --

rtype

dict

returns

Response Syntax

{}

Response Structure

  • (dict) --

GetTableObjects (new) Link ¶

Returns the set of Amazon S3 objects that make up the specified governed table. A transaction ID or timestamp can be specified for time-travel queries.

See also: AWS API Documentation

Request Syntax

client.get_table_objects(
    CatalogId='string',
    DatabaseName='string',
    TableName='string',
    TransactionId='string',
    QueryAsOfTime=datetime(2015, 1, 1),
    PartitionPredicate='string',
    MaxResults=123,
    NextToken='string'
)
type CatalogId

string

param CatalogId

The catalog containing the governed table. Defaults to the caller’s account.

type DatabaseName

string

param DatabaseName

[REQUIRED]

The database containing the governed table.

type TableName

string

param TableName

[REQUIRED]

The governed table for which to retrieve objects.

type TransactionId

string

param TransactionId

The transaction ID at which to read the governed table contents. If this transaction has aborted, an error is returned. If not set, defaults to the most recent committed transaction. Cannot be specified along with QueryAsOfTime .

type QueryAsOfTime

datetime

param QueryAsOfTime

The time as of when to read the governed table contents. If not set, the most recent transaction commit time is used. Cannot be specified along with TransactionId .

type PartitionPredicate

string

param PartitionPredicate

A predicate to filter the objects returned based on the partition keys defined in the governed table.

  • The comparison operators supported are: =, >, <, >=, <=

  • The logical operators supported are: AND

  • The data types supported are integer, long, date(yyyy-MM-dd), timestamp(yyyy-MM-dd HH:mm:ssXXX or yyyy-MM-dd HH:mm:ss"), string and decimal.

type MaxResults

integer

param MaxResults

Specifies how many values to return in a page.

type NextToken

string

param NextToken

A continuation token if this is not the first call to retrieve these objects.

rtype

dict

returns

Response Syntax

{
    'Objects': [
        {
            'PartitionValues': [
                'string',
            ],
            'Objects': [
                {
                    'Uri': 'string',
                    'ETag': 'string',
                    'Size': 123
                },
            ]
        },
    ],
    'NextToken': 'string'
}

Response Structure

  • (dict) --

    • Objects (list) --

      A list of objects organized by partition keys.

      • (dict) --

        A structure containing a list of partition values and table objects.

        • PartitionValues (list) --

          A list of partition values.

          • (string) --

        • Objects (list) --

          A list of table objects

          • (dict) --

            Specifies the details of a governed table.

            • Uri (string) --

              The Amazon S3 location of the object.

            • ETag (string) --

              The Amazon S3 ETag of the object. Returned by GetTableObjects for validation and used to identify changes to the underlying data.

            • Size (integer) --

              The size of the Amazon S3 object in bytes.

    • NextToken (string) --

      A continuation token indicating whether additional data is available.

GetQueryState (new) Link ¶

Returns the state of a query previously submitted. Clients are expected to poll GetQueryState to monitor the current state of the planning before retrieving the work units. A query state is only visible to the principal that made the initial call to StartQueryPlanning .

See also: AWS API Documentation

Request Syntax

client.get_query_state(
    QueryId='string'
)
type QueryId

string

param QueryId

[REQUIRED]

The ID of the plan query operation.

rtype

dict

returns

Response Syntax

{
    'Error': 'string',
    'State': 'PENDING'|'WORKUNITS_AVAILABLE'|'ERROR'|'FINISHED'|'EXPIRED'
}

Response Structure

  • (dict) --

    A structure for the output.

    • Error (string) --

      An error message when the operation fails.

    • State (string) --

      The state of a query previously submitted. The possible states are:

      • PENDING: the query is pending.

      • WORKUNITS_AVAILABLE: some work units are ready for retrieval and execution.

      • FINISHED: the query planning finished successfully, and all work units are ready for retrieval and execution.

      • ERROR: an error occurred with the query, such as an invalid query ID or a backend error.

UpdateTableObjects (new) Link ¶

Updates the manifest of Amazon S3 objects that make up the specified governed table.

See also: AWS API Documentation

Request Syntax

client.update_table_objects(
    CatalogId='string',
    DatabaseName='string',
    TableName='string',
    TransactionId='string',
    WriteOperations=[
        {
            'AddObject': {
                'Uri': 'string',
                'ETag': 'string',
                'Size': 123,
                'PartitionValues': [
                    'string',
                ]
            },
            'DeleteObject': {
                'Uri': 'string',
                'ETag': 'string',
                'PartitionValues': [
                    'string',
                ]
            }
        },
    ]
)
type CatalogId

string

param CatalogId

The catalog containing the governed table to update. Defaults to the caller’s account ID.

type DatabaseName

string

param DatabaseName

[REQUIRED]

The database containing the governed table to update.

type TableName

string

param TableName

[REQUIRED]

The governed table to update.

type TransactionId

string

param TransactionId

[REQUIRED]

The transaction at which to do the write.

type WriteOperations

list

param WriteOperations

[REQUIRED]

A list of WriteOperation objects that define an object to add to or delete from the manifest for a governed table.

  • (dict) --

    Defines an object to add to or delete from a governed table.

    • AddObject (dict) --

      A new object to add to the governed table.

      • Uri (string) -- [REQUIRED]

        The Amazon S3 location of the object.

      • ETag (string) -- [REQUIRED]

        The Amazon S3 ETag of the object. Returned by GetTableObjects for validation and used to identify changes to the underlying data.

      • Size (integer) -- [REQUIRED]

        The size of the Amazon S3 object in bytes.

      • PartitionValues (list) --

        A list of partition values for the object. A value must be specified for each partition key associated with the table.

        The supported data types are integer, long, date(yyyy-MM-dd), timestamp(yyyy-MM-dd HH:mm:ssXXX or yyyy-MM-dd HH:mm:ss"), string and decimal.

        • (string) --

    • DeleteObject (dict) --

      An object to delete from the governed table.

      • Uri (string) -- [REQUIRED]

        The Amazon S3 location of the object to delete.

      • ETag (string) --

        The Amazon S3 ETag of the object. Returned by GetTableObjects for validation and used to identify changes to the underlying data.

      • PartitionValues (list) --

        A list of partition values for the object. A value must be specified for each partition key associated with the governed table.

        • (string) --

rtype

dict

returns

Response Syntax

{}

Response Structure

  • (dict) --

GetQueryStatistics (new) Link ¶

Retrieves statistics on the planning and execution of a query.

See also: AWS API Documentation

Request Syntax

client.get_query_statistics(
    QueryId='string'
)
type QueryId

string

param QueryId

[REQUIRED]

The ID of the plan query operation.

rtype

dict

returns

Response Syntax

{
    'ExecutionStatistics': {
        'AverageExecutionTimeMillis': 123,
        'DataScannedBytes': 123,
        'WorkUnitsExecutedCount': 123
    },
    'PlanningStatistics': {
        'EstimatedDataToScanBytes': 123,
        'PlanningTimeMillis': 123,
        'QueueTimeMillis': 123,
        'WorkUnitsGeneratedCount': 123
    },
    'QuerySubmissionTime': datetime(2015, 1, 1)
}

Response Structure

  • (dict) --

    • ExecutionStatistics (dict) --

      An ExecutionStatistics structure containing execution statistics.

      • AverageExecutionTimeMillis (integer) --

        The average time the request took to be executed.

      • DataScannedBytes (integer) --

        The amount of data that was scanned in bytes.

      • WorkUnitsExecutedCount (integer) --

        The number of work units executed.

    • PlanningStatistics (dict) --

      A PlanningStatistics structure containing query planning statistics.

      • EstimatedDataToScanBytes (integer) --

        An estimate of the data that was scanned in bytes.

      • PlanningTimeMillis (integer) --

        The time that it took to process the request.

      • QueueTimeMillis (integer) --

        The time the request was in queue to be processed.

      • WorkUnitsGeneratedCount (integer) --

        The number of work units generated.

    • QuerySubmissionTime (datetime) --

      The time that the query was submitted.

GetWorkUnits (new) Link ¶

Retrieves the work units generated by the StartQueryPlanning operation.

See also: AWS API Documentation

Request Syntax

client.get_work_units(
    NextToken='string',
    PageSize=123,
    QueryId='string'
)
type NextToken

string

param NextToken

A continuation token, if this is a continuation call.

type PageSize

integer

param PageSize

The size of each page to get in the Amazon Web Services service call. This does not affect the number of items returned in the command's output. Setting a smaller page size results in more calls to the Amazon Web Services service, retrieving fewer items in each call. This can help prevent the Amazon Web Services service calls from timing out.

type QueryId

string

param QueryId

[REQUIRED]

The ID of the plan query operation.

rtype

dict

returns

Response Syntax

{
    'NextToken': 'string',
    'QueryId': 'string',
    'WorkUnitRanges': [
        {
            'WorkUnitIdMax': 123,
            'WorkUnitIdMin': 123,
            'WorkUnitToken': 'string'
        },
    ]
}

Response Structure

  • (dict) --

    A structure for the output.

    • NextToken (string) --

      A continuation token for paginating the returned list of tokens, returned if the current segment of the list is not the last.

    • QueryId (string) --

      The ID of the plan query operation.

    • WorkUnitRanges (list) --

      A WorkUnitRangeList object that specifies the valid range of work unit IDs for querying the execution service.

      • (dict) --

        Defines the valid range of work unit IDs for querying the execution service.

        • WorkUnitIdMax (integer) --

          Defines the maximum work unit ID in the range. The maximum value is inclusive.

        • WorkUnitIdMin (integer) --

          Defines the minimum work unit ID in the range.

        • WorkUnitToken (string) --

          A work token used to query the execution service.

StartTransaction (new) Link ¶

Starts a new transaction and returns its transaction ID. Transaction IDs are opaque objects that you can use to identify a transaction.

See also: AWS API Documentation

Request Syntax

client.start_transaction(
    TransactionType='READ_AND_WRITE'|'READ_ONLY'
)
type TransactionType

string

param TransactionType

Indicates whether this transaction should be read only or read and write. Writes made using a read-only transaction ID will be rejected. Read-only transactions do not need to be committed.

rtype

dict

returns

Response Syntax

{
    'TransactionId': 'string'
}

Response Structure

  • (dict) --

    • TransactionId (string) --

      An opaque identifier for the transaction.

AddLFTagsToResource (updated) Link ¶
Changes (request)
{'Resource': {'DataCellsFilter': {'DatabaseName': 'string',
                                  'Name': 'string',
                                  'TableCatalogId': 'string',
                                  'TableName': 'string'}}}

Attaches one or more LF-tags to an existing resource.

See also: AWS API Documentation

Request Syntax

client.add_lf_tags_to_resource(
    CatalogId='string',
    Resource={
        'Catalog': {}
        ,
        'Database': {
            'CatalogId': 'string',
            'Name': 'string'
        },
        'Table': {
            'CatalogId': 'string',
            'DatabaseName': 'string',
            'Name': 'string',
            'TableWildcard': {}

        },
        'TableWithColumns': {
            'CatalogId': 'string',
            'DatabaseName': 'string',
            'Name': 'string',
            'ColumnNames': [
                'string',
            ],
            'ColumnWildcard': {
                'ExcludedColumnNames': [
                    'string',
                ]
            }
        },
        'DataLocation': {
            'CatalogId': 'string',
            'ResourceArn': 'string'
        },
        'DataCellsFilter': {
            'TableCatalogId': 'string',
            'DatabaseName': 'string',
            'TableName': 'string',
            'Name': 'string'
        },
        'LFTag': {
            'CatalogId': 'string',
            'TagKey': 'string',
            'TagValues': [
                'string',
            ]
        },
        'LFTagPolicy': {
            'CatalogId': 'string',
            'ResourceType': 'DATABASE'|'TABLE',
            'Expression': [
                {
                    'TagKey': 'string',
                    'TagValues': [
                        'string',
                    ]
                },
            ]
        }
    },
    LFTags=[
        {
            'CatalogId': 'string',
            'TagKey': 'string',
            'TagValues': [
                'string',
            ]
        },
    ]
)
type CatalogId

string

param CatalogId

The identifier for the Data Catalog. By default, the account ID. The Data Catalog is the persistent metadata store. It contains database definitions, table definitions, and other control information to manage your Lake Formation environment.

type Resource

dict

param Resource

[REQUIRED]

The database, table, or column resource to which to attach an LF-tag.

  • Catalog (dict) --

    The identifier for the Data Catalog. By default, the account ID. The Data Catalog is the persistent metadata store. It contains database definitions, table definitions, and other control information to manage your Lake Formation environment.

  • Database (dict) --

    The database for the resource. Unique to the Data Catalog. A database is a set of associated table definitions organized into a logical group. You can Grant and Revoke database permissions to a principal.

    • CatalogId (string) --

      The identifier for the Data Catalog. By default, it is the account ID of the caller.

    • Name (string) -- [REQUIRED]

      The name of the database resource. Unique to the Data Catalog.

  • Table (dict) --

    The table for the resource. A table is a metadata definition that represents your data. You can Grant and Revoke table privileges to a principal.

    • CatalogId (string) --

      The identifier for the Data Catalog. By default, it is the account ID of the caller.

    • DatabaseName (string) -- [REQUIRED]

      The name of the database for the table. Unique to a Data Catalog. A database is a set of associated table definitions organized into a logical group. You can Grant and Revoke database privileges to a principal.

    • Name (string) --

      The name of the table.

    • TableWildcard (dict) --

      A wildcard object representing every table under a database.

      At least one of TableResource$Name or TableResource$TableWildcard is required.

  • TableWithColumns (dict) --

    The table with columns for the resource. A principal with permissions to this resource can select metadata from the columns of a table in the Data Catalog and the underlying data in Amazon S3.

    • CatalogId (string) --

      The identifier for the Data Catalog. By default, it is the account ID of the caller.

    • DatabaseName (string) -- [REQUIRED]

      The name of the database for the table with columns resource. Unique to the Data Catalog. A database is a set of associated table definitions organized into a logical group. You can Grant and Revoke database privileges to a principal.

    • Name (string) -- [REQUIRED]

      The name of the table resource. A table is a metadata definition that represents your data. You can Grant and Revoke table privileges to a principal.

    • ColumnNames (list) --

      The list of column names for the table. At least one of ColumnNames or ColumnWildcard is required.

      • (string) --

    • ColumnWildcard (dict) --

      A wildcard specified by a ColumnWildcard object. At least one of ColumnNames or ColumnWildcard is required.

      • ExcludedColumnNames (list) --

        Excludes column names. Any column with this name will be excluded.

        • (string) --

  • DataLocation (dict) --

    The location of an Amazon S3 path where permissions are granted or revoked.

    • CatalogId (string) --

      The identifier for the Data Catalog where the location is registered with Lake Formation. By default, it is the account ID of the caller.

    • ResourceArn (string) -- [REQUIRED]

      The Amazon Resource Name (ARN) that uniquely identifies the data location resource.

  • DataCellsFilter (dict) --

    A data cell filter.

    • TableCatalogId (string) --

      The ID of the catalog to which the table belongs.

    • DatabaseName (string) --

      A database in the Glue Data Catalog.

    • TableName (string) --

      The name of the table.

    • Name (string) --

      The name of the data cells filter.

  • LFTag (dict) --

    The LF-tag key and values attached to a resource.

    • CatalogId (string) --

      The identifier for the Data Catalog. By default, the account ID. The Data Catalog is the persistent metadata store. It contains database definitions, table definitions, and other control information to manage your Lake Formation environment.

    • TagKey (string) -- [REQUIRED]

      The key-name for the LF-tag.

    • TagValues (list) -- [REQUIRED]

      A list of possible values an attribute can take.

      • (string) --

  • LFTagPolicy (dict) --

    A list of LF-tag conditions that define a resource's LF-tag policy.

    • CatalogId (string) --

      The identifier for the Data Catalog. By default, the account ID. The Data Catalog is the persistent metadata store. It contains database definitions, table definitions, and other control information to manage your Lake Formation environment.

    • ResourceType (string) -- [REQUIRED]

      The resource type for which the LF-tag policy applies.

    • Expression (list) -- [REQUIRED]

      A list of LF-tag conditions that apply to the resource's LF-tag policy.

      • (dict) --

        A structure that allows an admin to grant user permissions on certain conditions. For example, granting a role access to all columns that do not have the LF-tag 'PII' in tables that have the LF-tag 'Prod'.

        • TagKey (string) -- [REQUIRED]

          The key-name for the LF-tag.

        • TagValues (list) -- [REQUIRED]

          A list of possible values an attribute can take.

          • (string) --

type LFTags

list

param LFTags

[REQUIRED]

The LF-tags to attach to the resource.

  • (dict) --

    A structure containing an LF-tag key-value pair.

    • CatalogId (string) --

      The identifier for the Data Catalog. By default, the account ID. The Data Catalog is the persistent metadata store. It contains database definitions, table definitions, and other control information to manage your Lake Formation environment.

    • TagKey (string) -- [REQUIRED]

      The key-name for the LF-tag.

    • TagValues (list) -- [REQUIRED]

      A list of possible values an attribute can take.

      • (string) --

rtype

dict

returns

Response Syntax

{
    'Failures': [
        {
            'LFTag': {
                'CatalogId': 'string',
                'TagKey': 'string',
                'TagValues': [
                    'string',
                ]
            },
            'Error': {
                'ErrorCode': 'string',
                'ErrorMessage': 'string'
            }
        },
    ]
}

Response Structure

  • (dict) --

    • Failures (list) --

      A list of failures to tag the resource.

      • (dict) --

        A structure containing an error related to a TagResource or UnTagResource operation.

        • LFTag (dict) --

          The key-name of the LF-tag.

          • CatalogId (string) --

            The identifier for the Data Catalog. By default, the account ID. The Data Catalog is the persistent metadata store. It contains database definitions, table definitions, and other control information to manage your Lake Formation environment.

          • TagKey (string) --

            The key-name for the LF-tag.

          • TagValues (list) --

            A list of possible values an attribute can take.

            • (string) --

        • Error (dict) --

          An error that occurred with the attachment or detachment of the LF-tag.

          • ErrorCode (string) --

            The code associated with this error.

          • ErrorMessage (string) --

            A message describing the error.

BatchGrantPermissions (updated) Link ¶
Changes (request, response)
Request
{'Entries': {'Resource': {'DataCellsFilter': {'DatabaseName': 'string',
                                              'Name': 'string',
                                              'TableCatalogId': 'string',
                                              'TableName': 'string'}}}}
Response
{'Failures': {'RequestEntry': {'Resource': {'DataCellsFilter': {'DatabaseName': 'string',
                                                                'Name': 'string',
                                                                'TableCatalogId': 'string',
                                                                'TableName': 'string'}}}}}

Batch operation to grant permissions to the principal.

See also: AWS API Documentation

Request Syntax

client.batch_grant_permissions(
    CatalogId='string',
    Entries=[
        {
            'Id': 'string',
            'Principal': {
                'DataLakePrincipalIdentifier': 'string'
            },
            'Resource': {
                'Catalog': {}
                ,
                'Database': {
                    'CatalogId': 'string',
                    'Name': 'string'
                },
                'Table': {
                    'CatalogId': 'string',
                    'DatabaseName': 'string',
                    'Name': 'string',
                    'TableWildcard': {}

                },
                'TableWithColumns': {
                    'CatalogId': 'string',
                    'DatabaseName': 'string',
                    'Name': 'string',
                    'ColumnNames': [
                        'string',
                    ],
                    'ColumnWildcard': {
                        'ExcludedColumnNames': [
                            'string',
                        ]
                    }
                },
                'DataLocation': {
                    'CatalogId': 'string',
                    'ResourceArn': 'string'
                },
                'DataCellsFilter': {
                    'TableCatalogId': 'string',
                    'DatabaseName': 'string',
                    'TableName': 'string',
                    'Name': 'string'
                },
                'LFTag': {
                    'CatalogId': 'string',
                    'TagKey': 'string',
                    'TagValues': [
                        'string',
                    ]
                },
                'LFTagPolicy': {
                    'CatalogId': 'string',
                    'ResourceType': 'DATABASE'|'TABLE',
                    'Expression': [
                        {
                            'TagKey': 'string',
                            'TagValues': [
                                'string',
                            ]
                        },
                    ]
                }
            },
            'Permissions': [
                'ALL'|'SELECT'|'ALTER'|'DROP'|'DELETE'|'INSERT'|'DESCRIBE'|'CREATE_DATABASE'|'CREATE_TABLE'|'DATA_LOCATION_ACCESS'|'CREATE_TAG'|'ALTER_TAG'|'DELETE_TAG'|'DESCRIBE_TAG'|'ASSOCIATE_TAG',
            ],
            'PermissionsWithGrantOption': [
                'ALL'|'SELECT'|'ALTER'|'DROP'|'DELETE'|'INSERT'|'DESCRIBE'|'CREATE_DATABASE'|'CREATE_TABLE'|'DATA_LOCATION_ACCESS'|'CREATE_TAG'|'ALTER_TAG'|'DELETE_TAG'|'DESCRIBE_TAG'|'ASSOCIATE_TAG',
            ]
        },
    ]
)
type CatalogId

string

param CatalogId

The identifier for the Data Catalog. By default, the account ID. The Data Catalog is the persistent metadata store. It contains database definitions, table definitions, and other control information to manage your Lake Formation environment.

type Entries

list

param Entries

[REQUIRED]

A list of up to 20 entries for resource permissions to be granted by batch operation to the principal.

  • (dict) --

    A permission to a resource granted by batch operation to the principal.

    • Id (string) -- [REQUIRED]

      A unique identifier for the batch permissions request entry.

    • Principal (dict) --

      The principal to be granted a permission.

      • DataLakePrincipalIdentifier (string) --

        An identifier for the Lake Formation principal.

    • Resource (dict) --

      The resource to which the principal is to be granted a permission.

      • Catalog (dict) --

        The identifier for the Data Catalog. By default, the account ID. The Data Catalog is the persistent metadata store. It contains database definitions, table definitions, and other control information to manage your Lake Formation environment.

      • Database (dict) --

        The database for the resource. Unique to the Data Catalog. A database is a set of associated table definitions organized into a logical group. You can Grant and Revoke database permissions to a principal.

        • CatalogId (string) --

          The identifier for the Data Catalog. By default, it is the account ID of the caller.

        • Name (string) -- [REQUIRED]

          The name of the database resource. Unique to the Data Catalog.

      • Table (dict) --

        The table for the resource. A table is a metadata definition that represents your data. You can Grant and Revoke table privileges to a principal.

        • CatalogId (string) --

          The identifier for the Data Catalog. By default, it is the account ID of the caller.

        • DatabaseName (string) -- [REQUIRED]

          The name of the database for the table. Unique to a Data Catalog. A database is a set of associated table definitions organized into a logical group. You can Grant and Revoke database privileges to a principal.

        • Name (string) --

          The name of the table.

        • TableWildcard (dict) --

          A wildcard object representing every table under a database.

          At least one of TableResource$Name or TableResource$TableWildcard is required.

      • TableWithColumns (dict) --

        The table with columns for the resource. A principal with permissions to this resource can select metadata from the columns of a table in the Data Catalog and the underlying data in Amazon S3.

        • CatalogId (string) --

          The identifier for the Data Catalog. By default, it is the account ID of the caller.

        • DatabaseName (string) -- [REQUIRED]

          The name of the database for the table with columns resource. Unique to the Data Catalog. A database is a set of associated table definitions organized into a logical group. You can Grant and Revoke database privileges to a principal.

        • Name (string) -- [REQUIRED]

          The name of the table resource. A table is a metadata definition that represents your data. You can Grant and Revoke table privileges to a principal.

        • ColumnNames (list) --

          The list of column names for the table. At least one of ColumnNames or ColumnWildcard is required.

          • (string) --

        • ColumnWildcard (dict) --

          A wildcard specified by a ColumnWildcard object. At least one of ColumnNames or ColumnWildcard is required.

          • ExcludedColumnNames (list) --

            Excludes column names. Any column with this name will be excluded.

            • (string) --

      • DataLocation (dict) --

        The location of an Amazon S3 path where permissions are granted or revoked.

        • CatalogId (string) --

          The identifier for the Data Catalog where the location is registered with Lake Formation. By default, it is the account ID of the caller.

        • ResourceArn (string) -- [REQUIRED]

          The Amazon Resource Name (ARN) that uniquely identifies the data location resource.

      • DataCellsFilter (dict) --

        A data cell filter.

        • TableCatalogId (string) --

          The ID of the catalog to which the table belongs.

        • DatabaseName (string) --

          A database in the Glue Data Catalog.

        • TableName (string) --

          The name of the table.

        • Name (string) --

          The name of the data cells filter.

      • LFTag (dict) --

        The LF-tag key and values attached to a resource.

        • CatalogId (string) --

          The identifier for the Data Catalog. By default, the account ID. The Data Catalog is the persistent metadata store. It contains database definitions, table definitions, and other control information to manage your Lake Formation environment.

        • TagKey (string) -- [REQUIRED]

          The key-name for the LF-tag.

        • TagValues (list) -- [REQUIRED]

          A list of possible values an attribute can take.

          • (string) --

      • LFTagPolicy (dict) --

        A list of LF-tag conditions that define a resource's LF-tag policy.

        • CatalogId (string) --

          The identifier for the Data Catalog. By default, the account ID. The Data Catalog is the persistent metadata store. It contains database definitions, table definitions, and other control information to manage your Lake Formation environment.

        • ResourceType (string) -- [REQUIRED]

          The resource type for which the LF-tag policy applies.

        • Expression (list) -- [REQUIRED]

          A list of LF-tag conditions that apply to the resource's LF-tag policy.

          • (dict) --

            A structure that allows an admin to grant user permissions on certain conditions. For example, granting a role access to all columns that do not have the LF-tag 'PII' in tables that have the LF-tag 'Prod'.

            • TagKey (string) -- [REQUIRED]

              The key-name for the LF-tag.

            • TagValues (list) -- [REQUIRED]

              A list of possible values an attribute can take.

              • (string) --

    • Permissions (list) --

      The permissions to be granted.

      • (string) --

    • PermissionsWithGrantOption (list) --

      Indicates if the option to pass permissions is granted.

      • (string) --

rtype

dict

returns

Response Syntax

{
    'Failures': [
        {
            'RequestEntry': {
                'Id': 'string',
                'Principal': {
                    'DataLakePrincipalIdentifier': 'string'
                },
                'Resource': {
                    'Catalog': {},
                    'Database': {
                        'CatalogId': 'string',
                        'Name': 'string'
                    },
                    'Table': {
                        'CatalogId': 'string',
                        'DatabaseName': 'string',
                        'Name': 'string',
                        'TableWildcard': {}
                    },
                    'TableWithColumns': {
                        'CatalogId': 'string',
                        'DatabaseName': 'string',
                        'Name': 'string',
                        'ColumnNames': [
                            'string',
                        ],
                        'ColumnWildcard': {
                            'ExcludedColumnNames': [
                                'string',
                            ]
                        }
                    },
                    'DataLocation': {
                        'CatalogId': 'string',
                        'ResourceArn': 'string'
                    },
                    'DataCellsFilter': {
                        'TableCatalogId': 'string',
                        'DatabaseName': 'string',
                        'TableName': 'string',
                        'Name': 'string'
                    },
                    'LFTag': {
                        'CatalogId': 'string',
                        'TagKey': 'string',
                        'TagValues': [
                            'string',
                        ]
                    },
                    'LFTagPolicy': {
                        'CatalogId': 'string',
                        'ResourceType': 'DATABASE'|'TABLE',
                        'Expression': [
                            {
                                'TagKey': 'string',
                                'TagValues': [
                                    'string',
                                ]
                            },
                        ]
                    }
                },
                'Permissions': [
                    'ALL'|'SELECT'|'ALTER'|'DROP'|'DELETE'|'INSERT'|'DESCRIBE'|'CREATE_DATABASE'|'CREATE_TABLE'|'DATA_LOCATION_ACCESS'|'CREATE_TAG'|'ALTER_TAG'|'DELETE_TAG'|'DESCRIBE_TAG'|'ASSOCIATE_TAG',
                ],
                'PermissionsWithGrantOption': [
                    'ALL'|'SELECT'|'ALTER'|'DROP'|'DELETE'|'INSERT'|'DESCRIBE'|'CREATE_DATABASE'|'CREATE_TABLE'|'DATA_LOCATION_ACCESS'|'CREATE_TAG'|'ALTER_TAG'|'DELETE_TAG'|'DESCRIBE_TAG'|'ASSOCIATE_TAG',
                ]
            },
            'Error': {
                'ErrorCode': 'string',
                'ErrorMessage': 'string'
            }
        },
    ]
}

Response Structure

  • (dict) --

    • Failures (list) --

      A list of failures to grant permissions to the resources.

      • (dict) --

        A list of failures when performing a batch grant or batch revoke operation.

        • RequestEntry (dict) --

          An identifier for an entry of the batch request.

          • Id (string) --

            A unique identifier for the batch permissions request entry.

          • Principal (dict) --

            The principal to be granted a permission.

            • DataLakePrincipalIdentifier (string) --

              An identifier for the Lake Formation principal.

          • Resource (dict) --

            The resource to which the principal is to be granted a permission.

            • Catalog (dict) --

              The identifier for the Data Catalog. By default, the account ID. The Data Catalog is the persistent metadata store. It contains database definitions, table definitions, and other control information to manage your Lake Formation environment.

            • Database (dict) --

              The database for the resource. Unique to the Data Catalog. A database is a set of associated table definitions organized into a logical group. You can Grant and Revoke database permissions to a principal.

              • CatalogId (string) --

                The identifier for the Data Catalog. By default, it is the account ID of the caller.

              • Name (string) --

                The name of the database resource. Unique to the Data Catalog.

            • Table (dict) --

              The table for the resource. A table is a metadata definition that represents your data. You can Grant and Revoke table privileges to a principal.

              • CatalogId (string) --

                The identifier for the Data Catalog. By default, it is the account ID of the caller.

              • DatabaseName (string) --

                The name of the database for the table. Unique to a Data Catalog. A database is a set of associated table definitions organized into a logical group. You can Grant and Revoke database privileges to a principal.

              • Name (string) --

                The name of the table.

              • TableWildcard (dict) --

                A wildcard object representing every table under a database.

                At least one of TableResource$Name or TableResource$TableWildcard is required.

            • TableWithColumns (dict) --

              The table with columns for the resource. A principal with permissions to this resource can select metadata from the columns of a table in the Data Catalog and the underlying data in Amazon S3.

              • CatalogId (string) --

                The identifier for the Data Catalog. By default, it is the account ID of the caller.

              • DatabaseName (string) --

                The name of the database for the table with columns resource. Unique to the Data Catalog. A database is a set of associated table definitions organized into a logical group. You can Grant and Revoke database privileges to a principal.

              • Name (string) --

                The name of the table resource. A table is a metadata definition that represents your data. You can Grant and Revoke table privileges to a principal.

              • ColumnNames (list) --

                The list of column names for the table. At least one of ColumnNames or ColumnWildcard is required.

                • (string) --

              • ColumnWildcard (dict) --

                A wildcard specified by a ColumnWildcard object. At least one of ColumnNames or ColumnWildcard is required.

                • ExcludedColumnNames (list) --

                  Excludes column names. Any column with this name will be excluded.

                  • (string) --

            • DataLocation (dict) --

              The location of an Amazon S3 path where permissions are granted or revoked.

              • CatalogId (string) --

                The identifier for the Data Catalog where the location is registered with Lake Formation. By default, it is the account ID of the caller.

              • ResourceArn (string) --

                The Amazon Resource Name (ARN) that uniquely identifies the data location resource.

            • DataCellsFilter (dict) --

              A data cell filter.

              • TableCatalogId (string) --

                The ID of the catalog to which the table belongs.

              • DatabaseName (string) --

                A database in the Glue Data Catalog.

              • TableName (string) --

                The name of the table.

              • Name (string) --

                The name of the data cells filter.

            • LFTag (dict) --

              The LF-tag key and values attached to a resource.

              • CatalogId (string) --

                The identifier for the Data Catalog. By default, the account ID. The Data Catalog is the persistent metadata store. It contains database definitions, table definitions, and other control information to manage your Lake Formation environment.

              • TagKey (string) --

                The key-name for the LF-tag.

              • TagValues (list) --

                A list of possible values an attribute can take.

                • (string) --

            • LFTagPolicy (dict) --

              A list of LF-tag conditions that define a resource's LF-tag policy.

              • CatalogId (string) --

                The identifier for the Data Catalog. By default, the account ID. The Data Catalog is the persistent metadata store. It contains database definitions, table definitions, and other control information to manage your Lake Formation environment.

              • ResourceType (string) --

                The resource type for which the LF-tag policy applies.

              • Expression (list) --

                A list of LF-tag conditions that apply to the resource's LF-tag policy.

                • (dict) --

                  A structure that allows an admin to grant user permissions on certain conditions. For example, granting a role access to all columns that do not have the LF-tag 'PII' in tables that have the LF-tag 'Prod'.

                  • TagKey (string) --

                    The key-name for the LF-tag.

                  • TagValues (list) --

                    A list of possible values an attribute can take.

                    • (string) --

          • Permissions (list) --

            The permissions to be granted.

            • (string) --

          • PermissionsWithGrantOption (list) --

            Indicates if the option to pass permissions is granted.

            • (string) --

        • Error (dict) --

          An error message that applies to the failure of the entry.

          • ErrorCode (string) --

            The code associated with this error.

          • ErrorMessage (string) --

            A message describing the error.

BatchRevokePermissions (updated) Link ¶
Changes (request, response)
Request
{'Entries': {'Resource': {'DataCellsFilter': {'DatabaseName': 'string',
                                              'Name': 'string',
                                              'TableCatalogId': 'string',
                                              'TableName': 'string'}}}}
Response
{'Failures': {'RequestEntry': {'Resource': {'DataCellsFilter': {'DatabaseName': 'string',
                                                                'Name': 'string',
                                                                'TableCatalogId': 'string',
                                                                'TableName': 'string'}}}}}

Batch operation to revoke permissions from the principal.

See also: AWS API Documentation

Request Syntax

client.batch_revoke_permissions(
    CatalogId='string',
    Entries=[
        {
            'Id': 'string',
            'Principal': {
                'DataLakePrincipalIdentifier': 'string'
            },
            'Resource': {
                'Catalog': {}
                ,
                'Database': {
                    'CatalogId': 'string',
                    'Name': 'string'
                },
                'Table': {
                    'CatalogId': 'string',
                    'DatabaseName': 'string',
                    'Name': 'string',
                    'TableWildcard': {}

                },
                'TableWithColumns': {
                    'CatalogId': 'string',
                    'DatabaseName': 'string',
                    'Name': 'string',
                    'ColumnNames': [
                        'string',
                    ],
                    'ColumnWildcard': {
                        'ExcludedColumnNames': [
                            'string',
                        ]
                    }
                },
                'DataLocation': {
                    'CatalogId': 'string',
                    'ResourceArn': 'string'
                },
                'DataCellsFilter': {
                    'TableCatalogId': 'string',
                    'DatabaseName': 'string',
                    'TableName': 'string',
                    'Name': 'string'
                },
                'LFTag': {
                    'CatalogId': 'string',
                    'TagKey': 'string',
                    'TagValues': [
                        'string',
                    ]
                },
                'LFTagPolicy': {
                    'CatalogId': 'string',
                    'ResourceType': 'DATABASE'|'TABLE',
                    'Expression': [
                        {
                            'TagKey': 'string',
                            'TagValues': [
                                'string',
                            ]
                        },
                    ]
                }
            },
            'Permissions': [
                'ALL'|'SELECT'|'ALTER'|'DROP'|'DELETE'|'INSERT'|'DESCRIBE'|'CREATE_DATABASE'|'CREATE_TABLE'|'DATA_LOCATION_ACCESS'|'CREATE_TAG'|'ALTER_TAG'|'DELETE_TAG'|'DESCRIBE_TAG'|'ASSOCIATE_TAG',
            ],
            'PermissionsWithGrantOption': [
                'ALL'|'SELECT'|'ALTER'|'DROP'|'DELETE'|'INSERT'|'DESCRIBE'|'CREATE_DATABASE'|'CREATE_TABLE'|'DATA_LOCATION_ACCESS'|'CREATE_TAG'|'ALTER_TAG'|'DELETE_TAG'|'DESCRIBE_TAG'|'ASSOCIATE_TAG',
            ]
        },
    ]
)
type CatalogId

string

param CatalogId

The identifier for the Data Catalog. By default, the account ID. The Data Catalog is the persistent metadata store. It contains database definitions, table definitions, and other control information to manage your Lake Formation environment.

type Entries

list

param Entries

[REQUIRED]

A list of up to 20 entries for resource permissions to be revoked by batch operation to the principal.

  • (dict) --

    A permission to a resource granted by batch operation to the principal.

    • Id (string) -- [REQUIRED]

      A unique identifier for the batch permissions request entry.

    • Principal (dict) --

      The principal to be granted a permission.

      • DataLakePrincipalIdentifier (string) --

        An identifier for the Lake Formation principal.

    • Resource (dict) --

      The resource to which the principal is to be granted a permission.

      • Catalog (dict) --

        The identifier for the Data Catalog. By default, the account ID. The Data Catalog is the persistent metadata store. It contains database definitions, table definitions, and other control information to manage your Lake Formation environment.

      • Database (dict) --

        The database for the resource. Unique to the Data Catalog. A database is a set of associated table definitions organized into a logical group. You can Grant and Revoke database permissions to a principal.

        • CatalogId (string) --

          The identifier for the Data Catalog. By default, it is the account ID of the caller.

        • Name (string) -- [REQUIRED]

          The name of the database resource. Unique to the Data Catalog.

      • Table (dict) --

        The table for the resource. A table is a metadata definition that represents your data. You can Grant and Revoke table privileges to a principal.

        • CatalogId (string) --

          The identifier for the Data Catalog. By default, it is the account ID of the caller.

        • DatabaseName (string) -- [REQUIRED]

          The name of the database for the table. Unique to a Data Catalog. A database is a set of associated table definitions organized into a logical group. You can Grant and Revoke database privileges to a principal.

        • Name (string) --

          The name of the table.

        • TableWildcard (dict) --

          A wildcard object representing every table under a database.

          At least one of TableResource$Name or TableResource$TableWildcard is required.

      • TableWithColumns (dict) --

        The table with columns for the resource. A principal with permissions to this resource can select metadata from the columns of a table in the Data Catalog and the underlying data in Amazon S3.

        • CatalogId (string) --

          The identifier for the Data Catalog. By default, it is the account ID of the caller.

        • DatabaseName (string) -- [REQUIRED]

          The name of the database for the table with columns resource. Unique to the Data Catalog. A database is a set of associated table definitions organized into a logical group. You can Grant and Revoke database privileges to a principal.

        • Name (string) -- [REQUIRED]

          The name of the table resource. A table is a metadata definition that represents your data. You can Grant and Revoke table privileges to a principal.

        • ColumnNames (list) --

          The list of column names for the table. At least one of ColumnNames or ColumnWildcard is required.

          • (string) --

        • ColumnWildcard (dict) --

          A wildcard specified by a ColumnWildcard object. At least one of ColumnNames or ColumnWildcard is required.

          • ExcludedColumnNames (list) --

            Excludes column names. Any column with this name will be excluded.

            • (string) --

      • DataLocation (dict) --

        The location of an Amazon S3 path where permissions are granted or revoked.

        • CatalogId (string) --

          The identifier for the Data Catalog where the location is registered with Lake Formation. By default, it is the account ID of the caller.

        • ResourceArn (string) -- [REQUIRED]

          The Amazon Resource Name (ARN) that uniquely identifies the data location resource.

      • DataCellsFilter (dict) --

        A data cell filter.

        • TableCatalogId (string) --

          The ID of the catalog to which the table belongs.

        • DatabaseName (string) --

          A database in the Glue Data Catalog.

        • TableName (string) --

          The name of the table.

        • Name (string) --

          The name of the data cells filter.

      • LFTag (dict) --

        The LF-tag key and values attached to a resource.

        • CatalogId (string) --

          The identifier for the Data Catalog. By default, the account ID. The Data Catalog is the persistent metadata store. It contains database definitions, table definitions, and other control information to manage your Lake Formation environment.

        • TagKey (string) -- [REQUIRED]

          The key-name for the LF-tag.

        • TagValues (list) -- [REQUIRED]

          A list of possible values an attribute can take.

          • (string) --

      • LFTagPolicy (dict) --

        A list of LF-tag conditions that define a resource's LF-tag policy.

        • CatalogId (string) --

          The identifier for the Data Catalog. By default, the account ID. The Data Catalog is the persistent metadata store. It contains database definitions, table definitions, and other control information to manage your Lake Formation environment.

        • ResourceType (string) -- [REQUIRED]

          The resource type for which the LF-tag policy applies.

        • Expression (list) -- [REQUIRED]

          A list of LF-tag conditions that apply to the resource's LF-tag policy.

          • (dict) --

            A structure that allows an admin to grant user permissions on certain conditions. For example, granting a role access to all columns that do not have the LF-tag 'PII' in tables that have the LF-tag 'Prod'.

            • TagKey (string) -- [REQUIRED]

              The key-name for the LF-tag.

            • TagValues (list) -- [REQUIRED]

              A list of possible values an attribute can take.

              • (string) --

    • Permissions (list) --

      The permissions to be granted.

      • (string) --

    • PermissionsWithGrantOption (list) --

      Indicates if the option to pass permissions is granted.

      • (string) --

rtype

dict

returns

Response Syntax

{
    'Failures': [
        {
            'RequestEntry': {
                'Id': 'string',
                'Principal': {
                    'DataLakePrincipalIdentifier': 'string'
                },
                'Resource': {
                    'Catalog': {},
                    'Database': {
                        'CatalogId': 'string',
                        'Name': 'string'
                    },
                    'Table': {
                        'CatalogId': 'string',
                        'DatabaseName': 'string',
                        'Name': 'string',
                        'TableWildcard': {}
                    },
                    'TableWithColumns': {
                        'CatalogId': 'string',
                        'DatabaseName': 'string',
                        'Name': 'string',
                        'ColumnNames': [
                            'string',
                        ],
                        'ColumnWildcard': {
                            'ExcludedColumnNames': [
                                'string',
                            ]
                        }
                    },
                    'DataLocation': {
                        'CatalogId': 'string',
                        'ResourceArn': 'string'
                    },
                    'DataCellsFilter': {
                        'TableCatalogId': 'string',
                        'DatabaseName': 'string',
                        'TableName': 'string',
                        'Name': 'string'
                    },
                    'LFTag': {
                        'CatalogId': 'string',
                        'TagKey': 'string',
                        'TagValues': [
                            'string',
                        ]
                    },
                    'LFTagPolicy': {
                        'CatalogId': 'string',
                        'ResourceType': 'DATABASE'|'TABLE',
                        'Expression': [
                            {
                                'TagKey': 'string',
                                'TagValues': [
                                    'string',
                                ]
                            },
                        ]
                    }
                },
                'Permissions': [
                    'ALL'|'SELECT'|'ALTER'|'DROP'|'DELETE'|'INSERT'|'DESCRIBE'|'CREATE_DATABASE'|'CREATE_TABLE'|'DATA_LOCATION_ACCESS'|'CREATE_TAG'|'ALTER_TAG'|'DELETE_TAG'|'DESCRIBE_TAG'|'ASSOCIATE_TAG',
                ],
                'PermissionsWithGrantOption': [
                    'ALL'|'SELECT'|'ALTER'|'DROP'|'DELETE'|'INSERT'|'DESCRIBE'|'CREATE_DATABASE'|'CREATE_TABLE'|'DATA_LOCATION_ACCESS'|'CREATE_TAG'|'ALTER_TAG'|'DELETE_TAG'|'DESCRIBE_TAG'|'ASSOCIATE_TAG',
                ]
            },
            'Error': {
                'ErrorCode': 'string',
                'ErrorMessage': 'string'
            }
        },
    ]
}

Response Structure

  • (dict) --

    • Failures (list) --

      A list of failures to revoke permissions to the resources.

      • (dict) --

        A list of failures when performing a batch grant or batch revoke operation.

        • RequestEntry (dict) --

          An identifier for an entry of the batch request.

          • Id (string) --

            A unique identifier for the batch permissions request entry.

          • Principal (dict) --

            The principal to be granted a permission.

            • DataLakePrincipalIdentifier (string) --

              An identifier for the Lake Formation principal.

          • Resource (dict) --

            The resource to which the principal is to be granted a permission.

            • Catalog (dict) --

              The identifier for the Data Catalog. By default, the account ID. The Data Catalog is the persistent metadata store. It contains database definitions, table definitions, and other control information to manage your Lake Formation environment.

            • Database (dict) --

              The database for the resource. Unique to the Data Catalog. A database is a set of associated table definitions organized into a logical group. You can Grant and Revoke database permissions to a principal.

              • CatalogId (string) --

                The identifier for the Data Catalog. By default, it is the account ID of the caller.

              • Name (string) --

                The name of the database resource. Unique to the Data Catalog.

            • Table (dict) --

              The table for the resource. A table is a metadata definition that represents your data. You can Grant and Revoke table privileges to a principal.

              • CatalogId (string) --

                The identifier for the Data Catalog. By default, it is the account ID of the caller.

              • DatabaseName (string) --

                The name of the database for the table. Unique to a Data Catalog. A database is a set of associated table definitions organized into a logical group. You can Grant and Revoke database privileges to a principal.

              • Name (string) --

                The name of the table.

              • TableWildcard (dict) --

                A wildcard object representing every table under a database.

                At least one of TableResource$Name or TableResource$TableWildcard is required.

            • TableWithColumns (dict) --

              The table with columns for the resource. A principal with permissions to this resource can select metadata from the columns of a table in the Data Catalog and the underlying data in Amazon S3.

              • CatalogId (string) --

                The identifier for the Data Catalog. By default, it is the account ID of the caller.

              • DatabaseName (string) --

                The name of the database for the table with columns resource. Unique to the Data Catalog. A database is a set of associated table definitions organized into a logical group. You can Grant and Revoke database privileges to a principal.

              • Name (string) --

                The name of the table resource. A table is a metadata definition that represents your data. You can Grant and Revoke table privileges to a principal.

              • ColumnNames (list) --

                The list of column names for the table. At least one of ColumnNames or ColumnWildcard is required.

                • (string) --

              • ColumnWildcard (dict) --

                A wildcard specified by a ColumnWildcard object. At least one of ColumnNames or ColumnWildcard is required.

                • ExcludedColumnNames (list) --

                  Excludes column names. Any column with this name will be excluded.

                  • (string) --

            • DataLocation (dict) --

              The location of an Amazon S3 path where permissions are granted or revoked.

              • CatalogId (string) --

                The identifier for the Data Catalog where the location is registered with Lake Formation. By default, it is the account ID of the caller.

              • ResourceArn (string) --

                The Amazon Resource Name (ARN) that uniquely identifies the data location resource.

            • DataCellsFilter (dict) --

              A data cell filter.

              • TableCatalogId (string) --

                The ID of the catalog to which the table belongs.

              • DatabaseName (string) --

                A database in the Glue Data Catalog.

              • TableName (string) --

                The name of the table.

              • Name (string) --

                The name of the data cells filter.

            • LFTag (dict) --

              The LF-tag key and values attached to a resource.

              • CatalogId (string) --

                The identifier for the Data Catalog. By default, the account ID. The Data Catalog is the persistent metadata store. It contains database definitions, table definitions, and other control information to manage your Lake Formation environment.

              • TagKey (string) --

                The key-name for the LF-tag.

              • TagValues (list) --

                A list of possible values an attribute can take.

                • (string) --

            • LFTagPolicy (dict) --

              A list of LF-tag conditions that define a resource's LF-tag policy.

              • CatalogId (string) --

                The identifier for the Data Catalog. By default, the account ID. The Data Catalog is the persistent metadata store. It contains database definitions, table definitions, and other control information to manage your Lake Formation environment.

              • ResourceType (string) --

                The resource type for which the LF-tag policy applies.

              • Expression (list) --

                A list of LF-tag conditions that apply to the resource's LF-tag policy.

                • (dict) --

                  A structure that allows an admin to grant user permissions on certain conditions. For example, granting a role access to all columns that do not have the LF-tag 'PII' in tables that have the LF-tag 'Prod'.

                  • TagKey (string) --

                    The key-name for the LF-tag.

                  • TagValues (list) --

                    A list of possible values an attribute can take.

                    • (string) --

          • Permissions (list) --

            The permissions to be granted.

            • (string) --

          • PermissionsWithGrantOption (list) --

            Indicates if the option to pass permissions is granted.

            • (string) --

        • Error (dict) --

          An error message that applies to the failure of the entry.

          • ErrorCode (string) --

            The code associated with this error.

          • ErrorMessage (string) --

            A message describing the error.

GetEffectivePermissionsForPath (updated) Link ¶
Changes (response)
{'Permissions': {'Resource': {'DataCellsFilter': {'DatabaseName': 'string',
                                                  'Name': 'string',
                                                  'TableCatalogId': 'string',
                                                  'TableName': 'string'}}}}

Returns the Lake Formation permissions for a specified table or database resource located at a path in Amazon S3. GetEffectivePermissionsForPath will not return databases and tables if the catalog is encrypted.

See also: AWS API Documentation

Request Syntax

client.get_effective_permissions_for_path(
    CatalogId='string',
    ResourceArn='string',
    NextToken='string',
    MaxResults=123
)
type CatalogId

string

param CatalogId

The identifier for the Data Catalog. By default, the account ID. The Data Catalog is the persistent metadata store. It contains database definitions, table definitions, and other control information to manage your Lake Formation environment.

type ResourceArn

string

param ResourceArn

[REQUIRED]

The Amazon Resource Name (ARN) of the resource for which you want to get permissions.

type NextToken

string

param NextToken

A continuation token, if this is not the first call to retrieve this list.

type MaxResults

integer

param MaxResults

The maximum number of results to return.

rtype

dict

returns

Response Syntax

{
    'Permissions': [
        {
            'Principal': {
                'DataLakePrincipalIdentifier': 'string'
            },
            'Resource': {
                'Catalog': {},
                'Database': {
                    'CatalogId': 'string',
                    'Name': 'string'
                },
                'Table': {
                    'CatalogId': 'string',
                    'DatabaseName': 'string',
                    'Name': 'string',
                    'TableWildcard': {}
                },
                'TableWithColumns': {
                    'CatalogId': 'string',
                    'DatabaseName': 'string',
                    'Name': 'string',
                    'ColumnNames': [
                        'string',
                    ],
                    'ColumnWildcard': {
                        'ExcludedColumnNames': [
                            'string',
                        ]
                    }
                },
                'DataLocation': {
                    'CatalogId': 'string',
                    'ResourceArn': 'string'
                },
                'DataCellsFilter': {
                    'TableCatalogId': 'string',
                    'DatabaseName': 'string',
                    'TableName': 'string',
                    'Name': 'string'
                },
                'LFTag': {
                    'CatalogId': 'string',
                    'TagKey': 'string',
                    'TagValues': [
                        'string',
                    ]
                },
                'LFTagPolicy': {
                    'CatalogId': 'string',
                    'ResourceType': 'DATABASE'|'TABLE',
                    'Expression': [
                        {
                            'TagKey': 'string',
                            'TagValues': [
                                'string',
                            ]
                        },
                    ]
                }
            },
            'Permissions': [
                'ALL'|'SELECT'|'ALTER'|'DROP'|'DELETE'|'INSERT'|'DESCRIBE'|'CREATE_DATABASE'|'CREATE_TABLE'|'DATA_LOCATION_ACCESS'|'CREATE_TAG'|'ALTER_TAG'|'DELETE_TAG'|'DESCRIBE_TAG'|'ASSOCIATE_TAG',
            ],
            'PermissionsWithGrantOption': [
                'ALL'|'SELECT'|'ALTER'|'DROP'|'DELETE'|'INSERT'|'DESCRIBE'|'CREATE_DATABASE'|'CREATE_TABLE'|'DATA_LOCATION_ACCESS'|'CREATE_TAG'|'ALTER_TAG'|'DELETE_TAG'|'DESCRIBE_TAG'|'ASSOCIATE_TAG',
            ],
            'AdditionalDetails': {
                'ResourceShare': [
                    'string',
                ]
            }
        },
    ],
    'NextToken': 'string'
}

Response Structure

  • (dict) --

    • Permissions (list) --

      A list of the permissions for the specified table or database resource located at the path in Amazon S3.

      • (dict) --

        The permissions granted or revoked on a resource.

        • Principal (dict) --

          The Data Lake principal to be granted or revoked permissions.

          • DataLakePrincipalIdentifier (string) --

            An identifier for the Lake Formation principal.

        • Resource (dict) --

          The resource where permissions are to be granted or revoked.

          • Catalog (dict) --

            The identifier for the Data Catalog. By default, the account ID. The Data Catalog is the persistent metadata store. It contains database definitions, table definitions, and other control information to manage your Lake Formation environment.

          • Database (dict) --

            The database for the resource. Unique to the Data Catalog. A database is a set of associated table definitions organized into a logical group. You can Grant and Revoke database permissions to a principal.

            • CatalogId (string) --

              The identifier for the Data Catalog. By default, it is the account ID of the caller.

            • Name (string) --

              The name of the database resource. Unique to the Data Catalog.

          • Table (dict) --

            The table for the resource. A table is a metadata definition that represents your data. You can Grant and Revoke table privileges to a principal.

            • CatalogId (string) --

              The identifier for the Data Catalog. By default, it is the account ID of the caller.

            • DatabaseName (string) --

              The name of the database for the table. Unique to a Data Catalog. A database is a set of associated table definitions organized into a logical group. You can Grant and Revoke database privileges to a principal.

            • Name (string) --

              The name of the table.

            • TableWildcard (dict) --

              A wildcard object representing every table under a database.

              At least one of TableResource$Name or TableResource$TableWildcard is required.

          • TableWithColumns (dict) --

            The table with columns for the resource. A principal with permissions to this resource can select metadata from the columns of a table in the Data Catalog and the underlying data in Amazon S3.

            • CatalogId (string) --

              The identifier for the Data Catalog. By default, it is the account ID of the caller.

            • DatabaseName (string) --

              The name of the database for the table with columns resource. Unique to the Data Catalog. A database is a set of associated table definitions organized into a logical group. You can Grant and Revoke database privileges to a principal.

            • Name (string) --

              The name of the table resource. A table is a metadata definition that represents your data. You can Grant and Revoke table privileges to a principal.

            • ColumnNames (list) --

              The list of column names for the table. At least one of ColumnNames or ColumnWildcard is required.

              • (string) --

            • ColumnWildcard (dict) --

              A wildcard specified by a ColumnWildcard object. At least one of ColumnNames or ColumnWildcard is required.

              • ExcludedColumnNames (list) --

                Excludes column names. Any column with this name will be excluded.

                • (string) --

          • DataLocation (dict) --

            The location of an Amazon S3 path where permissions are granted or revoked.

            • CatalogId (string) --

              The identifier for the Data Catalog where the location is registered with Lake Formation. By default, it is the account ID of the caller.

            • ResourceArn (string) --

              The Amazon Resource Name (ARN) that uniquely identifies the data location resource.

          • DataCellsFilter (dict) --

            A data cell filter.

            • TableCatalogId (string) --

              The ID of the catalog to which the table belongs.

            • DatabaseName (string) --

              A database in the Glue Data Catalog.

            • TableName (string) --

              The name of the table.

            • Name (string) --

              The name of the data cells filter.

          • LFTag (dict) --

            The LF-tag key and values attached to a resource.

            • CatalogId (string) --

              The identifier for the Data Catalog. By default, the account ID. The Data Catalog is the persistent metadata store. It contains database definitions, table definitions, and other control information to manage your Lake Formation environment.

            • TagKey (string) --

              The key-name for the LF-tag.

            • TagValues (list) --

              A list of possible values an attribute can take.

              • (string) --

          • LFTagPolicy (dict) --

            A list of LF-tag conditions that define a resource's LF-tag policy.

            • CatalogId (string) --

              The identifier for the Data Catalog. By default, the account ID. The Data Catalog is the persistent metadata store. It contains database definitions, table definitions, and other control information to manage your Lake Formation environment.

            • ResourceType (string) --

              The resource type for which the LF-tag policy applies.

            • Expression (list) --

              A list of LF-tag conditions that apply to the resource's LF-tag policy.

              • (dict) --

                A structure that allows an admin to grant user permissions on certain conditions. For example, granting a role access to all columns that do not have the LF-tag 'PII' in tables that have the LF-tag 'Prod'.

                • TagKey (string) --

                  The key-name for the LF-tag.

                • TagValues (list) --

                  A list of possible values an attribute can take.

                  • (string) --

        • Permissions (list) --

          The permissions to be granted or revoked on the resource.

          • (string) --

        • PermissionsWithGrantOption (list) --

          Indicates whether to grant the ability to grant permissions (as a subset of permissions granted).

          • (string) --

        • AdditionalDetails (dict) --

          This attribute can be used to return any additional details of PrincipalResourcePermissions . Currently returns only as a RAM resource share ARN.

          • ResourceShare (list) --

            A resource share ARN for a catalog resource shared through RAM.

            • (string) --

    • NextToken (string) --

      A continuation token, if this is not the first call to retrieve this list.

GetResourceLFTags (updated) Link ¶
Changes (request)
{'Resource': {'DataCellsFilter': {'DatabaseName': 'string',
                                  'Name': 'string',
                                  'TableCatalogId': 'string',
                                  'TableName': 'string'}}}

Returns the LF-tags applied to a resource.

See also: AWS API Documentation

Request Syntax

client.get_resource_lf_tags(
    CatalogId='string',
    Resource={
        'Catalog': {}
        ,
        'Database': {
            'CatalogId': 'string',
            'Name': 'string'
        },
        'Table': {
            'CatalogId': 'string',
            'DatabaseName': 'string',
            'Name': 'string',
            'TableWildcard': {}

        },
        'TableWithColumns': {
            'CatalogId': 'string',
            'DatabaseName': 'string',
            'Name': 'string',
            'ColumnNames': [
                'string',
            ],
            'ColumnWildcard': {
                'ExcludedColumnNames': [
                    'string',
                ]
            }
        },
        'DataLocation': {
            'CatalogId': 'string',
            'ResourceArn': 'string'
        },
        'DataCellsFilter': {
            'TableCatalogId': 'string',
            'DatabaseName': 'string',
            'TableName': 'string',
            'Name': 'string'
        },
        'LFTag': {
            'CatalogId': 'string',
            'TagKey': 'string',
            'TagValues': [
                'string',
            ]
        },
        'LFTagPolicy': {
            'CatalogId': 'string',
            'ResourceType': 'DATABASE'|'TABLE',
            'Expression': [
                {
                    'TagKey': 'string',
                    'TagValues': [
                        'string',
                    ]
                },
            ]
        }
    },
    ShowAssignedLFTags=True|False
)
type CatalogId

string

param CatalogId

The identifier for the Data Catalog. By default, the account ID. The Data Catalog is the persistent metadata store. It contains database definitions, table definitions, and other control information to manage your Lake Formation environment.

type Resource

dict

param Resource

[REQUIRED]

The database, table, or column resource for which you want to return LF-tags.

  • Catalog (dict) --

    The identifier for the Data Catalog. By default, the account ID. The Data Catalog is the persistent metadata store. It contains database definitions, table definitions, and other control information to manage your Lake Formation environment.

  • Database (dict) --

    The database for the resource. Unique to the Data Catalog. A database is a set of associated table definitions organized into a logical group. You can Grant and Revoke database permissions to a principal.

    • CatalogId (string) --

      The identifier for the Data Catalog. By default, it is the account ID of the caller.

    • Name (string) -- [REQUIRED]

      The name of the database resource. Unique to the Data Catalog.

  • Table (dict) --

    The table for the resource. A table is a metadata definition that represents your data. You can Grant and Revoke table privileges to a principal.

    • CatalogId (string) --

      The identifier for the Data Catalog. By default, it is the account ID of the caller.

    • DatabaseName (string) -- [REQUIRED]

      The name of the database for the table. Unique to a Data Catalog. A database is a set of associated table definitions organized into a logical group. You can Grant and Revoke database privileges to a principal.

    • Name (string) --

      The name of the table.

    • TableWildcard (dict) --

      A wildcard object representing every table under a database.

      At least one of TableResource$Name or TableResource$TableWildcard is required.

  • TableWithColumns (dict) --

    The table with columns for the resource. A principal with permissions to this resource can select metadata from the columns of a table in the Data Catalog and the underlying data in Amazon S3.

    • CatalogId (string) --

      The identifier for the Data Catalog. By default, it is the account ID of the caller.

    • DatabaseName (string) -- [REQUIRED]

      The name of the database for the table with columns resource. Unique to the Data Catalog. A database is a set of associated table definitions organized into a logical group. You can Grant and Revoke database privileges to a principal.

    • Name (string) -- [REQUIRED]

      The name of the table resource. A table is a metadata definition that represents your data. You can Grant and Revoke table privileges to a principal.

    • ColumnNames (list) --

      The list of column names for the table. At least one of ColumnNames or ColumnWildcard is required.

      • (string) --

    • ColumnWildcard (dict) --

      A wildcard specified by a ColumnWildcard object. At least one of ColumnNames or ColumnWildcard is required.

      • ExcludedColumnNames (list) --

        Excludes column names. Any column with this name will be excluded.

        • (string) --

  • DataLocation (dict) --

    The location of an Amazon S3 path where permissions are granted or revoked.

    • CatalogId (string) --

      The identifier for the Data Catalog where the location is registered with Lake Formation. By default, it is the account ID of the caller.

    • ResourceArn (string) -- [REQUIRED]

      The Amazon Resource Name (ARN) that uniquely identifies the data location resource.

  • DataCellsFilter (dict) --

    A data cell filter.

    • TableCatalogId (string) --

      The ID of the catalog to which the table belongs.

    • DatabaseName (string) --

      A database in the Glue Data Catalog.

    • TableName (string) --

      The name of the table.

    • Name (string) --

      The name of the data cells filter.

  • LFTag (dict) --

    The LF-tag key and values attached to a resource.

    • CatalogId (string) --

      The identifier for the Data Catalog. By default, the account ID. The Data Catalog is the persistent metadata store. It contains database definitions, table definitions, and other control information to manage your Lake Formation environment.

    • TagKey (string) -- [REQUIRED]

      The key-name for the LF-tag.

    • TagValues (list) -- [REQUIRED]

      A list of possible values an attribute can take.

      • (string) --

  • LFTagPolicy (dict) --

    A list of LF-tag conditions that define a resource's LF-tag policy.

    • CatalogId (string) --

      The identifier for the Data Catalog. By default, the account ID. The Data Catalog is the persistent metadata store. It contains database definitions, table definitions, and other control information to manage your Lake Formation environment.

    • ResourceType (string) -- [REQUIRED]

      The resource type for which the LF-tag policy applies.

    • Expression (list) -- [REQUIRED]

      A list of LF-tag conditions that apply to the resource's LF-tag policy.

      • (dict) --

        A structure that allows an admin to grant user permissions on certain conditions. For example, granting a role access to all columns that do not have the LF-tag 'PII' in tables that have the LF-tag 'Prod'.

        • TagKey (string) -- [REQUIRED]

          The key-name for the LF-tag.

        • TagValues (list) -- [REQUIRED]

          A list of possible values an attribute can take.

          • (string) --

type ShowAssignedLFTags

boolean

param ShowAssignedLFTags

Indicates whether to show the assigned LF-tags.

rtype

dict

returns

Response Syntax

{
    'LFTagOnDatabase': [
        {
            'CatalogId': 'string',
            'TagKey': 'string',
            'TagValues': [
                'string',
            ]
        },
    ],
    'LFTagsOnTable': [
        {
            'CatalogId': 'string',
            'TagKey': 'string',
            'TagValues': [
                'string',
            ]
        },
    ],
    'LFTagsOnColumns': [
        {
            'Name': 'string',
            'LFTags': [
                {
                    'CatalogId': 'string',
                    'TagKey': 'string',
                    'TagValues': [
                        'string',
                    ]
                },
            ]
        },
    ]
}

Response Structure

  • (dict) --

    • LFTagOnDatabase (list) --

      A list of LF-tags applied to a database resource.

      • (dict) --

        A structure containing an LF-tag key-value pair.

        • CatalogId (string) --

          The identifier for the Data Catalog. By default, the account ID. The Data Catalog is the persistent metadata store. It contains database definitions, table definitions, and other control information to manage your Lake Formation environment.

        • TagKey (string) --

          The key-name for the LF-tag.

        • TagValues (list) --

          A list of possible values an attribute can take.

          • (string) --

    • LFTagsOnTable (list) --

      A list of LF-tags applied to a table resource.

      • (dict) --

        A structure containing an LF-tag key-value pair.

        • CatalogId (string) --

          The identifier for the Data Catalog. By default, the account ID. The Data Catalog is the persistent metadata store. It contains database definitions, table definitions, and other control information to manage your Lake Formation environment.

        • TagKey (string) --

          The key-name for the LF-tag.

        • TagValues (list) --

          A list of possible values an attribute can take.

          • (string) --

    • LFTagsOnColumns (list) --

      A list of LF-tags applied to a column resource.

      • (dict) --

        A structure containing the name of a column resource and the LF-tags attached to it.

        • Name (string) --

          The name of a column resource.

        • LFTags (list) --

          The LF-tags attached to a column resource.

          • (dict) --

            A structure containing an LF-tag key-value pair.

            • CatalogId (string) --

              The identifier for the Data Catalog. By default, the account ID. The Data Catalog is the persistent metadata store. It contains database definitions, table definitions, and other control information to manage your Lake Formation environment.

            • TagKey (string) --

              The key-name for the LF-tag.

            • TagValues (list) --

              A list of possible values an attribute can take.

              • (string) --

GrantPermissions (updated) Link ¶
Changes (request)
{'Resource': {'DataCellsFilter': {'DatabaseName': 'string',
                                  'Name': 'string',
                                  'TableCatalogId': 'string',
                                  'TableName': 'string'}}}

Grants permissions to the principal to access metadata in the Data Catalog and data organized in underlying data storage such as Amazon S3.

For information about permissions, see Security and Access Control to Metadata and Data .

See also: AWS API Documentation

Request Syntax

client.grant_permissions(
    CatalogId='string',
    Principal={
        'DataLakePrincipalIdentifier': 'string'
    },
    Resource={
        'Catalog': {}
        ,
        'Database': {
            'CatalogId': 'string',
            'Name': 'string'
        },
        'Table': {
            'CatalogId': 'string',
            'DatabaseName': 'string',
            'Name': 'string',
            'TableWildcard': {}

        },
        'TableWithColumns': {
            'CatalogId': 'string',
            'DatabaseName': 'string',
            'Name': 'string',
            'ColumnNames': [
                'string',
            ],
            'ColumnWildcard': {
                'ExcludedColumnNames': [
                    'string',
                ]
            }
        },
        'DataLocation': {
            'CatalogId': 'string',
            'ResourceArn': 'string'
        },
        'DataCellsFilter': {
            'TableCatalogId': 'string',
            'DatabaseName': 'string',
            'TableName': 'string',
            'Name': 'string'
        },
        'LFTag': {
            'CatalogId': 'string',
            'TagKey': 'string',
            'TagValues': [
                'string',
            ]
        },
        'LFTagPolicy': {
            'CatalogId': 'string',
            'ResourceType': 'DATABASE'|'TABLE',
            'Expression': [
                {
                    'TagKey': 'string',
                    'TagValues': [
                        'string',
                    ]
                },
            ]
        }
    },
    Permissions=[
        'ALL'|'SELECT'|'ALTER'|'DROP'|'DELETE'|'INSERT'|'DESCRIBE'|'CREATE_DATABASE'|'CREATE_TABLE'|'DATA_LOCATION_ACCESS'|'CREATE_TAG'|'ALTER_TAG'|'DELETE_TAG'|'DESCRIBE_TAG'|'ASSOCIATE_TAG',
    ],
    PermissionsWithGrantOption=[
        'ALL'|'SELECT'|'ALTER'|'DROP'|'DELETE'|'INSERT'|'DESCRIBE'|'CREATE_DATABASE'|'CREATE_TABLE'|'DATA_LOCATION_ACCESS'|'CREATE_TAG'|'ALTER_TAG'|'DELETE_TAG'|'DESCRIBE_TAG'|'ASSOCIATE_TAG',
    ]
)
type CatalogId

string

param CatalogId

The identifier for the Data Catalog. By default, the account ID. The Data Catalog is the persistent metadata store. It contains database definitions, table definitions, and other control information to manage your Lake Formation environment.

type Principal

dict

param Principal

[REQUIRED]

The principal to be granted the permissions on the resource. Supported principals are IAM users or IAM roles, and they are defined by their principal type and their ARN.

Note that if you define a resource with a particular ARN, then later delete, and recreate a resource with that same ARN, the resource maintains the permissions already granted.

  • DataLakePrincipalIdentifier (string) --

    An identifier for the Lake Formation principal.

type Resource

dict

param Resource

[REQUIRED]

The resource to which permissions are to be granted. Resources in Lake Formation are the Data Catalog, databases, and tables.

  • Catalog (dict) --

    The identifier for the Data Catalog. By default, the account ID. The Data Catalog is the persistent metadata store. It contains database definitions, table definitions, and other control information to manage your Lake Formation environment.

  • Database (dict) --

    The database for the resource. Unique to the Data Catalog. A database is a set of associated table definitions organized into a logical group. You can Grant and Revoke database permissions to a principal.

    • CatalogId (string) --

      The identifier for the Data Catalog. By default, it is the account ID of the caller.

    • Name (string) -- [REQUIRED]

      The name of the database resource. Unique to the Data Catalog.

  • Table (dict) --

    The table for the resource. A table is a metadata definition that represents your data. You can Grant and Revoke table privileges to a principal.

    • CatalogId (string) --

      The identifier for the Data Catalog. By default, it is the account ID of the caller.

    • DatabaseName (string) -- [REQUIRED]

      The name of the database for the table. Unique to a Data Catalog. A database is a set of associated table definitions organized into a logical group. You can Grant and Revoke database privileges to a principal.

    • Name (string) --

      The name of the table.

    • TableWildcard (dict) --

      A wildcard object representing every table under a database.

      At least one of TableResource$Name or TableResource$TableWildcard is required.

  • TableWithColumns (dict) --

    The table with columns for the resource. A principal with permissions to this resource can select metadata from the columns of a table in the Data Catalog and the underlying data in Amazon S3.

    • CatalogId (string) --

      The identifier for the Data Catalog. By default, it is the account ID of the caller.

    • DatabaseName (string) -- [REQUIRED]

      The name of the database for the table with columns resource. Unique to the Data Catalog. A database is a set of associated table definitions organized into a logical group. You can Grant and Revoke database privileges to a principal.

    • Name (string) -- [REQUIRED]

      The name of the table resource. A table is a metadata definition that represents your data. You can Grant and Revoke table privileges to a principal.

    • ColumnNames (list) --

      The list of column names for the table. At least one of ColumnNames or ColumnWildcard is required.

      • (string) --

    • ColumnWildcard (dict) --

      A wildcard specified by a ColumnWildcard object. At least one of ColumnNames or ColumnWildcard is required.

      • ExcludedColumnNames (list) --

        Excludes column names. Any column with this name will be excluded.

        • (string) --

  • DataLocation (dict) --

    The location of an Amazon S3 path where permissions are granted or revoked.

    • CatalogId (string) --

      The identifier for the Data Catalog where the location is registered with Lake Formation. By default, it is the account ID of the caller.

    • ResourceArn (string) -- [REQUIRED]

      The Amazon Resource Name (ARN) that uniquely identifies the data location resource.

  • DataCellsFilter (dict) --

    A data cell filter.

    • TableCatalogId (string) --

      The ID of the catalog to which the table belongs.

    • DatabaseName (string) --

      A database in the Glue Data Catalog.

    • TableName (string) --

      The name of the table.

    • Name (string) --

      The name of the data cells filter.

  • LFTag (dict) --

    The LF-tag key and values attached to a resource.

    • CatalogId (string) --

      The identifier for the Data Catalog. By default, the account ID. The Data Catalog is the persistent metadata store. It contains database definitions, table definitions, and other control information to manage your Lake Formation environment.

    • TagKey (string) -- [REQUIRED]

      The key-name for the LF-tag.

    • TagValues (list) -- [REQUIRED]

      A list of possible values an attribute can take.

      • (string) --

  • LFTagPolicy (dict) --

    A list of LF-tag conditions that define a resource's LF-tag policy.

    • CatalogId (string) --

      The identifier for the Data Catalog. By default, the account ID. The Data Catalog is the persistent metadata store. It contains database definitions, table definitions, and other control information to manage your Lake Formation environment.

    • ResourceType (string) -- [REQUIRED]

      The resource type for which the LF-tag policy applies.

    • Expression (list) -- [REQUIRED]

      A list of LF-tag conditions that apply to the resource's LF-tag policy.

      • (dict) --

        A structure that allows an admin to grant user permissions on certain conditions. For example, granting a role access to all columns that do not have the LF-tag 'PII' in tables that have the LF-tag 'Prod'.

        • TagKey (string) -- [REQUIRED]

          The key-name for the LF-tag.

        • TagValues (list) -- [REQUIRED]

          A list of possible values an attribute can take.

          • (string) --

type Permissions

list

param Permissions

[REQUIRED]

The permissions granted to the principal on the resource. Lake Formation defines privileges to grant and revoke access to metadata in the Data Catalog and data organized in underlying data storage such as Amazon S3. Lake Formation requires that each principal be authorized to perform a specific task on Lake Formation resources.

  • (string) --

type PermissionsWithGrantOption

list

param PermissionsWithGrantOption

Indicates a list of the granted permissions that the principal may pass to other users. These permissions may only be a subset of the permissions granted in the Privileges .

  • (string) --

rtype

dict

returns

Response Syntax

{}

Response Structure

  • (dict) --

ListPermissions (updated) Link ¶
Changes (request, response)
Request
{'IncludeRelated': 'string',
 'Resource': {'DataCellsFilter': {'DatabaseName': 'string',
                                  'Name': 'string',
                                  'TableCatalogId': 'string',
                                  'TableName': 'string'}}}
Response
{'PrincipalResourcePermissions': {'Resource': {'DataCellsFilter': {'DatabaseName': 'string',
                                                                   'Name': 'string',
                                                                   'TableCatalogId': 'string',
                                                                   'TableName': 'string'}}}}

Returns a list of the principal permissions on the resource, filtered by the permissions of the caller. For example, if you are granted an ALTER permission, you are able to see only the principal permissions for ALTER.

This operation returns only those permissions that have been explicitly granted.

For information about permissions, see Security and Access Control to Metadata and Data .

See also: AWS API Documentation

Request Syntax

client.list_permissions(
    CatalogId='string',
    Principal={
        'DataLakePrincipalIdentifier': 'string'
    },
    ResourceType='CATALOG'|'DATABASE'|'TABLE'|'DATA_LOCATION'|'LF_TAG'|'LF_TAG_POLICY'|'LF_TAG_POLICY_DATABASE'|'LF_TAG_POLICY_TABLE',
    Resource={
        'Catalog': {}
        ,
        'Database': {
            'CatalogId': 'string',
            'Name': 'string'
        },
        'Table': {
            'CatalogId': 'string',
            'DatabaseName': 'string',
            'Name': 'string',
            'TableWildcard': {}

        },
        'TableWithColumns': {
            'CatalogId': 'string',
            'DatabaseName': 'string',
            'Name': 'string',
            'ColumnNames': [
                'string',
            ],
            'ColumnWildcard': {
                'ExcludedColumnNames': [
                    'string',
                ]
            }
        },
        'DataLocation': {
            'CatalogId': 'string',
            'ResourceArn': 'string'
        },
        'DataCellsFilter': {
            'TableCatalogId': 'string',
            'DatabaseName': 'string',
            'TableName': 'string',
            'Name': 'string'
        },
        'LFTag': {
            'CatalogId': 'string',
            'TagKey': 'string',
            'TagValues': [
                'string',
            ]
        },
        'LFTagPolicy': {
            'CatalogId': 'string',
            'ResourceType': 'DATABASE'|'TABLE',
            'Expression': [
                {
                    'TagKey': 'string',
                    'TagValues': [
                        'string',
                    ]
                },
            ]
        }
    },
    NextToken='string',
    MaxResults=123,
    IncludeRelated='string'
)
type CatalogId

string

param CatalogId

The identifier for the Data Catalog. By default, the account ID. The Data Catalog is the persistent metadata store. It contains database definitions, table definitions, and other control information to manage your Lake Formation environment.

type Principal

dict

param Principal

Specifies a principal to filter the permissions returned.

  • DataLakePrincipalIdentifier (string) --

    An identifier for the Lake Formation principal.

type ResourceType

string

param ResourceType

Specifies a resource type to filter the permissions returned.

type Resource

dict

param Resource

A resource where you will get a list of the principal permissions.

This operation does not support getting privileges on a table with columns. Instead, call this operation on the table, and the operation returns the table and the table w columns.

  • Catalog (dict) --

    The identifier for the Data Catalog. By default, the account ID. The Data Catalog is the persistent metadata store. It contains database definitions, table definitions, and other control information to manage your Lake Formation environment.

  • Database (dict) --

    The database for the resource. Unique to the Data Catalog. A database is a set of associated table definitions organized into a logical group. You can Grant and Revoke database permissions to a principal.

    • CatalogId (string) --

      The identifier for the Data Catalog. By default, it is the account ID of the caller.

    • Name (string) -- [REQUIRED]

      The name of the database resource. Unique to the Data Catalog.

  • Table (dict) --

    The table for the resource. A table is a metadata definition that represents your data. You can Grant and Revoke table privileges to a principal.

    • CatalogId (string) --

      The identifier for the Data Catalog. By default, it is the account ID of the caller.

    • DatabaseName (string) -- [REQUIRED]

      The name of the database for the table. Unique to a Data Catalog. A database is a set of associated table definitions organized into a logical group. You can Grant and Revoke database privileges to a principal.

    • Name (string) --

      The name of the table.

    • TableWildcard (dict) --

      A wildcard object representing every table under a database.

      At least one of TableResource$Name or TableResource$TableWildcard is required.

  • TableWithColumns (dict) --

    The table with columns for the resource. A principal with permissions to this resource can select metadata from the columns of a table in the Data Catalog and the underlying data in Amazon S3.

    • CatalogId (string) --

      The identifier for the Data Catalog. By default, it is the account ID of the caller.

    • DatabaseName (string) -- [REQUIRED]

      The name of the database for the table with columns resource. Unique to the Data Catalog. A database is a set of associated table definitions organized into a logical group. You can Grant and Revoke database privileges to a principal.

    • Name (string) -- [REQUIRED]

      The name of the table resource. A table is a metadata definition that represents your data. You can Grant and Revoke table privileges to a principal.

    • ColumnNames (list) --

      The list of column names for the table. At least one of ColumnNames or ColumnWildcard is required.

      • (string) --

    • ColumnWildcard (dict) --

      A wildcard specified by a ColumnWildcard object. At least one of ColumnNames or ColumnWildcard is required.

      • ExcludedColumnNames (list) --

        Excludes column names. Any column with this name will be excluded.

        • (string) --

  • DataLocation (dict) --

    The location of an Amazon S3 path where permissions are granted or revoked.

    • CatalogId (string) --

      The identifier for the Data Catalog where the location is registered with Lake Formation. By default, it is the account ID of the caller.

    • ResourceArn (string) -- [REQUIRED]

      The Amazon Resource Name (ARN) that uniquely identifies the data location resource.

  • DataCellsFilter (dict) --

    A data cell filter.

    • TableCatalogId (string) --

      The ID of the catalog to which the table belongs.

    • DatabaseName (string) --

      A database in the Glue Data Catalog.

    • TableName (string) --

      The name of the table.

    • Name (string) --

      The name of the data cells filter.

  • LFTag (dict) --

    The LF-tag key and values attached to a resource.

    • CatalogId (string) --

      The identifier for the Data Catalog. By default, the account ID. The Data Catalog is the persistent metadata store. It contains database definitions, table definitions, and other control information to manage your Lake Formation environment.

    • TagKey (string) -- [REQUIRED]

      The key-name for the LF-tag.

    • TagValues (list) -- [REQUIRED]

      A list of possible values an attribute can take.

      • (string) --

  • LFTagPolicy (dict) --

    A list of LF-tag conditions that define a resource's LF-tag policy.

    • CatalogId (string) --

      The identifier for the Data Catalog. By default, the account ID. The Data Catalog is the persistent metadata store. It contains database definitions, table definitions, and other control information to manage your Lake Formation environment.

    • ResourceType (string) -- [REQUIRED]

      The resource type for which the LF-tag policy applies.

    • Expression (list) -- [REQUIRED]

      A list of LF-tag conditions that apply to the resource's LF-tag policy.

      • (dict) --

        A structure that allows an admin to grant user permissions on certain conditions. For example, granting a role access to all columns that do not have the LF-tag 'PII' in tables that have the LF-tag 'Prod'.

        • TagKey (string) -- [REQUIRED]

          The key-name for the LF-tag.

        • TagValues (list) -- [REQUIRED]

          A list of possible values an attribute can take.

          • (string) --

type NextToken

string

param NextToken

A continuation token, if this is not the first call to retrieve this list.

type MaxResults

integer

param MaxResults

The maximum number of results to return.

type IncludeRelated

string

param IncludeRelated

Indicates that related permissions should be included in the results.

rtype

dict

returns

Response Syntax

{
    'PrincipalResourcePermissions': [
        {
            'Principal': {
                'DataLakePrincipalIdentifier': 'string'
            },
            'Resource': {
                'Catalog': {},
                'Database': {
                    'CatalogId': 'string',
                    'Name': 'string'
                },
                'Table': {
                    'CatalogId': 'string',
                    'DatabaseName': 'string',
                    'Name': 'string',
                    'TableWildcard': {}
                },
                'TableWithColumns': {
                    'CatalogId': 'string',
                    'DatabaseName': 'string',
                    'Name': 'string',
                    'ColumnNames': [
                        'string',
                    ],
                    'ColumnWildcard': {
                        'ExcludedColumnNames': [
                            'string',
                        ]
                    }
                },
                'DataLocation': {
                    'CatalogId': 'string',
                    'ResourceArn': 'string'
                },
                'DataCellsFilter': {
                    'TableCatalogId': 'string',
                    'DatabaseName': 'string',
                    'TableName': 'string',
                    'Name': 'string'
                },
                'LFTag': {
                    'CatalogId': 'string',
                    'TagKey': 'string',
                    'TagValues': [
                        'string',
                    ]
                },
                'LFTagPolicy': {
                    'CatalogId': 'string',
                    'ResourceType': 'DATABASE'|'TABLE',
                    'Expression': [
                        {
                            'TagKey': 'string',
                            'TagValues': [
                                'string',
                            ]
                        },
                    ]
                }
            },
            'Permissions': [
                'ALL'|'SELECT'|'ALTER'|'DROP'|'DELETE'|'INSERT'|'DESCRIBE'|'CREATE_DATABASE'|'CREATE_TABLE'|'DATA_LOCATION_ACCESS'|'CREATE_TAG'|'ALTER_TAG'|'DELETE_TAG'|'DESCRIBE_TAG'|'ASSOCIATE_TAG',
            ],
            'PermissionsWithGrantOption': [
                'ALL'|'SELECT'|'ALTER'|'DROP'|'DELETE'|'INSERT'|'DESCRIBE'|'CREATE_DATABASE'|'CREATE_TABLE'|'DATA_LOCATION_ACCESS'|'CREATE_TAG'|'ALTER_TAG'|'DELETE_TAG'|'DESCRIBE_TAG'|'ASSOCIATE_TAG',
            ],
            'AdditionalDetails': {
                'ResourceShare': [
                    'string',
                ]
            }
        },
    ],
    'NextToken': 'string'
}

Response Structure

  • (dict) --

    • PrincipalResourcePermissions (list) --

      A list of principals and their permissions on the resource for the specified principal and resource types.

      • (dict) --

        The permissions granted or revoked on a resource.

        • Principal (dict) --

          The Data Lake principal to be granted or revoked permissions.

          • DataLakePrincipalIdentifier (string) --

            An identifier for the Lake Formation principal.

        • Resource (dict) --

          The resource where permissions are to be granted or revoked.

          • Catalog (dict) --

            The identifier for the Data Catalog. By default, the account ID. The Data Catalog is the persistent metadata store. It contains database definitions, table definitions, and other control information to manage your Lake Formation environment.

          • Database (dict) --

            The database for the resource. Unique to the Data Catalog. A database is a set of associated table definitions organized into a logical group. You can Grant and Revoke database permissions to a principal.

            • CatalogId (string) --

              The identifier for the Data Catalog. By default, it is the account ID of the caller.

            • Name (string) --

              The name of the database resource. Unique to the Data Catalog.

          • Table (dict) --

            The table for the resource. A table is a metadata definition that represents your data. You can Grant and Revoke table privileges to a principal.

            • CatalogId (string) --

              The identifier for the Data Catalog. By default, it is the account ID of the caller.

            • DatabaseName (string) --

              The name of the database for the table. Unique to a Data Catalog. A database is a set of associated table definitions organized into a logical group. You can Grant and Revoke database privileges to a principal.

            • Name (string) --

              The name of the table.

            • TableWildcard (dict) --

              A wildcard object representing every table under a database.

              At least one of TableResource$Name or TableResource$TableWildcard is required.

          • TableWithColumns (dict) --

            The table with columns for the resource. A principal with permissions to this resource can select metadata from the columns of a table in the Data Catalog and the underlying data in Amazon S3.

            • CatalogId (string) --

              The identifier for the Data Catalog. By default, it is the account ID of the caller.

            • DatabaseName (string) --

              The name of the database for the table with columns resource. Unique to the Data Catalog. A database is a set of associated table definitions organized into a logical group. You can Grant and Revoke database privileges to a principal.

            • Name (string) --

              The name of the table resource. A table is a metadata definition that represents your data. You can Grant and Revoke table privileges to a principal.

            • ColumnNames (list) --

              The list of column names for the table. At least one of ColumnNames or ColumnWildcard is required.

              • (string) --

            • ColumnWildcard (dict) --

              A wildcard specified by a ColumnWildcard object. At least one of ColumnNames or ColumnWildcard is required.

              • ExcludedColumnNames (list) --

                Excludes column names. Any column with this name will be excluded.

                • (string) --

          • DataLocation (dict) --

            The location of an Amazon S3 path where permissions are granted or revoked.

            • CatalogId (string) --

              The identifier for the Data Catalog where the location is registered with Lake Formation. By default, it is the account ID of the caller.

            • ResourceArn (string) --

              The Amazon Resource Name (ARN) that uniquely identifies the data location resource.

          • DataCellsFilter (dict) --

            A data cell filter.

            • TableCatalogId (string) --

              The ID of the catalog to which the table belongs.

            • DatabaseName (string) --

              A database in the Glue Data Catalog.

            • TableName (string) --

              The name of the table.

            • Name (string) --

              The name of the data cells filter.

          • LFTag (dict) --

            The LF-tag key and values attached to a resource.

            • CatalogId (string) --

              The identifier for the Data Catalog. By default, the account ID. The Data Catalog is the persistent metadata store. It contains database definitions, table definitions, and other control information to manage your Lake Formation environment.

            • TagKey (string) --

              The key-name for the LF-tag.

            • TagValues (list) --

              A list of possible values an attribute can take.

              • (string) --

          • LFTagPolicy (dict) --

            A list of LF-tag conditions that define a resource's LF-tag policy.

            • CatalogId (string) --

              The identifier for the Data Catalog. By default, the account ID. The Data Catalog is the persistent metadata store. It contains database definitions, table definitions, and other control information to manage your Lake Formation environment.

            • ResourceType (string) --

              The resource type for which the LF-tag policy applies.

            • Expression (list) --

              A list of LF-tag conditions that apply to the resource's LF-tag policy.

              • (dict) --

                A structure that allows an admin to grant user permissions on certain conditions. For example, granting a role access to all columns that do not have the LF-tag 'PII' in tables that have the LF-tag 'Prod'.

                • TagKey (string) --

                  The key-name for the LF-tag.

                • TagValues (list) --

                  A list of possible values an attribute can take.

                  • (string) --

        • Permissions (list) --

          The permissions to be granted or revoked on the resource.

          • (string) --

        • PermissionsWithGrantOption (list) --

          Indicates whether to grant the ability to grant permissions (as a subset of permissions granted).

          • (string) --

        • AdditionalDetails (dict) --

          This attribute can be used to return any additional details of PrincipalResourcePermissions . Currently returns only as a RAM resource share ARN.

          • ResourceShare (list) --

            A resource share ARN for a catalog resource shared through RAM.

            • (string) --

    • NextToken (string) --

      A continuation token, if this is not the first call to retrieve this list.

RemoveLFTagsFromResource (updated) Link ¶
Changes (request)
{'Resource': {'DataCellsFilter': {'DatabaseName': 'string',
                                  'Name': 'string',
                                  'TableCatalogId': 'string',
                                  'TableName': 'string'}}}

Removes an LF-tag from the resource. Only database, table, or tableWithColumns resource are allowed. To tag columns, use the column inclusion list in tableWithColumns to specify column input.

See also: AWS API Documentation

Request Syntax

client.remove_lf_tags_from_resource(
    CatalogId='string',
    Resource={
        'Catalog': {}
        ,
        'Database': {
            'CatalogId': 'string',
            'Name': 'string'
        },
        'Table': {
            'CatalogId': 'string',
            'DatabaseName': 'string',
            'Name': 'string',
            'TableWildcard': {}

        },
        'TableWithColumns': {
            'CatalogId': 'string',
            'DatabaseName': 'string',
            'Name': 'string',
            'ColumnNames': [
                'string',
            ],
            'ColumnWildcard': {
                'ExcludedColumnNames': [
                    'string',
                ]
            }
        },
        'DataLocation': {
            'CatalogId': 'string',
            'ResourceArn': 'string'
        },
        'DataCellsFilter': {
            'TableCatalogId': 'string',
            'DatabaseName': 'string',
            'TableName': 'string',
            'Name': 'string'
        },
        'LFTag': {
            'CatalogId': 'string',
            'TagKey': 'string',
            'TagValues': [
                'string',
            ]
        },
        'LFTagPolicy': {
            'CatalogId': 'string',
            'ResourceType': 'DATABASE'|'TABLE',
            'Expression': [
                {
                    'TagKey': 'string',
                    'TagValues': [
                        'string',
                    ]
                },
            ]
        }
    },
    LFTags=[
        {
            'CatalogId': 'string',
            'TagKey': 'string',
            'TagValues': [
                'string',
            ]
        },
    ]
)
type CatalogId

string

param CatalogId

The identifier for the Data Catalog. By default, the account ID. The Data Catalog is the persistent metadata store. It contains database definitions, table definitions, and other control information to manage your Lake Formation environment.

type Resource

dict

param Resource

[REQUIRED]

The database, table, or column resource where you want to remove an LF-tag.

  • Catalog (dict) --

    The identifier for the Data Catalog. By default, the account ID. The Data Catalog is the persistent metadata store. It contains database definitions, table definitions, and other control information to manage your Lake Formation environment.

  • Database (dict) --

    The database for the resource. Unique to the Data Catalog. A database is a set of associated table definitions organized into a logical group. You can Grant and Revoke database permissions to a principal.

    • CatalogId (string) --

      The identifier for the Data Catalog. By default, it is the account ID of the caller.

    • Name (string) -- [REQUIRED]

      The name of the database resource. Unique to the Data Catalog.

  • Table (dict) --

    The table for the resource. A table is a metadata definition that represents your data. You can Grant and Revoke table privileges to a principal.

    • CatalogId (string) --

      The identifier for the Data Catalog. By default, it is the account ID of the caller.

    • DatabaseName (string) -- [REQUIRED]

      The name of the database for the table. Unique to a Data Catalog. A database is a set of associated table definitions organized into a logical group. You can Grant and Revoke database privileges to a principal.

    • Name (string) --

      The name of the table.

    • TableWildcard (dict) --

      A wildcard object representing every table under a database.

      At least one of TableResource$Name or TableResource$TableWildcard is required.

  • TableWithColumns (dict) --

    The table with columns for the resource. A principal with permissions to this resource can select metadata from the columns of a table in the Data Catalog and the underlying data in Amazon S3.

    • CatalogId (string) --

      The identifier for the Data Catalog. By default, it is the account ID of the caller.

    • DatabaseName (string) -- [REQUIRED]

      The name of the database for the table with columns resource. Unique to the Data Catalog. A database is a set of associated table definitions organized into a logical group. You can Grant and Revoke database privileges to a principal.

    • Name (string) -- [REQUIRED]

      The name of the table resource. A table is a metadata definition that represents your data. You can Grant and Revoke table privileges to a principal.

    • ColumnNames (list) --

      The list of column names for the table. At least one of ColumnNames or ColumnWildcard is required.

      • (string) --

    • ColumnWildcard (dict) --

      A wildcard specified by a ColumnWildcard object. At least one of ColumnNames or ColumnWildcard is required.

      • ExcludedColumnNames (list) --

        Excludes column names. Any column with this name will be excluded.

        • (string) --

  • DataLocation (dict) --

    The location of an Amazon S3 path where permissions are granted or revoked.

    • CatalogId (string) --

      The identifier for the Data Catalog where the location is registered with Lake Formation. By default, it is the account ID of the caller.

    • ResourceArn (string) -- [REQUIRED]

      The Amazon Resource Name (ARN) that uniquely identifies the data location resource.

  • DataCellsFilter (dict) --

    A data cell filter.

    • TableCatalogId (string) --

      The ID of the catalog to which the table belongs.

    • DatabaseName (string) --

      A database in the Glue Data Catalog.

    • TableName (string) --

      The name of the table.

    • Name (string) --

      The name of the data cells filter.

  • LFTag (dict) --

    The LF-tag key and values attached to a resource.

    • CatalogId (string) --

      The identifier for the Data Catalog. By default, the account ID. The Data Catalog is the persistent metadata store. It contains database definitions, table definitions, and other control information to manage your Lake Formation environment.

    • TagKey (string) -- [REQUIRED]

      The key-name for the LF-tag.

    • TagValues (list) -- [REQUIRED]

      A list of possible values an attribute can take.

      • (string) --

  • LFTagPolicy (dict) --

    A list of LF-tag conditions that define a resource's LF-tag policy.

    • CatalogId (string) --

      The identifier for the Data Catalog. By default, the account ID. The Data Catalog is the persistent metadata store. It contains database definitions, table definitions, and other control information to manage your Lake Formation environment.

    • ResourceType (string) -- [REQUIRED]

      The resource type for which the LF-tag policy applies.

    • Expression (list) -- [REQUIRED]

      A list of LF-tag conditions that apply to the resource's LF-tag policy.

      • (dict) --

        A structure that allows an admin to grant user permissions on certain conditions. For example, granting a role access to all columns that do not have the LF-tag 'PII' in tables that have the LF-tag 'Prod'.

        • TagKey (string) -- [REQUIRED]

          The key-name for the LF-tag.

        • TagValues (list) -- [REQUIRED]

          A list of possible values an attribute can take.

          • (string) --

type LFTags

list

param LFTags

[REQUIRED]

The LF-tags to be removed from the resource.

  • (dict) --

    A structure containing an LF-tag key-value pair.

    • CatalogId (string) --

      The identifier for the Data Catalog. By default, the account ID. The Data Catalog is the persistent metadata store. It contains database definitions, table definitions, and other control information to manage your Lake Formation environment.

    • TagKey (string) -- [REQUIRED]

      The key-name for the LF-tag.

    • TagValues (list) -- [REQUIRED]

      A list of possible values an attribute can take.

      • (string) --

rtype

dict

returns

Response Syntax

{
    'Failures': [
        {
            'LFTag': {
                'CatalogId': 'string',
                'TagKey': 'string',
                'TagValues': [
                    'string',
                ]
            },
            'Error': {
                'ErrorCode': 'string',
                'ErrorMessage': 'string'
            }
        },
    ]
}

Response Structure

  • (dict) --

    • Failures (list) --

      A list of failures to untag a resource.

      • (dict) --

        A structure containing an error related to a TagResource or UnTagResource operation.

        • LFTag (dict) --

          The key-name of the LF-tag.

          • CatalogId (string) --

            The identifier for the Data Catalog. By default, the account ID. The Data Catalog is the persistent metadata store. It contains database definitions, table definitions, and other control information to manage your Lake Formation environment.

          • TagKey (string) --

            The key-name for the LF-tag.

          • TagValues (list) --

            A list of possible values an attribute can take.

            • (string) --

        • Error (dict) --

          An error that occurred with the attachment or detachment of the LF-tag.

          • ErrorCode (string) --

            The code associated with this error.

          • ErrorMessage (string) --

            A message describing the error.

RevokePermissions (updated) Link ¶
Changes (request)
{'Resource': {'DataCellsFilter': {'DatabaseName': 'string',
                                  'Name': 'string',
                                  'TableCatalogId': 'string',
                                  'TableName': 'string'}}}

Revokes permissions to the principal to access metadata in the Data Catalog and data organized in underlying data storage such as Amazon S3.

See also: AWS API Documentation

Request Syntax

client.revoke_permissions(
    CatalogId='string',
    Principal={
        'DataLakePrincipalIdentifier': 'string'
    },
    Resource={
        'Catalog': {}
        ,
        'Database': {
            'CatalogId': 'string',
            'Name': 'string'
        },
        'Table': {
            'CatalogId': 'string',
            'DatabaseName': 'string',
            'Name': 'string',
            'TableWildcard': {}

        },
        'TableWithColumns': {
            'CatalogId': 'string',
            'DatabaseName': 'string',
            'Name': 'string',
            'ColumnNames': [
                'string',
            ],
            'ColumnWildcard': {
                'ExcludedColumnNames': [
                    'string',
                ]
            }
        },
        'DataLocation': {
            'CatalogId': 'string',
            'ResourceArn': 'string'
        },
        'DataCellsFilter': {
            'TableCatalogId': 'string',
            'DatabaseName': 'string',
            'TableName': 'string',
            'Name': 'string'
        },
        'LFTag': {
            'CatalogId': 'string',
            'TagKey': 'string',
            'TagValues': [
                'string',
            ]
        },
        'LFTagPolicy': {
            'CatalogId': 'string',
            'ResourceType': 'DATABASE'|'TABLE',
            'Expression': [
                {
                    'TagKey': 'string',
                    'TagValues': [
                        'string',
                    ]
                },
            ]
        }
    },
    Permissions=[
        'ALL'|'SELECT'|'ALTER'|'DROP'|'DELETE'|'INSERT'|'DESCRIBE'|'CREATE_DATABASE'|'CREATE_TABLE'|'DATA_LOCATION_ACCESS'|'CREATE_TAG'|'ALTER_TAG'|'DELETE_TAG'|'DESCRIBE_TAG'|'ASSOCIATE_TAG',
    ],
    PermissionsWithGrantOption=[
        'ALL'|'SELECT'|'ALTER'|'DROP'|'DELETE'|'INSERT'|'DESCRIBE'|'CREATE_DATABASE'|'CREATE_TABLE'|'DATA_LOCATION_ACCESS'|'CREATE_TAG'|'ALTER_TAG'|'DELETE_TAG'|'DESCRIBE_TAG'|'ASSOCIATE_TAG',
    ]
)
type CatalogId

string

param CatalogId

The identifier for the Data Catalog. By default, the account ID. The Data Catalog is the persistent metadata store. It contains database definitions, table definitions, and other control information to manage your Lake Formation environment.

type Principal

dict

param Principal

[REQUIRED]

The principal to be revoked permissions on the resource.

  • DataLakePrincipalIdentifier (string) --

    An identifier for the Lake Formation principal.

type Resource

dict

param Resource

[REQUIRED]

The resource to which permissions are to be revoked.

  • Catalog (dict) --

    The identifier for the Data Catalog. By default, the account ID. The Data Catalog is the persistent metadata store. It contains database definitions, table definitions, and other control information to manage your Lake Formation environment.

  • Database (dict) --

    The database for the resource. Unique to the Data Catalog. A database is a set of associated table definitions organized into a logical group. You can Grant and Revoke database permissions to a principal.

    • CatalogId (string) --

      The identifier for the Data Catalog. By default, it is the account ID of the caller.

    • Name (string) -- [REQUIRED]

      The name of the database resource. Unique to the Data Catalog.

  • Table (dict) --

    The table for the resource. A table is a metadata definition that represents your data. You can Grant and Revoke table privileges to a principal.

    • CatalogId (string) --

      The identifier for the Data Catalog. By default, it is the account ID of the caller.

    • DatabaseName (string) -- [REQUIRED]

      The name of the database for the table. Unique to a Data Catalog. A database is a set of associated table definitions organized into a logical group. You can Grant and Revoke database privileges to a principal.

    • Name (string) --

      The name of the table.

    • TableWildcard (dict) --

      A wildcard object representing every table under a database.

      At least one of TableResource$Name or TableResource$TableWildcard is required.

  • TableWithColumns (dict) --

    The table with columns for the resource. A principal with permissions to this resource can select metadata from the columns of a table in the Data Catalog and the underlying data in Amazon S3.

    • CatalogId (string) --

      The identifier for the Data Catalog. By default, it is the account ID of the caller.

    • DatabaseName (string) -- [REQUIRED]

      The name of the database for the table with columns resource. Unique to the Data Catalog. A database is a set of associated table definitions organized into a logical group. You can Grant and Revoke database privileges to a principal.

    • Name (string) -- [REQUIRED]

      The name of the table resource. A table is a metadata definition that represents your data. You can Grant and Revoke table privileges to a principal.

    • ColumnNames (list) --

      The list of column names for the table. At least one of ColumnNames or ColumnWildcard is required.

      • (string) --

    • ColumnWildcard (dict) --

      A wildcard specified by a ColumnWildcard object. At least one of ColumnNames or ColumnWildcard is required.

      • ExcludedColumnNames (list) --

        Excludes column names. Any column with this name will be excluded.

        • (string) --

  • DataLocation (dict) --

    The location of an Amazon S3 path where permissions are granted or revoked.

    • CatalogId (string) --

      The identifier for the Data Catalog where the location is registered with Lake Formation. By default, it is the account ID of the caller.

    • ResourceArn (string) -- [REQUIRED]

      The Amazon Resource Name (ARN) that uniquely identifies the data location resource.

  • DataCellsFilter (dict) --

    A data cell filter.

    • TableCatalogId (string) --

      The ID of the catalog to which the table belongs.

    • DatabaseName (string) --

      A database in the Glue Data Catalog.

    • TableName (string) --

      The name of the table.

    • Name (string) --

      The name of the data cells filter.

  • LFTag (dict) --

    The LF-tag key and values attached to a resource.

    • CatalogId (string) --

      The identifier for the Data Catalog. By default, the account ID. The Data Catalog is the persistent metadata store. It contains database definitions, table definitions, and other control information to manage your Lake Formation environment.

    • TagKey (string) -- [REQUIRED]

      The key-name for the LF-tag.

    • TagValues (list) -- [REQUIRED]

      A list of possible values an attribute can take.

      • (string) --

  • LFTagPolicy (dict) --

    A list of LF-tag conditions that define a resource's LF-tag policy.

    • CatalogId (string) --

      The identifier for the Data Catalog. By default, the account ID. The Data Catalog is the persistent metadata store. It contains database definitions, table definitions, and other control information to manage your Lake Formation environment.

    • ResourceType (string) -- [REQUIRED]

      The resource type for which the LF-tag policy applies.

    • Expression (list) -- [REQUIRED]

      A list of LF-tag conditions that apply to the resource's LF-tag policy.

      • (dict) --

        A structure that allows an admin to grant user permissions on certain conditions. For example, granting a role access to all columns that do not have the LF-tag 'PII' in tables that have the LF-tag 'Prod'.

        • TagKey (string) -- [REQUIRED]

          The key-name for the LF-tag.

        • TagValues (list) -- [REQUIRED]

          A list of possible values an attribute can take.

          • (string) --

type Permissions

list

param Permissions

[REQUIRED]

The permissions revoked to the principal on the resource. For information about permissions, see Security and Access Control to Metadata and Data .

  • (string) --

type PermissionsWithGrantOption

list

param PermissionsWithGrantOption

Indicates a list of permissions for which to revoke the grant option allowing the principal to pass permissions to other principals.

  • (string) --

rtype

dict

returns

Response Syntax

{}

Response Structure

  • (dict) --