2017/02/27 - Amazon DynamoDB Streams - 1 updated api methods
Changes Time to Live (TTL) is a feature that allows you to define when items in a table expire and can be purged from the database, so that you don't have to track expired data and delete it manually. With TTL enabled on a DynamoDB table, you can set a timestamp for deletion on a per-item basis, allowing you to limit storage usage to only those records that are relevant.
{'Records': {'userIdentity': {'PrincipalId': 'string', 'Type': 'string'}}}
Retrieves the stream records from a given shard.
Specify a shard iterator using the ShardIterator parameter. The shard iterator specifies the position in the shard from which you want to start reading stream records sequentially. If there are no stream records available in the portion of the shard that the iterator points to, GetRecords returns an empty list. Note that it might take multiple calls to get to a portion of the shard that contains stream records.
Note
GetRecords can retrieve a maximum of 1 MB of data or 1000 stream records, whichever comes first.
See also: AWS API Documentation
Request Syntax
client.get_records(
ShardIterator='string',
Limit=123
)
string
[REQUIRED]
A shard iterator that was retrieved from a previous GetShardIterator operation. This iterator can be used to access the stream records in this shard.
integer
The maximum number of records to return from the shard. The upper limit is 1000.
dict
Response Syntax
{
'Records': [
{
'eventID': 'string',
'eventName': 'INSERT'|'MODIFY'|'REMOVE',
'eventVersion': 'string',
'eventSource': 'string',
'awsRegion': 'string',
'dynamodb': {
'ApproximateCreationDateTime': datetime(2015, 1, 1),
'Keys': {
'string': {
'S': 'string',
'N': 'string',
'B': b'bytes',
'SS': [
'string',
],
'NS': [
'string',
],
'BS': [
b'bytes',
],
'M': {
'string': {'... recursive ...'}
},
'L': [
{'... recursive ...'},
],
'NULL': True|False,
'BOOL': True|False
}
},
'NewImage': {
'string': {
'S': 'string',
'N': 'string',
'B': b'bytes',
'SS': [
'string',
],
'NS': [
'string',
],
'BS': [
b'bytes',
],
'M': {
'string': {'... recursive ...'}
},
'L': [
{'... recursive ...'},
],
'NULL': True|False,
'BOOL': True|False
}
},
'OldImage': {
'string': {
'S': 'string',
'N': 'string',
'B': b'bytes',
'SS': [
'string',
],
'NS': [
'string',
],
'BS': [
b'bytes',
],
'M': {
'string': {'... recursive ...'}
},
'L': [
{'... recursive ...'},
],
'NULL': True|False,
'BOOL': True|False
}
},
'SequenceNumber': 'string',
'SizeBytes': 123,
'StreamViewType': 'NEW_IMAGE'|'OLD_IMAGE'|'NEW_AND_OLD_IMAGES'|'KEYS_ONLY'
},
'userIdentity': {
'PrincipalId': 'string',
'Type': 'string'
}
},
],
'NextShardIterator': 'string'
}
Response Structure
(dict) --
Represents the output of a GetRecords operation.
Records (list) --
The stream records from the shard, which were retrieved using the shard iterator.
(dict) --
A description of a unique event within a stream.
eventID (string) --
A globally unique identifier for the event that was recorded in this stream record.
eventName (string) --
The type of data modification that was performed on the DynamoDB table:
INSERT - a new item was added to the table.
MODIFY - one or more of an existing item's attributes were modified.
REMOVE - the item was deleted from the table
eventVersion (string) --
The version number of the stream record format. This number is updated whenever the structure of Record is modified.
Client applications must not assume that eventVersion will remain at a particular value, as this number is subject to change at any time. In general, eventVersion will only increase as the low-level DynamoDB Streams API evolves.
eventSource (string) --
The AWS service from which the stream record originated. For DynamoDB Streams, this is aws:dynamodb .
awsRegion (string) --
The region in which the GetRecords request was received.
dynamodb (dict) --
The main body of the stream record, containing all of the DynamoDB-specific fields.
ApproximateCreationDateTime (datetime) --
The approximate date and time when the stream record was created, in UNIX epoch time format.
Keys (dict) --
The primary key attribute(s) for the DynamoDB item that was modified.
(string) --
(dict) --
Represents the data for an attribute. You can set one, and only one, of the elements.
Each attribute in an item is a name-value pair. An attribute can be single-valued or multi-valued set. For example, a book item can have title and authors attributes. Each book has one title but can have many authors. The multi-valued attribute is a set; duplicate values are not allowed.
S (string) --
A String data type.
N (string) --
A Number data type.
B (bytes) --
A Binary data type.
SS (list) --
A String Set data type.
(string) --
NS (list) --
A Number Set data type.
(string) --
BS (list) --
A Binary Set data type.
(bytes) --
M (dict) --
A Map data type.
(string) --
(dict) --
Represents the data for an attribute. You can set one, and only one, of the elements.
Each attribute in an item is a name-value pair. An attribute can be single-valued or multi-valued set. For example, a book item can have title and authors attributes. Each book has one title but can have many authors. The multi-valued attribute is a set; duplicate values are not allowed.
L (list) --
A List data type.
(dict) --
Represents the data for an attribute. You can set one, and only one, of the elements.
Each attribute in an item is a name-value pair. An attribute can be single-valued or multi-valued set. For example, a book item can have title and authors attributes. Each book has one title but can have many authors. The multi-valued attribute is a set; duplicate values are not allowed.
NULL (boolean) --
A Null data type.
BOOL (boolean) --
A Boolean data type.
NewImage (dict) --
The item in the DynamoDB table as it appeared after it was modified.
(string) --
(dict) --
Represents the data for an attribute. You can set one, and only one, of the elements.
Each attribute in an item is a name-value pair. An attribute can be single-valued or multi-valued set. For example, a book item can have title and authors attributes. Each book has one title but can have many authors. The multi-valued attribute is a set; duplicate values are not allowed.
S (string) --
A String data type.
N (string) --
A Number data type.
B (bytes) --
A Binary data type.
SS (list) --
A String Set data type.
(string) --
NS (list) --
A Number Set data type.
(string) --
BS (list) --
A Binary Set data type.
(bytes) --
M (dict) --
A Map data type.
(string) --
(dict) --
Represents the data for an attribute. You can set one, and only one, of the elements.
Each attribute in an item is a name-value pair. An attribute can be single-valued or multi-valued set. For example, a book item can have title and authors attributes. Each book has one title but can have many authors. The multi-valued attribute is a set; duplicate values are not allowed.
L (list) --
A List data type.
(dict) --
Represents the data for an attribute. You can set one, and only one, of the elements.
Each attribute in an item is a name-value pair. An attribute can be single-valued or multi-valued set. For example, a book item can have title and authors attributes. Each book has one title but can have many authors. The multi-valued attribute is a set; duplicate values are not allowed.
NULL (boolean) --
A Null data type.
BOOL (boolean) --
A Boolean data type.
OldImage (dict) --
The item in the DynamoDB table as it appeared before it was modified.
(string) --
(dict) --
Represents the data for an attribute. You can set one, and only one, of the elements.
Each attribute in an item is a name-value pair. An attribute can be single-valued or multi-valued set. For example, a book item can have title and authors attributes. Each book has one title but can have many authors. The multi-valued attribute is a set; duplicate values are not allowed.
S (string) --
A String data type.
N (string) --
A Number data type.
B (bytes) --
A Binary data type.
SS (list) --
A String Set data type.
(string) --
NS (list) --
A Number Set data type.
(string) --
BS (list) --
A Binary Set data type.
(bytes) --
M (dict) --
A Map data type.
(string) --
(dict) --
Represents the data for an attribute. You can set one, and only one, of the elements.
Each attribute in an item is a name-value pair. An attribute can be single-valued or multi-valued set. For example, a book item can have title and authors attributes. Each book has one title but can have many authors. The multi-valued attribute is a set; duplicate values are not allowed.
L (list) --
A List data type.
(dict) --
Represents the data for an attribute. You can set one, and only one, of the elements.
Each attribute in an item is a name-value pair. An attribute can be single-valued or multi-valued set. For example, a book item can have title and authors attributes. Each book has one title but can have many authors. The multi-valued attribute is a set; duplicate values are not allowed.
NULL (boolean) --
A Null data type.
BOOL (boolean) --
A Boolean data type.
SequenceNumber (string) --
The sequence number of the stream record.
SizeBytes (integer) --
The size of the stream record, in bytes.
StreamViewType (string) --
The type of data from the modified DynamoDB item that was captured in this stream record:
KEYS_ONLY - only the key attributes of the modified item.
NEW_IMAGE - the entire item, as it appeared after it was modified.
OLD_IMAGE - the entire item, as it appeared before it was modified.
NEW_AND_OLD_IMAGES - both the new and the old item images of the item.
userIdentity (dict) --
Items that are deleted by the Time to Live process after expiration have the following fields:
Records[].userIdentity.type "Service"
Records[].userIdentity.principalId "dynamodb.amazonaws.com"
PrincipalId (string) --
A unique identifier for the entity that made the call. For Time To Live, the principalId is "dynamodb.amazonaws.com".
Type (string) --
The type of the identity. For Time To Live, the type is "Service".
NextShardIterator (string) --
The next position in the shard from which to start sequentially reading stream records. If set to null , the shard has been closed and the requested iterator will not return any more data.