2021/04/01 - Amazon Lex Runtime Service - 2 updated api methods
Changes Amazon Lex now supports base64-encoded message and input transcript fields.
{'encodedInputTranscript': 'string', 'encodedMessage': 'string'}
Sends user input (text or speech) to Amazon Lex. Clients use this API to send text and audio requests to Amazon Lex at runtime. Amazon Lex interprets the user input using the machine learning model that it built for the bot.
The PostContent operation supports audio input at 8kHz and 16kHz. You can use 8kHz audio to achieve higher speech recognition accuracy in telephone audio applications.
In response, Amazon Lex returns the next message to convey to the user. Consider the following example messages:
For a user input "I would like a pizza," Amazon Lex might return a response with a message eliciting slot data (for example, PizzaSize ): "What size pizza would you like?".
After the user provides all of the pizza order information, Amazon Lex might return a response with a message to get user confirmation: "Order the pizza?".
After the user replies "Yes" to the confirmation prompt, Amazon Lex might return a conclusion statement: "Thank you, your cheese pizza has been ordered.".
Not all Amazon Lex messages require a response from the user. For example, conclusion statements do not require a response. Some messages require only a yes or no response. In addition to the message , Amazon Lex provides additional context about the message in the response that you can use to enhance client behavior, such as displaying the appropriate client user interface. Consider the following examples:
If the message is to elicit slot data, Amazon Lex returns the following context information:
x-amz-lex-dialog-state header set to ElicitSlot
x-amz-lex-intent-name header set to the intent name in the current context
x-amz-lex-slot-to-elicit header set to the slot name for which the message is eliciting information
x-amz-lex-slots header set to a map of slots configured for the intent with their current values
If the message is a confirmation prompt, the x-amz-lex-dialog-state header is set to Confirmation and the x-amz-lex-slot-to-elicit header is omitted.
If the message is a clarification prompt configured for the intent, indicating that the user intent is not understood, the x-amz-dialog-state header is set to ElicitIntent and the x-amz-slot-to-elicit header is omitted.
In addition, Amazon Lex also returns your application-specific sessionAttributes . For more information, see Managing Conversation Context .
See also: AWS API Documentation
Request Syntax
client.post_content(
botName='string',
botAlias='string',
userId='string',
sessionAttributes={...}|[...]|123|123.4|'string'|True|None,
requestAttributes={...}|[...]|123|123.4|'string'|True|None,
contentType='string',
accept='string',
inputStream=b'bytes'|file,
activeContexts={...}|[...]|123|123.4|'string'|True|None
)
string
[REQUIRED]
Name of the Amazon Lex bot.
string
[REQUIRED]
Alias of the Amazon Lex bot.
string
[REQUIRED]
The ID of the client application user. Amazon Lex uses this to identify a user's conversation with your bot. At runtime, each request must contain the userID field.
To decide the user ID to use for your application, consider the following factors.
The userID field must not contain any personally identifiable information of the user, for example, name, personal identification numbers, or other end user personal information.
If you want a user to start a conversation on one device and continue on another device, use a user-specific identifier.
If you want the same user to be able to have two independent conversations on two different devices, choose a device-specific identifier.
A user can't have two independent conversations with two different versions of the same bot. For example, a user can't have a conversation with the PROD and BETA versions of the same bot. If you anticipate that a user will need to have conversation with two different versions, for example, while testing, include the bot alias in the user ID to separate the two conversations.
JSON serializable
You pass this value as the x-amz-lex-session-attributes HTTP header.
Application-specific information passed between Amazon Lex and a client application. The value must be a JSON serialized and base64 encoded map with string keys and values. The total size of the sessionAttributes and requestAttributes headers is limited to 12 KB.
For more information, see Setting Session Attributes .
JSON serializable
You pass this value as the x-amz-lex-request-attributes HTTP header.
Request-specific information passed between Amazon Lex and a client application. The value must be a JSON serialized and base64 encoded map with string keys and values. The total size of the requestAttributes and sessionAttributes headers is limited to 12 KB.
The namespace x-amz-lex: is reserved for special attributes. Don't create any request attributes with the prefix x-amz-lex: .
For more information, see Setting Request Attributes .
string
[REQUIRED]
You pass this value as the Content-Type HTTP header.
Indicates the audio format or text. The header value must start with one of the following prefixes:
PCM format, audio data must be in little-endian byte order.
audio/l16; rate=16000; channels=1
audio/x-l16; sample-rate=16000; channel-count=1
audio/lpcm; sample-rate=8000; sample-size-bits=16; channel-count=1; is-big-endian=false
Opus format
audio/x-cbr-opus-with-preamble; preamble-size=0; bit-rate=256000; frame-size-milliseconds=4
Text format
text/plain; charset=utf-8
string
You pass this value as the Accept HTTP header.
The message Amazon Lex returns in the response can be either text or speech based on the Accept HTTP header value in the request.
If the value is text/plain; charset=utf-8 , Amazon Lex returns text in the response.
If the value begins with audio/ , Amazon Lex returns speech in the response. Amazon Lex uses Amazon Polly to generate the speech (using the configuration you specified in the Accept header). For example, if you specify audio/mpeg as the value, Amazon Lex returns speech in the MPEG format.
If the value is audio/pcm , the speech returned is audio/pcm in 16-bit, little endian format.
The following are the accepted values:
audio/mpeg
audio/ogg
audio/pcm
text/plain; charset=utf-8
audio/* (defaults to mpeg)
bytes or seekable file-like object
[REQUIRED]
User input in PCM or Opus audio format or text format as described in the Content-Type HTTP header.
You can stream audio data to Amazon Lex or you can create a local buffer that captures all of the audio data before sending. In general, you get better performance if you stream audio data rather than buffering the data locally.
JSON serializable
A list of contexts active for the request. A context can be activated when a previous intent is fulfilled, or by including the context in the request,
If you don't specify a list of contexts, Amazon Lex will use the current list of contexts for the session. If you specify an empty list, all contexts for the session are cleared.
dict
Response Syntax
{
'contentType': 'string',
'intentName': 'string',
'nluIntentConfidence': {...}|[...]|123|123.4|'string'|True|None,
'alternativeIntents': {...}|[...]|123|123.4|'string'|True|None,
'slots': {...}|[...]|123|123.4|'string'|True|None,
'sessionAttributes': {...}|[...]|123|123.4|'string'|True|None,
'sentimentResponse': 'string',
'message': 'string',
'encodedMessage': 'string',
'messageFormat': 'PlainText'|'CustomPayload'|'SSML'|'Composite',
'dialogState': 'ElicitIntent'|'ConfirmIntent'|'ElicitSlot'|'Fulfilled'|'ReadyForFulfillment'|'Failed',
'slotToElicit': 'string',
'inputTranscript': 'string',
'encodedInputTranscript': 'string',
'audioStream': b'bytes'|file,
'botVersion': 'string',
'sessionId': 'string',
'activeContexts': {...}|[...]|123|123.4|'string'|True|None
}
Response Structure
(dict) --
contentType (string) --
Content type as specified in the Accept HTTP header in the request.
intentName (string) --
Current user intent that Amazon Lex is aware of.
nluIntentConfidence (JSON serializable) --
Provides a score that indicates how confident Amazon Lex is that the returned intent is the one that matches the user's intent. The score is between 0.0 and 1.0.
The score is a relative score, not an absolute score. The score may change based on improvements to Amazon Lex.
alternativeIntents (JSON serializable) --
One to four alternative intents that may be applicable to the user's intent.
Each alternative includes a score that indicates how confident Amazon Lex is that the intent matches the user's intent. The intents are sorted by the confidence score.
slots (JSON serializable) --
Map of zero or more intent slots (name/value pairs) Amazon Lex detected from the user input during the conversation. The field is base-64 encoded.
Amazon Lex creates a resolution list containing likely values for a slot. The value that it returns is determined by the valueSelectionStrategy selected when the slot type was created or updated. If valueSelectionStrategy is set to ORIGINAL_VALUE , the value provided by the user is returned, if the user value is similar to the slot values. If valueSelectionStrategy is set to TOP_RESOLUTION Amazon Lex returns the first value in the resolution list or, if there is no resolution list, null. If you don't specify a valueSelectionStrategy , the default is ORIGINAL_VALUE .
sessionAttributes (JSON serializable) --
Map of key/value pairs representing the session-specific context information.
sentimentResponse (string) --
The sentiment expressed in an utterance.
When the bot is configured to send utterances to Amazon Comprehend for sentiment analysis, this field contains the result of the analysis.
message (string) --
You can only use this field in the de-DE, en-AU, en-GB, en-US, es-419, es-ES, es-US, fr-CA, fr-FR, and it-IT locales. In all other locales, the message field is null. You should use the encodedMessage field instead.
The message to convey to the user. The message can come from the bot's configuration or from a Lambda function.
If the intent is not configured with a Lambda function, or if the Lambda function returned Delegate as the dialogAction.type in its response, Amazon Lex decides on the next course of action and selects an appropriate message from the bot's configuration based on the current interaction context. For example, if Amazon Lex isn't able to understand user input, it uses a clarification prompt message.
When you create an intent you can assign messages to groups. When messages are assigned to groups Amazon Lex returns one message from each group in the response. The message field is an escaped JSON string containing the messages. For more information about the structure of the JSON string returned, see msg-prompts-formats .
If the Lambda function returns a message, Amazon Lex passes it to the client in its response.
encodedMessage (string) --
The message to convey to the user. The message can come from the bot's configuration or from a Lambda function.
If the intent is not configured with a Lambda function, or if the Lambda function returned Delegate as the dialogAction.type in its response, Amazon Lex decides on the next course of action and selects an appropriate message from the bot's configuration based on the current interaction context. For example, if Amazon Lex isn't able to understand user input, it uses a clarification prompt message.
When you create an intent you can assign messages to groups. When messages are assigned to groups Amazon Lex returns one message from each group in the response. The message field is an escaped JSON string containing the messages. For more information about the structure of the JSON string returned, see msg-prompts-formats .
If the Lambda function returns a message, Amazon Lex passes it to the client in its response.
The encodedMessage field is base-64 encoded. You must decode the field before you can use the value.
messageFormat (string) --
The format of the response message. One of the following values:
PlainText - The message contains plain UTF-8 text.
CustomPayload - The message is a custom format for the client.
SSML - The message contains text formatted for voice output.
Composite - The message contains an escaped JSON object containing one or more messages from the groups that messages were assigned to when the intent was created.
dialogState (string) --
Identifies the current state of the user interaction. Amazon Lex returns one of the following values as dialogState . The client can optionally use this information to customize the user interface.
ElicitIntent - Amazon Lex wants to elicit the user's intent. Consider the following examples: For example, a user might utter an intent ("I want to order a pizza"). If Amazon Lex cannot infer the user intent from this utterance, it will return this dialog state.
ConfirmIntent - Amazon Lex is expecting a "yes" or "no" response. For example, Amazon Lex wants user confirmation before fulfilling an intent. Instead of a simple "yes" or "no" response, a user might respond with additional information. For example, "yes, but make it a thick crust pizza" or "no, I want to order a drink." Amazon Lex can process such additional information (in these examples, update the crust type slot or change the intent from OrderPizza to OrderDrink).
ElicitSlot - Amazon Lex is expecting the value of a slot for the current intent. For example, suppose that in the response Amazon Lex sends this message: "What size pizza would you like?". A user might reply with the slot value (e.g., "medium"). The user might also provide additional information in the response (e.g., "medium thick crust pizza"). Amazon Lex can process such additional information appropriately.
Fulfilled - Conveys that the Lambda function has successfully fulfilled the intent.
ReadyForFulfillment - Conveys that the client has to fulfill the request.
Failed - Conveys that the conversation with the user failed. This can happen for various reasons, including that the user does not provide an appropriate response to prompts from the service (you can configure how many times Amazon Lex can prompt a user for specific information), or if the Lambda function fails to fulfill the intent.
slotToElicit (string) --
If the dialogState value is ElicitSlot , returns the name of the slot for which Amazon Lex is eliciting a value.
inputTranscript (string) --
The text used to process the request.
You can use this field only in the de-DE, en-AU, en-GB, en-US, es-419, es-ES, es-US, fr-CA, fr-FR, and it-IT locales. In all other locales, the inputTranscript field is null. You should use the encodedInputTranscript field instead.
If the input was an audio stream, the inputTranscript field contains the text extracted from the audio stream. This is the text that is actually processed to recognize intents and slot values. You can use this information to determine if Amazon Lex is correctly processing the audio that you send.
encodedInputTranscript (string) --
The text used to process the request.
If the input was an audio stream, the encodedInputTranscript field contains the text extracted from the audio stream. This is the text that is actually processed to recognize intents and slot values. You can use this information to determine if Amazon Lex is correctly processing the audio that you send.
The encodedInputTranscript field is base-64 encoded. You must decode the field before you can use the value.
audioStream (bytes or seekable file-like object) --
The prompt (or statement) to convey to the user. This is based on the bot configuration and context. For example, if Amazon Lex did not understand the user intent, it sends the clarificationPrompt configured for the bot. If the intent requires confirmation before taking the fulfillment action, it sends the confirmationPrompt . Another example: Suppose that the Lambda function successfully fulfilled the intent, and sent a message to convey to the user. Then Amazon Lex sends that message in the response.
botVersion (string) --
The version of the bot that responded to the conversation. You can use this information to help determine if one version of a bot is performing better than another version.
sessionId (string) --
The unique identifier for the session.
activeContexts (JSON serializable) --
A list of active contexts for the session. A context can be set when an intent is fulfilled or by calling the PostContent , PostText , or PutSession operation.
You can use a context to control the intents that can follow up an intent, or to modify the operation of your application.
{'encodedMessage': 'string'}
Creates a new session or modifies an existing session with an Amazon Lex bot. Use this operation to enable your application to set the state of the bot.
For more information, see Managing Sessions .
See also: AWS API Documentation
Request Syntax
client.put_session(
botName='string',
botAlias='string',
userId='string',
sessionAttributes={
'string': 'string'
},
dialogAction={
'type': 'ElicitIntent'|'ConfirmIntent'|'ElicitSlot'|'Close'|'Delegate',
'intentName': 'string',
'slots': {
'string': 'string'
},
'slotToElicit': 'string',
'fulfillmentState': 'Fulfilled'|'Failed'|'ReadyForFulfillment',
'message': 'string',
'messageFormat': 'PlainText'|'CustomPayload'|'SSML'|'Composite'
},
recentIntentSummaryView=[
{
'intentName': 'string',
'checkpointLabel': 'string',
'slots': {
'string': 'string'
},
'confirmationStatus': 'None'|'Confirmed'|'Denied',
'dialogActionType': 'ElicitIntent'|'ConfirmIntent'|'ElicitSlot'|'Close'|'Delegate',
'fulfillmentState': 'Fulfilled'|'Failed'|'ReadyForFulfillment',
'slotToElicit': 'string'
},
],
accept='string',
activeContexts=[
{
'name': 'string',
'timeToLive': {
'timeToLiveInSeconds': 123,
'turnsToLive': 123
},
'parameters': {
'string': 'string'
}
},
]
)
string
[REQUIRED]
The name of the bot that contains the session data.
string
[REQUIRED]
The alias in use for the bot that contains the session data.
string
[REQUIRED]
The ID of the client application user. Amazon Lex uses this to identify a user's conversation with your bot.
dict
Map of key/value pairs representing the session-specific context information. It contains application information passed between Amazon Lex and a client application.
(string) --
(string) --
dict
Sets the next action that the bot should take to fulfill the conversation.
type (string) -- [REQUIRED]
The next action that the bot should take in its interaction with the user. The possible values are:
ConfirmIntent - The next action is asking the user if the intent is complete and ready to be fulfilled. This is a yes/no question such as "Place the order?"
Close - Indicates that the there will not be a response from the user. For example, the statement "Your order has been placed" does not require a response.
Delegate - The next action is determined by Amazon Lex.
ElicitIntent - The next action is to determine the intent that the user wants to fulfill.
ElicitSlot - The next action is to elicit a slot value from the user.
intentName (string) --
The name of the intent.
slots (dict) --
Map of the slots that have been gathered and their values.
(string) --
(string) --
slotToElicit (string) --
The name of the slot that should be elicited from the user.
fulfillmentState (string) --
The fulfillment state of the intent. The possible values are:
Failed - The Lambda function associated with the intent failed to fulfill the intent.
Fulfilled - The intent has fulfilled by the Lambda function associated with the intent.
ReadyForFulfillment - All of the information necessary for the intent is present and the intent ready to be fulfilled by the client application.
message (string) --
The message that should be shown to the user. If you don't specify a message, Amazon Lex will use the message configured for the intent.
messageFormat (string) --
PlainText - The message contains plain UTF-8 text.
CustomPayload - The message is a custom format for the client.
SSML - The message contains text formatted for voice output.
Composite - The message contains an escaped JSON object containing one or more messages. For more information, see Message Groups .
list
A summary of the recent intents for the bot. You can use the intent summary view to set a checkpoint label on an intent and modify attributes of intents. You can also use it to remove or add intent summary objects to the list.
An intent that you modify or add to the list must make sense for the bot. For example, the intent name must be valid for the bot. You must provide valid values for:
intentName
slot names
slotToElict
If you send the recentIntentSummaryView parameter in a PutSession request, the contents of the new summary view replaces the old summary view. For example, if a GetSession request returns three intents in the summary view and you call PutSession with one intent in the summary view, the next call to GetSession will only return one intent.
(dict) --
Provides information about the state of an intent. You can use this information to get the current state of an intent so that you can process the intent, or so that you can return the intent to its previous state.
intentName (string) --
The name of the intent.
checkpointLabel (string) --
A user-defined label that identifies a particular intent. You can use this label to return to a previous intent.
Use the checkpointLabelFilter parameter of the GetSessionRequest operation to filter the intents returned by the operation to those with only the specified label.
slots (dict) --
Map of the slots that have been gathered and their values.
(string) --
(string) --
confirmationStatus (string) --
The status of the intent after the user responds to the confirmation prompt. If the user confirms the intent, Amazon Lex sets this field to Confirmed . If the user denies the intent, Amazon Lex sets this value to Denied . The possible values are:
Confirmed - The user has responded "Yes" to the confirmation prompt, confirming that the intent is complete and that it is ready to be fulfilled.
Denied - The user has responded "No" to the confirmation prompt.
None - The user has never been prompted for confirmation; or, the user was prompted but did not confirm or deny the prompt.
dialogActionType (string) -- [REQUIRED]
The next action that the bot should take in its interaction with the user. The possible values are:
ConfirmIntent - The next action is asking the user if the intent is complete and ready to be fulfilled. This is a yes/no question such as "Place the order?"
Close - Indicates that the there will not be a response from the user. For example, the statement "Your order has been placed" does not require a response.
ElicitIntent - The next action is to determine the intent that the user wants to fulfill.
ElicitSlot - The next action is to elicit a slot value from the user.
fulfillmentState (string) --
The fulfillment state of the intent. The possible values are:
Failed - The Lambda function associated with the intent failed to fulfill the intent.
Fulfilled - The intent has fulfilled by the Lambda function associated with the intent.
ReadyForFulfillment - All of the information necessary for the intent is present and the intent ready to be fulfilled by the client application.
slotToElicit (string) --
The next slot to elicit from the user. If there is not slot to elicit, the field is blank.
string
The message that Amazon Lex returns in the response can be either text or speech based depending on the value of this field.
If the value is text/plain; charset=utf-8 , Amazon Lex returns text in the response.
If the value begins with audio/ , Amazon Lex returns speech in the response. Amazon Lex uses Amazon Polly to generate the speech in the configuration that you specify. For example, if you specify audio/mpeg as the value, Amazon Lex returns speech in the MPEG format.
If the value is audio/pcm , the speech is returned as audio/pcm in 16-bit, little endian format.
The following are the accepted values:
audio/mpeg
audio/ogg
audio/pcm
audio/* (defaults to mpeg)
text/plain; charset=utf-8
list
A list of contexts active for the request. A context can be activated when a previous intent is fulfilled, or by including the context in the request,
If you don't specify a list of contexts, Amazon Lex will use the current list of contexts for the session. If you specify an empty list, all contexts for the session are cleared.
(dict) --
A context is a variable that contains information about the current state of the conversation between a user and Amazon Lex. Context can be set automatically by Amazon Lex when an intent is fulfilled, or it can be set at runtime using the PutContent , PutText , or PutSession operation.
name (string) -- [REQUIRED]
The name of the context.
timeToLive (dict) -- [REQUIRED]
The length of time or number of turns that a context remains active.
timeToLiveInSeconds (integer) --
The number of seconds that the context should be active after it is first sent in a PostContent or PostText response. You can set the value between 5 and 86,400 seconds (24 hours).
turnsToLive (integer) --
The number of conversation turns that the context should be active. A conversation turn is one PostContent or PostText request and the corresponding response from Amazon Lex.
parameters (dict) -- [REQUIRED]
State variables for the current context. You can use these values as default values for slots in subsequent events.
(string) --
(string) --
dict
Response Syntax
{
'contentType': 'string',
'intentName': 'string',
'slots': {...}|[...]|123|123.4|'string'|True|None,
'sessionAttributes': {...}|[...]|123|123.4|'string'|True|None,
'message': 'string',
'encodedMessage': 'string',
'messageFormat': 'PlainText'|'CustomPayload'|'SSML'|'Composite',
'dialogState': 'ElicitIntent'|'ConfirmIntent'|'ElicitSlot'|'Fulfilled'|'ReadyForFulfillment'|'Failed',
'slotToElicit': 'string',
'audioStream': StreamingBody(),
'sessionId': 'string',
'activeContexts': {...}|[...]|123|123.4|'string'|True|None
}
Response Structure
(dict) --
contentType (string) --
Content type as specified in the Accept HTTP header in the request.
intentName (string) --
The name of the current intent.
slots (JSON serializable) --
Map of zero or more intent slots Amazon Lex detected from the user input during the conversation.
Amazon Lex creates a resolution list containing likely values for a slot. The value that it returns is determined by the valueSelectionStrategy selected when the slot type was created or updated. If valueSelectionStrategy is set to ORIGINAL_VALUE , the value provided by the user is returned, if the user value is similar to the slot values. If valueSelectionStrategy is set to TOP_RESOLUTION Amazon Lex returns the first value in the resolution list or, if there is no resolution list, null. If you don't specify a valueSelectionStrategy the default is ORIGINAL_VALUE .
sessionAttributes (JSON serializable) --
Map of key/value pairs representing session-specific context information.
message (string) --
The next message that should be presented to the user.
You can only use this field in the de-DE, en-AU, en-GB, en-US, es-419, es-ES, es-US, fr-CA, fr-FR, and it-IT locales. In all other locales, the message field is null. You should use the encodedMessage field instead.
encodedMessage (string) --
The next message that should be presented to the user.
The encodedMessage field is base-64 encoded. You must decode the field before you can use the value.
messageFormat (string) --
The format of the response message. One of the following values:
PlainText - The message contains plain UTF-8 text.
CustomPayload - The message is a custom format for the client.
SSML - The message contains text formatted for voice output.
Composite - The message contains an escaped JSON object containing one or more messages from the groups that messages were assigned to when the intent was created.
dialogState (string) --
ConfirmIntent - Amazon Lex is expecting a "yes" or "no" response to confirm the intent before fulfilling an intent.
ElicitIntent - Amazon Lex wants to elicit the user's intent.
ElicitSlot - Amazon Lex is expecting the value of a slot for the current intent.
Failed - Conveys that the conversation with the user has failed. This can happen for various reasons, including the user does not provide an appropriate response to prompts from the service, or if the Lambda function fails to fulfill the intent.
Fulfilled - Conveys that the Lambda function has sucessfully fulfilled the intent.
ReadyForFulfillment - Conveys that the client has to fulfill the intent.
slotToElicit (string) --
If the dialogState is ElicitSlot , returns the name of the slot for which Amazon Lex is eliciting a value.
audioStream (:class:`.StreamingBody`) --
The audio version of the message to convey to the user.
sessionId (string) --
A unique identifier for the session.
activeContexts (JSON serializable) --
A list of active contexts for the session.