Selecting a device to respond to device-agnostic user requests

Abstract

Implementations relate to selecting a particular device, from an ecosystem of devices, to provide responses to a device-agnostic request of the user while a scenario is occurring. The user specifies a scenario and contextual features are identified from one or more devices of the ecosystem to generate scenario features indicative of the scenario occurring. The scenario features are stored with a correlation to a device that is specified by the user to handle responses while the scenario is occurring. When a subsequent device-agnostic request is received, current contextual features are identified and compared to the scenario features. Based on the comparison, the specified assistant device is selected to respond to the device-agnostic request.

1 . A system, comprising:
 memory storing instructions;   one or more processors operable to execute the instructions to:
 receive user interface input that specifies:
 a scenario, and 
 a particular assistant device, of an ecosystem of linked assistant devices, to be utilized for interfacing with a user during automated assistant interactions when a subsequent device-agnostic request is received while the scenario is occurring; 
 
 store, in response to receiving the user interface input, an entry defining a correlation of the scenario to the particular assistant device; 
 receive an instance of further user interface input that indicates the scenario occurred during a given temporal period; 
 in response to receiving the instance of further user interface input:
 identify one or more contextual features present during the given temporal period, the one or more contextual features generated based on one or more sensors of one or more of the linked assistant devices; 
 generate, based on the contextual features, scenario features for the scenario; 
 
 subsequent to receiving the user interface input and the further user interface input:
 determine, based on comparing current contextual features to the scenario features, that the scenario is occurring; and 
 in response to determining that the scenario is occurring, select the particular assistant device for rendering assistant content, where selecting the particular assistant device is responsive to determining that the scenario is occurring and responsive to the entry defining the correlation of the scenario to the particular assistant device. 
 
   
     
     
         2 . The system of  claim 1 , wherein the one or more contextual features include an encoding of given sensor data from the sensors of a given linked assistant device of the linked assistant devices. 
     
     
         3 . The system of  claim 2 , wherein the encoding of the sensor data is generated by the given linked assistant device. 
     
     
         4 . The system of  claim 2 , wherein in generating the scenario features one or more of the processors are to combine the encoding with one or more other encodings from other of the linked assistant devices of the ecosystem. 
     
     
         5 . The system of  claim 1 , wherein at least one of the user interface input and the further user interface input is received from a given linked assistant device, of the ecosystem, that is different from the particular assistant device for responding to the assistant request. 
     
     
         6 . The system of  claim 1 , wherein in determining, based on comparing the current contextual features to the scenario features, that the scenario is occurring one or more of the processors are to:
 determine that the current contextual features are within a threshold distance of the scenario features.   
     
     
         7 . The system of  claim 1 , wherein one or more of the processors are further operable to execute the instructions to:
 generate, based on the scenario features, an area in an embedding space, wherein contextual features that are embedded within the area are indicative of the scenario.   
     
     
         8 . The system of  claim 7 , wherein in determining, based on comparing the current contextual features to the scenario features, that the scenario is occurring one or more of the processors are to:
 determine that the current contextual features are within the area.   
     
     
         9 . The system of  claim 1 , wherein the given temporal period is concurrent with receiving the instance of further user interface input. 
     
     
         10 . A system, comprising:
 memory storing instructions;   one or more processors operable to execute the instructions to:
 receive user interface input that specifies a particular assistant device, of an ecosystem of linked assistant devices, to be utilized for interfacing with a user during automated assistant interactions while a scenario, that is currently occurring, subsequently is occurring when a device-agnostic request is received; 
 in response to receiving the user interface input:
 identify one or more first contextual features generated based on sensor data from one or more sensors of one or more of the linked assistant devices; 
 generate, based on the first contextual features, one or more scenario features for the scenario; 
 store an entry defining a correlation of the one or more scenario features with the particular assistant device; 
 
 subsequent to receiving the user interface input:
 determine, based on comparing current contextual features to the scenario features, that the scenario is occurring; and 
 in response to determining that the scenario is occurring, select the particular assistant device for rendering assistant content, where selecting the particular assistant device is responsive to determining that the scenario is occurring and responsive to the entry defining the correlation of the scenario to the particular assistant device. 
 
   
     
     
         11 . The system of  claim 10 , wherein one or more of the processors are further operable to execute the instructions to:
 identify, based on the user interface input, a user profile associated with the user; and   store, with the entry, an indication of the user profile.   
     
     
         12 . The system of  claim 11 , wherein the user interface input is audio data captured by one or more microphones of one or more of the devices of the ecosystem. 
     
     
         13 . The system of  claim 12 , wherein in identifying the user profile one or more of the processors are to perform speaker identification utilizing the audio data. 
     
     
         14 . The system of  claim 12 , wherein one or more of the processors are further operable to execute the instructions to:
 receive user feedback indicating whether the scenario was occurring when the particular assistant device was selected.   
     
     
         15 . The system of  claim 14 , wherein one or more of the processors are further operable to execute the instructions to:
 update the one or more scenario features in response to the user feedback and based on the one or more current contextual features.   
     
     
         16 . A system, comprising:
 memory storing instructions;   one or more processors operable to execute the instructions to:
 identify one or more scenario features, generated based on sensor data from one or more sensors of one or more assistant devices, of an ecosystem of linked assistant devices, while a first scenario is occurring; 
 store the one or more scenario features with a correlation to a particular assistant device, of the ecosystem of linked assistant devices, that was specified by a user to be utilized for interfacing with the user during automated assistant interactions when the scenario is occurring; 
 receive, via one or more assistant devices of the ecosystem of linked assistant devices, a device-agnostic assistant request; 
 identify one or more current contextual features for the device-agnostic assistant request; 
 determine, based on comparing the current contextual features to the scenario features, that the scenario is occurring; and 
 select the particular assistant device for responding to the assistant request, where selecting the particular assistant device is responsive to determining that the scenario is occurring and is responsive to the correlation of the one or more scenario features with the automated assistant device. 
   
     
     
         17 . The system of  claim 16 , wherein one or more of the processors are further operable to execute the instructions to:
 prior to identifying the one or more scenario features, receive user interface input that specifies the particular assistant device, with an indication that the scenario is occurring.   
     
     
         18 . The system of  claim 17 , wherein one or more of the processors are further operable to execute the instructions to:
 prior to receiving the user interface input:
 receive, via one or more assistant devices of the ecosystem of linked assistant devices, an initial device-agnostic assistant request; 
 select a different one of the devices of the ecosystem, that is different than the particular assistant device, for responding to the initial device-agnostic assistant request; and 
 cause a response to the initial device-agnostic assistant request to be rendered by the different one of the devices of the ecosystem. 
   
     
     
         19 . The system of  claim 18 , wherein in selecting a different one of the devices of the ecosystem one or more of the processors are to:
 determine a proximity of the different one of the devices to the user; and   select the different one of the devices based on the proximity.   
     
     
         20 . The system of  claim 19 , wherein the user interface input that specifies the particular assistant device further indicates a user preference of the particular assistant device over the different device while the scenario is occurring.