Home api

Abstract

The present disclosure contemplates a variety of improved methods and systems for controlling a variety of disparate home devices coupled to the framework and/or ambient operating system (AmbientOS). This home application programming interface (API) exposes the operation of the home devices in a natural and intuitive manner, facilitating control of unknown devices by high level commands. The home devices are contextually responsive to API commands. Additionally, the home application programming interface can customizing an application developed to control devices in an environment to control the devices in the environment via an assistant device with artificial intelligence (AI) capabilities.

1 . A method for customizing an application developed to control devices in an environment via an assistant device with artificial intelligence (AI) capabilities, comprising:
 receiving a request from the application developed to control the devices in the environment, wherein the request includes device properties including one or more device functionalities and one or more device types and an indicator representing an occurrence identified by a video monitoring service;   identifying a first connected device connected to the assistant device in the environment having a first subset of the one or more device functionalities and a first subset of the one or more device types associated with the application developed to the control the devices in the environment;   identifying a second connected device connected to the assistant device in the environment having a second subset of the one or more device functionalities and a second subset of the one or more device types associated with the application developed to the control the devices in the environment;   identifying a first identifier of the first connected device and a second identifier of the second connected device, the first identifier and the second identifier each representing a corresponding reference to respective adapters of the first connected device and the second connected device allowing the application to perform the one or more device functionalities;   determining that the first subset of the one or more device functionalities associated with the first connected device and the second subset of the one or more device functionalities associated with the second connected device are associated with a rule, wherein the rule indicates that the first connected device and the second connected device cannot operate together in accordance with the rule representing functionalities that should not be operating at a same time when the video monitoring service identifies the indicator of the occurrence;   transmitting the first identifier, the second identifier and the rule associated with the first connected device and the second connected device representing that the application cannot perform the respective one or more functionalities associated with connected device and the second connected device at the same time when the video monitoring service identifies the indicator of the occurrence; and   displaying a notification indicating that the first connected device, and the second connected device cannot perform the one or more functionalities because the video monitoring service identified the indicator of the occurrence.   
     
     
         2 . A method for customizing an application developed to control devices in an environment via an assistant device with artificial intelligence (AI) capabilities, comprising:
 receiving a request from the application developed to control the devices in the environment, wherein the request includes device properties including one or more device functionalities and one or more device types and an indicator representing an occurrence identified by a video monitoring service;   identifying a first connected device connected to the assistant device in the environment having a first subset of the one or more device functionalities and a first subset of the one or more device types associated with the application developed to the control the devices in the environment;   identifying a second connected device connected to the assistant device in the environment having a second subset of the one or more device functionalities and a second subset of the one or more device types associated with the application developed to the control the devices in the environment;   identifying a first identifier of the first connected device and a second identifier of the second connected device, the first identifier and the second identifier each representing a corresponding reference to respective adapters of the first connected device and the second connected device allowing the application to perform the one or more device functionalities;   determining that the first subset of the one or more device functionalities associated with the first connected device and the second subset of the one or more device functionalities associated with the second connected device are associated with a rule;   receiving the indicator representing the occurrence identified by the video monitoring service; and   transmitting the first identifier, the second identifier and the rule associated with the first connected device and the second connected device to the first connected device and the second connected device when the video monitoring service identifies the indicator of the occurrence.   
     
     
         3 . The method of  claim 2 , wherein determination that the that the first subset of the one or more device functionalities associated with the first connected device and the second subset of the one or more device functionalities associated with the second connected device are associated with the rule is performed by accessing a rules definition database. 
     
     
         4 . The method of  claim 3 , wherein the rules definition database includes a first one or more attributes associated with the first connected device. 
     
     
         5 . The method of  claim 4 , wherein the rules definition database includes a second one or more attributes associated with the second connected device. 
     
     
         6 . The method of  claim 5 , wherein the rule indicates that the first one or more attributes associated with the first connected device are not compatible with the second one or more attributes associated with the second connected device. 
     
     
         7 . The method of  claim 4 , wherein the rule indicates that the first one or more attributes associated with the first connected device is time sensitive. 
     
     
         8 . The method of  claim 4 , wherein the rule indicates that the first one or more attributes associated with the first connected device is security related. 
     
     
         9 . A system for customizing an application developed to control devices in an environment via an assistant device, comprising:
 a processor;   a rules definition database; and   a memory storing instructions, wherein the processor is configured to execute the instructions such that the processor and memory are configured to:   receive a request from the application developed to control the devices in the environment, wherein the request includes device properties including one or more device functionalities and one or more device types and an indicator representing an occurrence identified by a video monitoring service;   identify a first connected device connected to the assistant device in the environment having a first subset of the one or more device functionalities and a first subset of the one or more device types associated with the application developed to the control the devices in the environment;   identify a second connected device connected to the assistant device in the environment having a second subset of the one or more device functionalities and a second subset of the one or more device types associated with the application developed to the control the devices in the environment;   identify a first identifier of the first connected device and a second identifier of the second connected device, the first identifier and the second identifier each representing a corresponding reference to respective adapters of the first connected device and the second connected device allowing the application to perform the one or more device functionalities;   determine using the rules definition database that the first subset of the one or more device functionalities associated with the first connected device and the second subset of the one or more device functionalities associated with the second connected device are associated with a rule;   receive the indicator representing the occurrence identified by the video monitoring service; and   transmit the first identifier, the second identifier and the rule associated with the first connected device and the second connected device to the first connected device and the second connected device when the video monitoring service identifies the indicator of the occurrence.   
     
     
         10 . The system of  claim 9 , wherein the rules definition database includes a first one or more attributes associated with the first connected device. 
     
     
         11 . The system of  claim 10 , wherein the rules definition database includes a second one or more attributes associated with the second connected device. 
     
     
         12 . The system of  claim 11 , wherein the rule indicates that the first one or more attributes associated with the first connected device are not compatible with the second one or more attributes associated with the second connected device. 
     
     
         13 . The system of  claim 10 , wherein the rule indicates that the first one or more attributes associated with the first connected device is time sensitive. 
     
     
         14 . The system of  claim 10 , wherein the rule indicates that the first one or more attributes associated with the first connected device is security related. 
     
     
         15 . A computer program product for customizing an application developed to control devices in an environment via an assistant device, comprising one or more non-transitory computer-readable media having computer program instructions stored therein, the computer program instructions being configured such that, when executed by one or more computing devices, the computer program instructions cause the one or more computing devices to:
 receive a request from the application developed to control the devices in the environment, wherein the request includes device properties including one or more device functionalities, one or more device types and an indicator representing an occurrence identified by a video monitoring service;   identify a first connected device connected to the assistant device in the environment having a first subset of the one or more device functionalities and a first subset of the one or more device types associated with the application developed to the control the devices in the environment;   identify a second connected device connected to the assistant device in the environment having a second subset of the one or more device functionalities and a second subset of the one or more device types associated with the application developed to the control the devices in the environment;   identify a first identifier of the first connected device and a second identifier of the second connected device, the first identifier and the second identifier each representing a corresponding reference to respective adapters of the first connected device and the second connected device allowing the application to perform the one or more device functionalities;   determine that the first subset of the one or more device functionalities associated with the first connected device and the second subset of the one or more device functionalities associated with the second connected device are associated with a rule;   receive the indicator representing the occurrence identified by the video monitoring service;   and   transmit the first identifier, the second identifier and the rule associated with the first connected device and the second connected device to the first connected device and the second connected device when the video monitoring service identifies the indicator of the occurrence.   
     
     
         16 . A computer program product of  claim 15 , wherein determination that the that the first subset of the one or more device functionalities associated with the first connected device and the second subset of the one or more device functionalities associated with the second connected device are associated with the rule is performed by accessing a rules definition database. 
     
     
         17 . The computer program product of  claim 16 , wherein the rules definition database includes a first one or more attributes associated with the first connected device. 
     
     
         18 . The computer program product of  claim 17 , wherein the rules definition database includes a second one or more attributes associated with the second connected device. 
     
     
         19 . The computer program product of  claim 18 , wherein the rule indicates that the first one or more attributes associated with the first connected device are not compatible with the second one or more attributes associated with the second connected device. 
     
     
         20 . The computer program product of  claim 17 , wherein the rule indicates that the first one or more attributes associated with the first connected device is time sensitive. 
     
     
         21 . The computer program product of  claim 17 , wherein the rule indicates that the first one or more attributes associated with the first connected device is security related.