Detection and interpretation of visual indicators

Abstract

Devices, systems and methods are disclosed that detect and interpret the meaning of visual and/or audio indicators of devices, and provide information, solutions to potential malfunctions, and/or automatic ordering of consumable products to users. For example, sequences of visual indicators (such as LEDs) and/or audio indicators (such as speakers that output beeps) generated by home electronics and other devices may be monitored using an image capture component (such as a camera) or audio capture component (such as a microphone), and the sequences may be interpreted to provide users with information of what is wrong with a device, how to fix a device, purchase a new device, offer repair services, etc. The systems and methods may also provide users with notifications relating to such indicators when the user is away from home.

1 .- 20 . (canceled) 
     
     
         21 . A computer-implemented method, comprising:
 receiving, from an image capture device associated with a user profile, image data representing a first device including an illuminated indicator;   processing the image data to determine the illuminated indicator corresponds to an action to order a first type of object corresponding to the first device;   determining a first object corresponding to the first type; and   associating the user profile with an order for the first object.   
     
     
         22 . The computer-implemented method of  claim 21 , further comprising:
 receiving a device identifier corresponding to the image capture device; and   determining the user profile using the device identifier.   
     
     
         23 . The computer-implemented method of  claim 21 , further comprising:
 determining, using the user profile, a device identifier corresponding to the first device; and   determining, using the device identifier, device data,   wherein processing the image data further uses the device data.   
     
     
         24 . The computer-implemented method of  claim 21 , further comprising:
 determining the user profile indicates preference information to automatically order the first object; and   causing a message to be sent to a second device associated with the user profile, the message indicating purchase of the first object.   
     
     
         25 . The computer-implemented method of  claim 21 , further comprising:
 causing a message to be sent to a second device associated with the user profile, the message indicating the first device and the order for the first of object;   receiving, from the second device, a response to the message; and   determining the response corresponds to permission to order the first object.   
     
     
         26 . The computer-implemented method of  claim 21 , further comprising:
 identifying past purchase history associated with the user profile; and   selecting the first object based at least in part on the past purchase history.   
     
     
         27 . The computer-implemented method of  claim 26 , further comprising:
 determining that the past purchase history indicates that the first object was most recently purchased outside a specified time window.   
     
     
         28 . The computer-implemented method of  claim 21 , further comprising:
 prior to purchase of the first object, identifying a stock of the first product; and   selecting the first object for purchase based at least in part on the stock of the first product.   
     
     
         29 . The computer-implemented method of  claim 21 , further comprising:
 determining the first type corresponds to the first object and a second object; and   determining the user profile indicates a preference for the first object.   
     
     
         30 . The computer-implemented method of  claim 21 , further comprising:
 receiving audio data corresponding to the illuminated indicator; and   processing the audio data to further determine the illuminated indicator corresponds to the action.   
     
     
         31 . A system, comprising:
 at least one processor; and   at least one memory including instructions operable to be executed by the at least one processor to configure the system to:
 receive, from an image capture device associated with a user profile, image data representing a first device including an illuminated indicator; 
 process the image data to determine the illuminated indicator corresponds to an action to order a first type of object corresponding to the first device; 
 determine a first object corresponding to the first type; and 
 associate the user profile with an order for the first object. 
   
     
     
         32 . The system of  claim 31 , wherein the memory further comprises instructions that, when executed by the at least one processor, further configure the system to:
 receive a device identifier corresponding to the image capture device; and   determine the user profile using the device identifier.   
     
     
         33 . The system of  claim 31 , wherein the memory further comprises instructions that, when executed by the at least one processor, further configure the system to:
 determine, using the user profile, a device identifier corresponding to the first device; and   determine, using the device identifier, device data,   wherein processing of the image data further uses the device data.   
     
     
         34 . The system of  claim 31 , wherein the memory further comprises instructions that, when executed by the at least one processor, further configure the system to:
 determine the user profile indicates preference information to automatically order the first object; and   cause a message to be sent to a second device associated with the user profile, the message indicating purchase of the first object.   
     
     
         35 . The system of  claim 31 , wherein the memory further comprises instructions that, when executed by the at least one processor, further configure the system to:
 cause a message to be sent to a second device associated with the user profile, the message indicating the first device and the order for the first of object;   receive, from the second device, a response to the message; and   determine the response corresponds to permission to order the first object.   
     
     
         36 . The system of  claim 31 , wherein the memory further comprises instructions that, when executed by the at least one processor, further configure the system to:
 identify past purchase history associated with the user profile; and   select the first object based at least in part on the past purchase history.   
     
     
         37 . The system of  claim 36 , wherein the memory further comprises instructions that, when executed by the at least one processor, further configure the system to:
 determine that the past purchase history indicates that the first object was most recently purchased outside a specified time window.   
     
     
         38 . The system of  claim 31 , wherein the memory further comprises instructions that, when executed by the at least one processor, further configure the system to:
 prior to purchase of the first object, identify a stock of the first product; and   select the first object for purchase based at least in part on the stock of the first product.   
     
     
         39 . The system of  claim 31 , wherein the memory further comprises instructions that, when executed by the at least one processor, further configure the system to:
 determine the first type corresponds to the first object and a second object; and   determine the user profile indicates a preference for the first object.   
     
     
         40 . The system of  claim 31 , wherein the memory further comprises instructions that, when executed by the at least one processor, further configure the system to:
 receive audio data corresponding to the illuminated indicator; and   process the audio data to further determine the illuminated indicator corresponds to the action.