Artificial intelligence assisted wearable

Abstract

The description relates to artificial intelligence assisted wearables, such as backpacks. An example backpack may include sensors, such as a microphone and a camera. The backpack may receive a contextual voice command from a user. The contextual voice command may include a non-explicit reference to an object in an environment. The backpack may use the sensors to sense the environment, use an artificial intelligence engine to identify the object in the environment, and use a digital assistant to perform a contextual task in response to the contextual voice command. The contextual task may relate to the object in the environment. The backpack may output a response to the contextual voice command to the user.

1 - 20 . (canceled) 
     
     
         21 . A hands-free digital assistant device, comprising:
 a camera;   a microphone;   a speaker;   a network interface;   a processor; and   a storage having instructions which, when executed by the processor, cause the processor to:   receive a contextual voice command from the user via the microphone, wherein the contextual voice command uses a non-explicit reference to an object in an environment;   capture an image of the environment including the object via the camera;   cause transmission of the contextual voice command and the image to an engine via the network interface to cause a contextual task to be performed, the contextual task including a computerized action relating to the object;   receive a response associated with the contextual task that was performed based at least on the contextual voice command; and   output the response to the user via the speaker.   
     
     
         22 . The device of  claim 21 , further comprising:
 a compass,   wherein the instructions further cause the processor to sense a direction that the user is facing via the compass.   
     
     
         23 . The device of  claim 21 , further comprising:
 a global positioning system (GPS) unit,   wherein the instructions further cause the processor to determine a location of the user via the GPS unit.   
     
     
         24 . A system for hands-free digital assistant device, comprising:
 a wearable device;   a sensor attached to the wearable device, the sensor being fixed relative to a body of a user and capable of sensing an environment;   a processor; and   a storage having instructions which, when executed by the processor, cause the processor to:   receive a contextual voice command that includes a pronoun for a contextual signal that refers to an object in the environment;   detect the object in the environment using the sensor;   cause an engine to perform a contextual task relating to the object in response to the contextual voice command; and   output a response associated with the contextual task to the user.   
     
     
         25 . The system of  claim 24 , wherein the wearable device includes a backpack. 
     
     
         26 . The system of  claim 24 , wherein the sensor includes a camera. 
     
     
         27 . The system of  claim 26 , wherein the camera is located in a strap of the wearable device and facing a front direction of the user. 
     
     
         28 . The system of  claim 24 , further comprising:
 a speaker for outputting the response, wherein the response includes auditory feedback.   
     
     
         29 . The system of  claim 24 , further comprising:
 a light emitting diode for outputting the response, wherein the response includes visual feedback.   
     
     
         30 . The system of  claim 24 , further comprising:
 a haptic actuator for outputting the response, wherein the response includes haptic feedback.   
     
     
         31 . The system of  claim 24 , further comprising:
 a network interface for connecting to a network through a companion device that is capable of connecting to the network.   
     
     
         32 . The system of  claim 24 , further comprising:
 a battery for charging a companion device.   
     
     
         33 . A method for hands-free digital assistance, comprising:
 receiving a contextual voice command that makes a reference to an object in an environment without explicitly identifying the object;   capturing a recording of the environment including the object;   using an engine to determine an identification of the object and to interpret the contextual voice command based at least on the identification of the object; and   
       causing a contextual task to be performed in response to the contextual voice command, the contextual task including a computerized action relating to the object in the environment. 
     
     
         34 . The method of  claim 33 , further comprising:
 using a speech recognition module to interpret the contextual voice command.   
     
     
         35 . The method of  claim 33 , wherein the recording includes one or more of: an audio recording, an image recording, and/or a video recording. 
     
     
         36 . The method of  claim 33 , further comprising:
 using an image recognition module to determine the identification of the object in the recording.   
     
     
         37 . The method of  claim 33 , further comprising:
 using a text recognition module to determine the identification of the object in the recording.   
     
     
         38 . The method of  claim 33 , further comprising:
 using a facial recognition module to determine the identification of the object in the recording.   
     
     
         39 . The method of  claim 33 , further comprising:
 using a cognitive module to determine the contextual task to be performed in response to the contextual voice command.   
     
     
         40 . The method of  claim 33 , further comprising:
 generating a response associated with the contextual task; and   transmitting the response to be output to a user.