Electronic device for tracking objects

Abstract

Systems, methods, and non-transitory media are provided for tracking operations using data received from a wearable device. An example method can include determining a first position of a wearable device in a physical space; receiving, from the wearable device, position information associated with the wearable device; determining a second position of the wearable device based on the received position information; and tracking, based on the first position and the second position, a movement of the wearable device relative to an electronic device.

What is claimed is: 
     
         1 . An apparatus comprising:
 at least one memory; and   at least one processor coupled to the at least one memory, the at least one processor being configured to:
 obtain, from an image sensor of one or more image sensors during a first time period, an image including a wearable device; 
 receive a first input from one or more sensors of the wearable device during the first time period; 
 perform one or more first operations based on the first input; 
 determine, during a second time period, that the wearable device is outside of a field of view (FOV) of the one or more image sensors; 
 receive a second input from the one or more sensors of the wearable device during the second time period; and 
 perform one or more second operations based on the second input. 
   
     
     
         2 . The apparatus of  claim 1 , wherein the one or more first operations and the one or more second operations include tracking movement of the wearable device relative to the apparatus. 
     
     
         3 . The apparatus of  claim 2 , wherein, to track the movement of the wearable device, the at least one processor is configured to:
 determine a first position of the wearable device within a first coordinate system of the wearable device;   transform the first coordinate system of the wearable device to a second coordinate system of the apparatus; and   determine a second position of the wearable device within the second coordinate system of the apparatus.   
     
     
         4 . The apparatus of  claim 2 , wherein the at least one processor is configured to:
 track, based on at the tracked movement of the wearable device, a location of a hand associated with the wearable device.   
     
     
         5 . The apparatus of  claim 4 , wherein the at least one processor is configured to:
 capture the image based on a determination that the wearable device is within the FOV of the one or more image sensors; and   track, based on the image, the location of the hand relative to a first coordinate system of the wearable device.   
     
     
         6 . The apparatus of  claim 1 , wherein the at least one processor is configured to:
 adjust, based on a determination that the wearable device is within the FOV of the image sensor, a setting of the image sensor, the setting comprising at least one of a power mode of the image sensor or an operating state of the image sensor.   
     
     
         7 . The apparatus of  claim 6 , wherein, to adjust the setting of the image sensor, the at least one processor is configured to change the power mode of the image sensor from a first power mode to a second power mode, the second power mode being a higher power mode than the first power mode. 
     
     
         8 . The apparatus of  claim 6 , wherein, to adjust the setting of the image sensor, the at least one processor is configured to change the operating state of the image sensor from a first operating state to a second operating state, the second operating state being a higher operating state than the first operating state. 
     
     
         9 . The apparatus of  claim 8 , wherein the first operating state comprises a first framerate, and wherein the second operating state comprises a second framerate, the second framerate being a higher framerate than the first framerate. 
     
     
         10 . The apparatus of  claim 8 , wherein the first operating state comprises a first resolution, and wherein the second operating state comprises a second resolution, the second resolution being a higher resolution than the first resolution. 
     
     
         11 . The apparatus of  claim 1 , wherein the at least one processor is configured to:
 adjust, based on the determination that the wearable device is outside of the FOV of the image sensor, a setting of the image sensor, the setting comprising at least one of a power mode of the image sensor or an operating state of the image sensor.   
     
     
         12 . The apparatus of  claim 11 , wherein, to adjust the setting of the image sensor, the at least one processor is configured to change the power mode of the image sensor from a first power mode to a second power mode, the second power mode being a lower power mode than the first power mode. 
     
     
         13 . The apparatus of  claim 11 , wherein, to adjust the setting of the image sensor, the at least one processor is configured to change the operating state of the image sensor from a first operating state to a second operating state, the second operating state being a lower operating state than the first operating state. 
     
     
         14 . The apparatus of  claim 13 , wherein the first operating state comprises a first framerate, and wherein the second operating state comprises a second framerate, the second framerate being a lower framerate than the first framerate. 
     
     
         15 . The apparatus of  claim 13 , wherein the first operating state comprises a first resolution, and wherein the second operating state comprises a second resolution, the second resolution being a lower resolution than the first resolution. 
     
     
         16 . The apparatus of  claim 1 , wherein the at least one processor is configured to:
 determine, based on at least one of data from the wearable device or a command from the wearable device, one or more extended reality (XR) inputs to an XR application on the apparatus.   
     
     
         17 . The apparatus of  claim 16 , wherein the one or more XR inputs comprise at least one of a modification of a virtual element along multiple dimensions in space, a selection of the virtual element, a navigation event, or a request to measure a distance defined by at least one of a first position of the wearable device, a second position of the wearable device, or a movement of the wearable device. 
     
     
         18 . The apparatus of  claim 17 , wherein the virtual element comprises at least one of a virtual object rendered by the apparatus, a virtual plane in an environment rendered by the apparatus, or the environment rendered by the apparatus. 
     
     
         19 . The apparatus of  claim 17 , wherein the navigation event comprises at least one of scrolling rendered content or moving from a first interface element to a second interface element. 
     
     
         20 . The apparatus of  claim 1 , wherein the wearable device comprises a watch, a bracelet, a ring, or a glove. 
     
     
         21 . The apparatus of  claim 1 , wherein the apparatus comprises a mobile device. 
     
     
         22 . The apparatus of  claim 1 , wherein the apparatus comprises an extended reality (XR) device including a display. 
     
     
         23 . A method comprising:
 obtaining, from an image sensor of one or more image sensors during a first time period, an image including a wearable device;   receiving a first input from one or more sensors of the wearable device during the first time period;   performing one or more first operations based on the first input;   determining, during a second time period, that the wearable device is outside of a field of view (FOV) of the one or more image sensors;   receiving a second input from the one or more sensors of the wearable device during the second time period; and   performing one or more second operations based on the second input.   
     
     
         24 . The method of  claim 23 , wherein the one or more first operations and the one or more second operations include tracking movement of the wearable device relative to an apparatus. 
     
     
         25 . The method of  claim 24 , further comprising:
 tracking, based on at the tracked movement of the wearable device, a location of a hand associated with the wearable device;   capturing the image based on a determination that the wearable device is within the FOV of the one or more image sensors; and   tracking, based on the image, the location of the hand relative to a first coordinate system of the wearable device.   
     
     
         26 . The method of  claim 23 , further comprising:
 adjusting, based on a determination that the wearable device is within the FOV of the image sensor, a setting of the image sensor, the setting comprising at least one of a power mode of the image sensor or an operating state of the image sensor.   
     
     
         27 . The method of  claim 26 , wherein adjusting the setting of the image sensor comprises at least one of:
 changing the power mode of the image sensor from a first power mode to a second power mode, the second power mode being a higher power mode than the first power mode; or   changing the operating state of the image sensor from a first operating state to a second operating state, the second operating state being a higher operating state than the first operating state.   
     
     
         28 . The method of  claim 27 , wherein one of:
 the first operating state comprises a first framerate, and wherein the second operating state comprises a second framerate, the second framerate being a higher framerate than the first framerate; or   the first operating state comprises a first resolution, and wherein the second operating state comprises a second resolution, the second resolution being a higher resolution than the first resolution.   
     
     
         29 . The method of  claim 23 , further comprising:
 adjusting, based on the determination that the wearable device is outside of the FOV of the image sensor, a setting of the image sensor, the setting comprising at least one of a power mode of the image sensor or an operating state of the image sensor.   
     
     
         30 . The method of  claim 29 , wherein adjust the setting of the image sensor comprises at least one of:
 changing the power mode of the image sensor from a first power mode to a second power mode, the second power mode being a lower power mode than the first power mode; or   changing the operating state of the image sensor from a first operating state to a second operating state, the second operating state being a lower operating state than the first operating state.