US11430216B2ActiveUtilityA1

Displaying data related to objects in images

Assignee: HEWLETT PACKARD DEVELOPMENT COPriority: Oct 22, 2018Filed: Oct 22, 2018Granted: Aug 30, 2022
Est. expiryOct 22, 2038(~12.3 yrs left)· nominal 20-yr term from priority
Inventors:Mohit Gupta
G09G 5/14G06V 20/68G06F 3/147G06F 16/53G09G 2340/14G06F 16/58G09G 2354/00G06V 20/20G06T 19/006
73
PatentIndex Score
1
Cited by
23
References
13
Claims

Abstract

An example of a non-transitory computer-readable medium storing machine-readable instructions. The instructions may cause a controller to receive an image and detect an object in the image. Based on a contextual setting of the electronic device, overlay data may be retrieved from a database or a remote electronic device to be visually associated with the object on a display.

Claims

exact text as granted — not AI-modified
What is claimed is: 
     
       1. A non-transitory computer-readable medium comprising machine-readable instructions that, when executed by a controller of a first electronic device, cause the controller to:
 receive an image via an imaging device of the first electronic device; 
 detect an object in the image; 
 detect a change in a contextual setting of the first electronic device from a first contextual setting to a second contextual setting based on a time of day identified by a time source associated with the first electronic device; 
 query a database stored in the first electronic device for first overlay data related to the object based on the second contextual setting; 
 when the first overlay data is stored in the database, retrieve the first overlay data from the database; 
 when the first overlay data is not stored in the database:
 send a message to a second electronic device, the message including identification data of the object and a first request for the first overlay data; and 
 receive the first overlay data from the second electronic device; and 
 
 cause the first overlay data to be presented with the object on a display of the first electronic device. 
 
     
     
       2. The non-transitory computer-readable medium of  claim 1 , wherein the machine-readable instructions, when executed by the controller, cause the controller to:
 receive a second image via the imaging device; 
 detect a second object in the second image; 
 send a second message to the second electronic device, the second message including second identification data of the second object and a second request for second overlay data; 
 receive the second overlay data from the second electronic device; and 
 cause the second overlay data to be presented with the second object on the display. 
 
     
     
       3. The non-transitory computer-readable medium of  claim 1 , wherein the machine-readable instructions, when executed by the controller, cause the controller to:
 receive a first user identification; and 
 determine the second contextual setting based on the first user identification. 
 
     
     
       4. The non-transitory computer-readable medium of  claim 3 , wherein the machine-readable instructions, when executed by the controller, cause the controller to:
 receive a second user identification; 
 determine a third contextual setting of the first electronic device based on the second user identification; 
 receive a second image via the imaging device; 
 detect the object in the second image; 
 query the database for second overlay data related to the object based on the third contextual setting; 
 retrieve the second overlay data from the database; and 
 cause the second overlay data to be presented with the object on the display. 
 
     
     
       5. The non-transitory computer-readable medium of  claim 1 , wherein the machine-readable instructions, when executed by the controller, cause the controller to:
 detect a second object in the image; 
 query the database for second overlay data related to the second object based on the second contextual setting; 
 retrieve the second overlay data from the database; and 
 cause the second overlay data to be presented with the second object on the display during the presentation of the first overlay data with the object on the display. 
 
     
     
       6. A non-transitory computer-readable medium comprising machine-readable instructions that, when executed by a controller of a first electronic device, cause the controller to:
 receive a user identification; 
 determine a first contextual setting of the first electronic device based on the user identification; 
 send a first request to a second electronic device for a first database entry based on the first contextual setting; 
 receive the first database entry from the second electronic device; 
 store the first database entry in a database stored in the first electronic device; 
 remove a second database entry from the database in response to determining the first contextual setting; 
 receive an image via an imaging device of the first electronic device; 
 detect an object in the image; 
 query the database for first overlay data related to the object; 
 retrieve the first overlay data from the database, the first overlay data corresponding to the first database entry; and 
 cause the first overlay data to be presented with the object on a display of the first electronic device. 
 
     
     
       7. The non-transitory computer-readable medium of  claim 6 , wherein the machine-readable instructions, when executed by the controller, cause the controller to:
 receive a time of day from a time source; 
 determine a second contextual setting of the first electronic device based on the user identification and the time of day; 
 send a second request to the second electronic device for a third database entry based on the second contextual setting; 
 receive the third database entry from the second electronic device; 
 store the third database entry in the database; 
 receive a second image via the imaging device; 
 detect the object in the second image; and 
 visually associate second overlay data with the object on the display, the second overlay data corresponding to the third database entry. 
 
     
     
       8. The non-transitory computer-readable medium of  claim 7 , wherein the machine-readable instructions, when executed by the controller, cause the controller to:
 determine that the first overlay data and the second overlay data are stored in the database and correspond to the object; and 
 select the second overlay data for presentation on the display based on the determination of the second contextual setting. 
 
     
     
       9. The non-transitory computer-readable medium of  claim 6 , wherein the user identification includes a login name and a password. 
     
     
       10. A non-transitory computer-readable medium comprising machine-readable instructions that, when executed by a controller of a first electronic device, cause the controller to:
 receive a user identification from a second electronic device; 
 determine a first contextual setting of the second electronic device based on the user identification; 
 select first overlay data based on the first contextual setting; 
 send the first overlay data to the second electronic device; 
 receive a message from the second electronic device, the message including identification data of an object; 
 select second overlay data based on the identification data and the first contextual setting; 
 send the second overlay data to the second electronic device; 
 receive a first message indicating a topic of interest corresponding to the user identification; 
 store an association between the user identification and the topic of interest; 
 select third overlay data based on the topic of interest; and 
 send the third overlay data to the second electronic device. 
 
     
     
       11. The non-transitory computer-readable medium of  claim 10 , wherein the machine-readable instructions, when executed by the controller, cause the controller to:
 analyze an e-mail in an e-mail account based on the user identification to identify the topic of interest corresponding to the user identification. 
 
     
     
       12. The non-transitory computer-readable medium of  claim 10 , wherein the machine-readable instructions, when executed by the controller, cause the controller to:
 receive a time of day from a time source; 
 determine a second contextual setting of the second electronic device based on the user identification and the time of day; 
 send a message to the second electronic device indicating a change of the contextual setting of the second electronic device from the first contextual setting to the second contextual setting; 
 select fourth overlay data based on the second contextual setting; and 
 send the fourth overlay data to the second electronic device. 
 
     
     
       13. The non-transitory computer-readable medium of  claim 10 , wherein the machine-readable instructions, when executed by the controller, cause the controller to:
 receive a second message from the second electronic device, the second message including second identification data of a second object; 
 search for fourth overlay data based on the first contextual setting and the second identification data; and 
 designate the second identification data for overlay processing based on the search.

Join the waitlist — get patent alerts

Track US11430216B2 — get alerts on status changes and closely related new filings.

We store only your email — no account needed. See our privacy policy.