US2024221324A1PendingUtilityA1

Image processing method and apparatus, electronic device, and program product

Assignee: LEMON INCPriority: Feb 3, 2021Filed: Jan 25, 2022Published: Jul 4, 2024
Est. expiryFeb 3, 2041(~14.5 yrs left)· nominal 20-yr term from priority
Inventors:Quan Wang
G06V 10/42G06V 10/44G06T 3/02G06V 20/20G06V 20/176G06F 3/01G06T 2219/004G06T 19/006
51
PatentIndex Score
0
Cited by
0
References
0
Claims

Abstract

Embodiments of the present disclosure provide an image processing method and apparatus, an electronic device, and a program product. The method includes: obtaining a live-action shooting image; determining a target object image in the live-action shooting image, where the target object image is an image containing a target object; acquiring a displaying object associated with the target object; determining, according to the target object image, a target displaying position of the displaying object in the live-action shooting image; and displaying the displaying object at the target displaying position in the live-action shooting image. According to the technical solution provided by the embodiments, an augmented reality display technology is used for directly displaying the displaying object associated with the target object; and reconstruction of a virtual model is no longer required, thereby saving computing resources, improving display efficiency, and enabling a user to obtain better interaction experience and visual experience.

Claims

exact text as granted — not AI-modified
What is claimed is: 
     
         1 . An image processing method, comprising:
 obtaining a live-action shooting image;   determining a target object image in the live-action shooting image, wherein the target object image is an image containing a target object;   acquiring a displaying object associated with the target object;   determining, according to the target object image, a target displaying position of the displaying object in the live-action shooting image; and   displaying the displaying object at the target displaying position in the live-action shooting image.   
     
     
         2 . The image processing method according to  claim 1 , wherein the determining a target object image in the live-action shooting image comprises:
 acquiring a reference image, wherein the reference image is the image containing the target object;   determining, according to the reference image, the target object image in the live-action shooting image.   
     
     
         3 . The image processing method according to  claim 2 , wherein the acquiring a reference image comprises:
 extracting a global feature of the live-action shooting image;   matching the global feature of the live-action shooting image with a global feature of at least one to-be-referenced image stored in an image database;   determining a to-be-referenced image matched with the global feature of the live-action shooting image as the reference image.   
     
     
         4 . (canceled) 
     
     
         5 . The image processing method according to  claim 2 , wherein the reference image comprises a preset displaying position;
 the determining, according to the target object image, a target displaying position of the displaying object in the live-action shooting image comprises:   performing model adaptation on the target object image and the reference image, to determine the target displaying position of the displaying object in the live-action shooting image based on a preset displaying position in the reference image.   
     
     
         6 . The image processing method according to  claim 5 , wherein the performing model adaptation on the target object image and the reference image, to determine the target displaying position of the displaying object in the live-action shooting image based on a preset displaying position in the reference image comprises:
 determining, according to the reference image and the target object image, an image affine transformation matrix;   performing, according to the image affine transformation matrix, affine transformation on the preset displaying position in the reference image, to obtain the target displaying position of the displaying object in the live-action shooting image.   
     
     
         7 . The image processing method according to  claim 6 , wherein the determining, according to the reference image and the target object image, an image affine transformation matrix comprises:
 extracting a local feature of the target object image;
 matching the local feature of the target object image with a local feature of the reference image, to obtain a mapping relationship between the local features; 
 determining, according to the mapping relationship between the local features, the image affine transformation matrix. 
   
     
     
         8 . The image processing method according to  claim 6 , wherein the reference image comprises a reference coordinate point of the preset displaying position;
 the performing, according to the image affine transformation matrix, affine transformation on the preset displaying position in the reference image, to obtain the target displaying position of the displaying object in the live-action shooting image comprises:   performing, according to the image affine transformation matrix, affine transformation on the reference coordinate point, to obtain a transformed target reference coordinate point;   determining, according to the target reference coordinate point, the target displaying position of the displaying object in the live-action shooting image.   
     
     
         9 . The image processing method according to  claim 8 , wherein the reference coordinate point of the preset displaying position being comprised in the reference image is preset. 
     
     
         10 . The image processing method according to  claim 1 , wherein after determining a target object image in the live-action shooting image, the method further comprises:
 uploading the target object image to a server;   receiving the displaying object returned by the server, so as to display the displaying object.   
     
     
         11 . The image processing method according to  claim 1 , wherein the displaying the displaying object at the target displaying position in the live-action shooting image comprises:
 based on an augmented reality display technology, displaying the displaying object, in a superimposition manner, at the target displaying position in the live-action shooting image.   
     
     
         12 . The image processing method according to  claim 1 , further comprising:
 responding to a triggering operation by a user on the displaying object displayed in the live-action shooting image;   displaying a triggering result of the displaying object in the live-action shooting image.   
     
     
         13 . The image processing method according to  claim 1 , wherein the target object is a landmark building. 
     
     
         14 . The image processing method according to  claim 13 , further comprising:
 displaying a landmark name of the landmark building in the live-action shooting image.   
     
     
         15 . (canceled) 
     
     
         16 . An electronic device, comprising:
 at least one processor; and   a memory for storing a computer program; wherein when the computer program is executed by the at least one processor, the at least one processor is configured to:   obtain a live-action shooting image;   determine a target object image in the live-action shooting image, wherein the target object image is an image containing a target object;   acquire a displaying object associated with the target object;   determine, according to the target object image, a target displaying position of the displaying object in the live-action shooting image; and   display the displaying object at the target displaying position in the live-action shooting image.   
     
     
         17 . A non-transitory computer readable storage medium, wherein the computer readable storage medium stores therein computer execution instructions, when the computer execution instructions are executed by a processor, the processor is configured to:
 obtain a live-action shooting image;   determine a target object image in the live-action shooting image, wherein the target object image is an image containing a target object;   acquire a displaying object associated with the target object;   determine, according to the target object image, a target displaying position of the displaying object in the live-action shooting image; and   display the displaying object at the target displaying position in the live-action shooting image.   
     
     
         18 - 19 . (canceled) 
     
     
         20 . The electronic device according to  claim 16 , wherein the at least one processor is configured to:
 acquire a reference image, wherein the reference image is the image containing the target object;   determine, according to the reference image, the target object image in the live-action shooting image.   
     
     
         21 . The electronic device according to  claim 16 , wherein the at least one processor is configured to:
 upload the target object image to a server;   receive the displaying object returned by the server, so as to display the displaying object.   
     
     
         22 . The electronic device according to  claim 16 , wherein the at least one processor is configured to:
 respond to a triggering operation by a user on the displaying object displayed in the live-action shooting image;   display a triggering result of the displaying object in the live-action shooting image.

Join the waitlist — get patent alerts

Track US2024221324A1 — get alerts on status changes and closely related new filings.

We store only your email — no account needed. See our privacy policy.