Method and Apparatus for Dynamic Image Content Manipulation

Abstract

A sample key signal frame and/or a sample image frame may be stored showing a finely-detailed element at a first resolution (e.g. a zoomed-in image). A current image signal includes the same finely-detailed element at a second, lower, resolution (e.g. a wide-angle image). The sample is scaled and/or transformed to match a target area within the current image and may be used to perform an image enhancement process which enhances the detailed element within an enhanced modified image frame. Thus, a more photo-realistic image is achieved.

What is claimed is: 
     
         1 . A method for use in dynamic image content manipulation, the method comprising:
 storing a sample key signal frame of a key signal which defines one or more pixel regions relating to a detailed element at a first resolution;   receiving a current image frame which includes the detailed element shown at a second resolution, wherein the second resolution is lower in detail than the first resolution in relation to the detailed element;   providing a current key signal frame which defines a target area of the current image frame which is to be modified with an alternate content;   enhancing the detailed element by providing fill content in the one or more pixel regions defined by the sample key signal frame in relation to the current image frame to provide an enhanced modified image frame; and   outputting the enhanced modified image frame.   
     
     
         2 . The method of  claim 1 , further comprising transforming at least one region of the sample key signal frame to correspond with a respective region of the current image frame containing the detailed element. 
     
     
         3 . The method of  claim 2 , wherein the transforming comprises distorting the sample key signal frame to correspond with a sub-region of the current image frame. 
     
     
         4 . The method of  claim 3 , wherein the distorting provides at least one portion of the sample key signal frame as an irregular quadrilateral shape over a sub-region of the current image frame. 
     
     
         5 . The method of  claim 2 , wherein the transforming is applied proportional to a relative difference between a first camera measurement signal appropriate to the current image frame and a second camera measurement signal appropriate to the sample key signal frame. 
     
     
         6 . The method of  claim 1 , further comprising storing a sample image frame corresponding to the sample key signal frame, and taking the fill content from the sample image frame in the pixel regions defined by the sample key signal frame. 
     
     
         7 . The method of  claim 1 , comprising enhancing the detailed element of the current image frame only in the target area. 
     
     
         8 . The method of  claim 1 , further comprising overlaying the fill content according to a variable transparency factor. 
     
     
         9 . The method of  claim 1 , further comprising selectively generating the enhanced modified image feed only at certain time portions during an image stream appropriate to the presence of the detailed element in a received image feed while not providing the enhanced modified image feed at other time portions during the image stream. 
     
     
         10 . A system for dynamic image content manipulation implemented by a computer having a processor and a memory, wherein the system is configured in use to:
 store a sample frame showing a detailed element at a first resolution;   process a current image frame of a received image feed which includes the detailed element shown at a second resolution, wherein the second resolution is lower in detail than the first resolution; and   enhance the detailed element in one or more pixel regions defined by the sample frame to provide an enhanced modified image frame.   
     
     
         11 . The system of  claim 10 , wherein the system is arranged to obtain the sample frame statically in advance of receiving the received image feed. 
     
     
         12 . The system of  claim 10 , wherein the system is arranged to obtain the sample frame contemporaneously with receiving the received image feed. 
     
     
         13 . The system of  claim 10 , wherein the system is arranged to obtain the sample frame opportunistically from the received image feed. 
     
     
         14 . The system of  claim 10 , wherein the system is coupled to a camera and/or a detector which observes a scene including the detailed element to provide the sample frame. 
     
     
         15 . A tangible non-transient machine readable medium comprising instructions which when executed cause a computer device to:
 store a sample frame showing a detailed element at a first resolution;   process a current image frame of a received image feed which includes the detailed element shown at a second resolution, wherein the second resolution is lower in detail than the first resolution; and   enhance the detailed element in one or more pixel regions defined by the sample frame to provide an enhanced modified image frame.