Encoding and decoding selectively retrievable representations of video content

Abstract

A system and method disposed to enable encoding, decoding and manipulation of digital video with substantially less processing load than would otherwise required. In particular, one disclosed method is directed to generating a compressed video data structure that is selectively decodable to a plurality of resolutions including the full resolution of the uncompressed stream. The desired number of data components and the content of the data components that make up the compressed video data, which determine the available video resolutions, are variable based upon the processing carried out and the resources available to decode and process the data components. During decoding, efficiency is substantially improved because only the data components necessary to generate a desired resolution are decoded. In variations, both temporal and spatial decoding are utilized to reduce frame rates, and hence, further reduce processor load. The system and method are particularly useful for real-time video editing applications.

1 .- 61 . (canceled) 
     
     
         62 . Non-transitory computer-readable apparatus comprising at least one computer program, the at least one computer program comprising a plurality of instructions which, when executed on a computerized apparatus, are configured to:
 obtain a plurality of video data comprising a plurality of data structures; and   selectively apply an effect to a first portion of the video data, the selective application of the effect comprising decoding the first portion according to a first display resolution, the first display resolution differing from a second display resolution applied to another portion of the video data;   wherein the decoding comprises decoding using a plurality of image components disposed in at least one of the plurality of data structures.   
     
     
         63 . The apparatus of  claim 62 , wherein the plurality of components comprise a plurality of components including a base component and a plurality of additional components each combinable with at least the base component. 
     
     
         64 . The apparatus of  claim 62 , wherein the effect further comprises a distortion or blurring based at least on application of one or more filtering operations. 
     
     
         65 . The apparatus of  claim 62 , wherein the first portion and the another portion each comprise one or more frames of the video data. 
     
     
         66 . The apparatus of  claim 62 , wherein the decoding comprises decoding one or more of the plurality of components created using a sub-band filter having a prescribed frequency band, the decoding of the one or more of the plurality of components performed to identify one or more edges of the first portion. 
     
     
         67 . The apparatus of  claim 66 , wherein the sub-band filter comprises a Haar wavelet-based filter, and the prescribed frequency band comprises a frequency disposed at an upper portion of a frequency spectrum associated with the first portion. 
     
     
         68 . The apparatus of  claim 62 , wherein the decoding comprises decoding one or more of the plurality of components created using a sub-band filter having a prescribed frequency band, the decoding of the one or more of the plurality of components resulting in two or more areas of the first portion with differing levels of image data. 
     
     
         69 . The apparatus of  claim 62 , wherein the decoding comprises decoding one or more of the plurality of components created using a wavelet transform having a prescribed length, the decoding of the one or more of the plurality of components performed to cause utilization of a plurality of pixels proximate to a region of interest within an image corresponding to the data structure. 
     
     
         70 . Non-transitory computer-readable apparatus comprising at least one computer program, the at least one computer program comprising a plurality of instructions which, when executed on a computerized apparatus, are configured to:
 obtain a plurality of video data comprising a plurality of data structures having one or more respective images associated therewith; and   selectively decode at least some of the video data according to a first display resolution, the first display resolution differing from a second display resolution selected for another portion of the video data;   wherein the selective decode comprises decode using a plurality of image components relating to the first portion and disposed in at least one of the plurality of data structures, the plurality of components comprising a base component and a plurality of additional components each combinable with at least the base component so as to achieve a plurality of different selectable display resolutions including the first resolution; and   wherein the plurality of components comprise at least one component which, when decoded, produces the first resolution only with respect to the first portion.   
     
     
         71 . The Apparatus of  claim 70 , wherein the first portion of the video data comprises a portion of the respective associated image, and the another portion of the video data comprises a remainder of the respective associated image. 
     
     
         72 . The apparatus of  claim 70 , wherein the decode comprises a decode of one or more of the plurality of components created using a sub-band filter having a prescribed frequency band, the decode of the one or more of the plurality of components performed to identify one or more edges of the first portion. 
     
     
         73 . The apparatus of  claim 72 , wherein the sub-band filter comprises a Haar wavelet-based filter, and the prescribed frequency band comprises a frequency disposed at an upper portion of a frequency spectrum associated with the first portion. 
     
     
         74 . The apparatus of  claim 70 , wherein the decode comprises a decode of one or more of the plurality of components created using a sub-band filter having a prescribed frequency band, the decode of the one or more of the plurality of components resulting in two or more areas of the first portion with differing levels of image data. 
     
     
         75 . The apparatus of  claim 70 , wherein the decode comprises a decode of one or more of the plurality of components created using a wavelet transform having a prescribed length, the decode of the one or more of the plurality of components performed to cause utilization of a plurality of pixels proximate to a region of interest within an image corresponding to the data structure. 
     
     
         76 . Non-transitory computer-readable apparatus comprising at least one computer program, the at least one computer program comprising a plurality of instructions which, when executed on a computerized apparatus, are configured to:
 obtain a plurality of video data comprising at least one data structure having an image associated therewith; and   selectively decode a first portion of the data structure according to a spatially non-uniform display resolution, the non-uniform display resolution comprising at least first and second display resolution values for different regions of the image;   wherein the selective decode comprises decode using a plurality of image components disposed in the data structure, the plurality of components comprising a base component and a plurality of additional components each combinable with at least the base component so as to achieve a plurality of different configurable display resolutions.   
     
     
         77 . The apparatus of  claim 76 , wherein the selective decode is based at least in part on a user-derived perception parameter received at time of the selective decode. 
     
     
         78 . The apparatus of  claim 76 , wherein the selective decode enables performance of a particular display-related function without decode of the image at full resolution. 
     
     
         79 . The apparatus of  claim 78 , wherein the particular display-related function comprises a render of the relevant one of the different regions at full resolution to make them adequate for human preview, and a render of others of different regions of the image to a display resolution less than would be adequate for human preview. 
     
     
         80 . The apparatus of  claim 76 , wherein the selective decode enables performance of a particular display-related function with decode of only relevant ones of the different regions of the image to full resolution. 
     
     
         81 . The apparatus of  claim 76 , wherein the particular display-related function comprises rendering of the relevant one of the different regions at full resolution to make them adequate for human preview, and rendering others of different regions of the image to a display resolution less than would be adequate for human preview.