US2004001546A1PendingUtilityA1

Spatiotemporal prediction for bidirectionally predictive (B) pictures and motion vector prediction for multi-picture reference motion compensation

Priority: Jun 3, 2002Filed: May 23, 2003Published: Jan 1, 2004
Est. expiryJun 3, 2022(expired)· nominal 20-yr term from priority
H04N 19/593H04N 19/573H04N 19/107H04N 19/577H04N 19/142H04N 19/176H04N 19/513H04N 19/51H04N 19/61H04N 19/105H04N 19/102H04N 19/58H04N 19/56H04N 19/137H04N 19/52H04N 19/87
49
PatentIndex Score
0
Cited by
0
References
0
Claims

Abstract

Several improvements for use with Bidirectionally Predictive (B) pictures within a video sequence are provided. In certain improvements Direct Mode encoding and/or Motion Vector Prediction are enhanced using spatial prediction techniques. In other improvements Motion Vector prediction includes temporal distance and subblock information, for example, for more accurate prediction. Such improvements and other presented herein significantly improve the performance of any applicable video coding system/logic.

Claims

exact text as granted — not AI-modified
What is claimed is:  
     
         1 . A method for use in encoding video data within a sequence of video frames, the method comprising: 
 identifying at least a portion of at least one video frame to be a Bidirectionally Predictive (B) picture; and    selectively encoding said B picture using at least spatial prediction to encode at least one motion parameter associated with said B picture.    
     
     
         2 . The method as recited in  claim 1 , wherein said B picture includes a macroblock.  
     
     
         3 . The method as recited in  claim 2 , wherein selectively encoding said B picture using at least spatial prediction to encode said at least one motion parameter produces a Direct Macroblock.  
     
     
         4 . The method as recited in  claim 1 , wherein said B picture includes a slice.  
     
     
         5 . The method as recited in  claim 1 , wherein said B picture includes at least a portion of a macroblock.  
     
     
         6 . The method as recited in  claim 1 , wherein selectively encoding said B picture using at least spatial prediction to encode said at least one motion parameter further includes employing linear motion vector prediction for said B picture based on at least one reference picture that is at least another portion of said video frame.  
     
     
         7 . The method as recited in  claim 1 , wherein selectively encoding said B picture using at least spatial prediction to encode said at least one motion parameter further includes employing non-linear motion vector prediction for said B picture based on at least one reference picture that is at least another portion of said video frame.  
     
     
         8 . The method as recited in  claim 1 , wherein selectively encoding said B picture using at least spatial prediction to encode said at least one motion parameter further includes employing median motion vector prediction for said B picture based on at least two reference pictures that are both portions of said video frame.  
     
     
         9 . The method as recited in  claim 1 , wherein said at least one motion parameter includes at least one motion vector.  
     
     
         10 . The method as recited in  claim 1 , wherein at least one other portion of at least one other video frame is processed to further selectively encode said B picture using temporal prediction to encode at least one temporal-based motion parameter associated with said B picture.  
     
     
         11 . The method as recited in  claim 10 , wherein said temporal prediction includes bidirectional temporal prediction.  
     
     
         12 . The method as recited in  claim 10 , wherein said at least one other video frame is a Predictive (P) frame.  
     
     
         13 . The method as recited in  claim 10 , further comprising selectively scaling said at least one temporal-based motion parameter based at least in part on a temporal distance between said other video frame and said frame that includes said B picture.  
     
     
         14 . The method as recited in  claim 13 , wherein temporal distance information is encoded within a header associated with said encoded B picture.  
     
     
         15 . The method as recited in  claim 10 , wherein said at least one other portion includes at least a portion of a macroblock within said at least one other video frame.  
     
     
         16 . A computer-readable medium having computer implementable instructions for configuring at least one processing unit to perform acts comprising: 
 accessing data for a sequence of video frames;    identifying at least a portion of at least one video frame to be a Bidirectionally Predictive (B) picture; and    selectively encoding said B picture using at least spatial prediction to encode at least one motion parameter associated with said B picture.    
     
     
         17 . The computer-readable medium as recited in  claim 16 , wherein said B picture includes a macroblock.  
     
     
         18 . The computer-readable medium as recited in  claim 17 , wherein selectively encoding said B picture using at least spatial prediction to encode said at least one motion parameter produces a Direct Macroblock.  
     
     
         19 . The computer-readable medium as recited in  claim 16 , wherein said B picture includes a slice.  
     
     
         20 . The computer-readable medium as recited in  claim 16 , wherein said B picture includes at least a portion of a macroblock.  
     
     
         21 . The computer-readable medium as recited in  claim 16 , wherein selectively encoding said B picture using at least spatial prediction to encode said at least one motion parameter further includes employing linear motion vector prediction for said B picture based on at least one reference picture that is at least another portion of said video frame.  
     
     
         22 . The computer-readable medium as recited in  claim 16 , wherein selectively encoding said B picture using at least spatial prediction to encode said at least one motion parameter further includes employing non-linear motion vector prediction for said B picture based on at least one reference picture that is at least another portion of said video frame.  
     
     
         23 . The computer-readable medium as recited in  claim 16 , wherein selectively encoding said B picture using at least spatial prediction to encode said at least one motion parameter further includes employing median motion vector prediction for said B picture based on at least two reference pictures that are both portions of said video frame.  
     
     
         24 . The computer-readable medium as recited in  claim 16 , wherein said at least one motion parameter includes at least one motion vector.  
     
     
         25 . The computer-readable medium as recited in  claim 1 , wherein at least one other portion of at least one other video frame is processed to further selectively encode said B picture using temporal prediction to encode at least one temporal-based motion parameter associated with said B picture.  
     
     
         26 . The computer-readable medium as recited in  claim 25 , wherein said temporal prediction includes bidirectional temporal prediction.  
     
     
         27 . The computer-readable medium as recited in  claim 25 , wherein said at least one other video frame is a Predictive (P) frame.  
     
     
         28 . The computer-readable medium as recited in  claim 25 , having computer implementable instructions for configuring said at least one processing unit to perform acts comprising: 
 selectively scaling said at least one temporal-based motion parameter based at least in part on a temporal distance between said other video frame and said frame that includes said B picture.    
     
     
         29 . The computer-readable medium as recited in  claim 28 , wherein temporal distance information is encoded within a header associated with said encoded B picture.  
     
     
         30 . The computer-readable medium as recited in  claim 25 , wherein said at least one other portion includes at least a portion of a macroblock within said at least one other video frame.  
     
     
         31 . An apparatus for use in encoding video data within a sequence of video frames, the apparatus comprising: 
 logic operatively configured to access video data for a sequence of video frames, identify at least a portion of at least one video frame to be a Bidirectionally Predictive (B) picture, and selectively encode said B picture using at least spatial prediction to encode at least one motion parameter associated with said B picture.    
     
     
         32 . The apparatus as recited in  claim 31 , wherein said B picture includes a macroblock.  
     
     
         33 . The apparatus as recited in  claim 32 , wherein said logic selectively encodes said B picture using at least spatial prediction to encode said at least one motion parameter to produce a Direct Macroblock.  
     
     
         34 . The apparatus as recited in  claim 31 , wherein said B picture includes a slice.  
     
     
         35 . The apparatus as recited in  claim 31 , wherein said B picture includes at least a portion of a macroblock.  
     
     
         36 . The apparatus as recited in  claim 31 , wherein said logic is further configured to employ linear motion vector prediction for said B picture based on at least one reference picture that is at least another portion of said video frame.  
     
     
         37 . The apparatus as recited in  claim 31 , wherein said logic is further configured to employ non-linear motion vector prediction for said B picture based on at least one reference picture that is at least another portion of said video frame.  
     
     
         38 . The apparatus as recited in  claim 31 , wherein said logic is further configured to employ median motion vector prediction for said B picture based on at least two reference pictures that are both portions of said video frame.  
     
     
         39 . The apparatus as recited in  claim 31 , wherein said at least one motion parameter includes at least one motion vector.  
     
     
         40 . The apparatus as recited in  claim 31 , wherein said logic is further configured to process at least one other portion of at least one other video frame is and selectively encode said B picture using temporal prediction to encode at least one temporal-based motion parameter associated with said B picture.  
     
     
         41 . The apparatus as recited in  claim 40 , wherein said temporal prediction includes bidirectional temporal prediction.  
     
     
         42 . The apparatus as recited in  claim 40 , wherein said at least one other video frame is a Predictive (P) frame.  
     
     
         43 . The apparatus as recited in  claim 40 , wherein said logic is further configured to selectively scale said at least one temporal-based motion parameter based at least in part on a temporal distance between said other video frame and said frame that includes said B picture.  
     
     
         44 . The apparatus as recited in  claim 43 , whereinsaid logic is further configured to include temporal distance information within a header associated with said encoded B picture.  
     
     
         45 . The apparatus as recited in  claim 40 , wherein said at least one other portion includes at least a portion of a macroblock within said at least one other video frame.  
     
     
         46 . A method for encoding video data, the method comprising: 
 identifying at least a portion of at least one video frame to be coded in an enhanced direct mode; and    encoding said portion in said enhanced direct mode using at least spatial information associated with said portion within said at least one video frame.    
     
     
         47 . The method as recited in  claim 46  wherein encoding said portion in said enhanced direct mode further includes using temporal information associated with said portion and at least one other portion of at least one other video frame.  
     
     
         48 . The method as recited in  claim 46 , wherein encoding said portion in said enhanced direct mode further includes using motion vector prediction based on at least one other portion within said at least one video frame.  
     
     
         49 . The method as recited in Clam  48 , wherein said motion vector prediction includes median prediction.  
     
     
         50 . The method as recited in  claim 46 , wherein said enhance direct mode includes using spatial prediction to calculate said spatial information based on at least one linear function that considers motion information of at least one other portion of said at least one video frame.  
     
     
         51 . The method as recited in  claim 46 , wherein said enhance direct mode includes using spatial prediction to calculate said spatial information based on at least one non-linear function that considers motion information of at least one other portion of said at least one video frame.  
     
     
         52 . A computer-readable medium having computer implementable instructions for configuring at least one processing unit to perform acts comprising encoding video data by identifying at least a portion of at least one video frame to be coded in an enhanced direct mode, and encoding said portion in said enhanced direct mode using at least spatial information associated with said portion within said at least one video frame.  
     
     
         53 . The computer-readable medium as recited in  claim 52  wherein encoding said portion in said enhanced direct mode further includes using temporal information associated with said portion and at least one other portion of at least one other video frame.  
     
     
         54 . The computer-readable medium as recited in  claim 52 , wherein encoding said portion in said enhanced direct mode further includes using motion vector prediction based on at least one other portion within said at least one video frame.  
     
     
         55 . The computer-readable medium as recited in Clam  54 , wherein said motion vector prediction includes median prediction.  
     
     
         56 . The computer-readable medium as recited in  claim 52 , wherein said enhance direct mode includes using spatial prediction to calculate said spatial information based on at least one linear function that considers motion information of at least one other portion of said at least one video frame.  
     
     
         57 . The computer-readable medium as recited in  claim 52 , wherein said enhance direct mode includes using spatial prediction to calculate said spatial information based on at least one non-linear function that considers motion information of at least one other portion of said at least one video frame.  
     
     
         58 . An apparatus comprising: 
 logic operatively configured to encode video data by identifying at least a portion of at least one video frame to be coded in an enhanced direct mode, and encode said portion in said enhanced direct mode using at least spatial information Is associated with said portion within said at least one video frame.    
     
     
         59 . The apparatus as recited in  claim 58  wherein said logic is further operatively configured to use temporal information associated with said portion and at least one other portion of at least one other video frame to encode said portion in said enhanced direct mode.  
     
     
         60 . The apparatus as recited in  claim 58 , wherein said logic is further operatively configured to encoding said portion in said enhanced direct mode further using motion vector prediction information based on at least one other portion within said at least one video frame.  
     
     
         61 . The apparatus as recited in Clam  60 , wherein said motion vector prediction includes median prediction.  
     
     
         62 . The apparatus as recited in  claim 56 , wherein said logic is further operatively configured to use spatial prediction to calculate said spatial information based on at least one linear function that considers motion information of at least one other portion of said at least one video frame.  
     
     
         63 . The apparatus as recited in  claim 56 , wherein said logic is further operatively configured to use spatial prediction to calculate said spatial information based on at least one non-linear function that considers motion information of at least one other portion of said at least one video frame.  
     
     
         64 . A method to predict a reference picture in direct mode video encoding, the method comprising: 
 selecting a reference picture from a group comprising a minimum reference picture for a plurality of predictions related to at least a portion of a video frame to be encoded, a median reference picture for said plurality of predictions, and a current reference picture based on a single direction prediction; and    encoding said at least one portion of said video frame based on selected reference picture.    
     
     
         65 . The method as recited in  claim 64 , wherein selecting said reference picture further includes selecting at least one spatially related prediction.  
     
     
         66 . The method as recited in  claim 64 , wherein selecting said reference picture further includes selecting at least one temporally related prediction.  
     
     
         67 . A computer-readable medium having computer implementable instructions for configuring at least one processing unit to perform acts comprising: 
 selecting a reference picture from a group comprising a minimum reference picture for a plurality of predictions related to at least a portion of a video frame to be encoded, a median reference picture for said plurality of predictions, and a current reference picture based on a single direction prediction; and    encoding said at least one portion of said video frame based on selected reference picture.    
     
     
         68 . The computer-readable medium as recited in  claim 67 , wherein selecting said reference picture further includes selecting at least one spatially related prediction.  
     
     
         69 . The computer-readable medium as recited in  claim 67 , wherein selecting said reference picture further includes selecting at least one temporally related prediction.  
     
     
         70 . An apparatus comprising: 
 logic that is operatively configured to select a reference picture from a group comprising a minimum reference picture for a plurality of predictions related to at least a portion of a video frame to be encoded, a median reference picture for said plurality of predictions, and a current reference picture based on a single direction prediction, and encode said at least one portion of said video frame based on selected reference picture.    
     
     
         71 . The apparatus as recited in  claim 70 , wherein said logic is operatively configured to select at least one spatially related prediction.  
     
     
         72 . The apparatus as recited in  claim 70 , wherein said logic is operatively configured to select at least one temporally related prediction.  
     
     
         73 . A method for use in selecting between temporal prediction, spatial prediction, or both temporal and spatial prediction for encoding at least a portion of at least one video frame in an enhanced direct mode, the method comprising: 
 selecting temporal prediction if at least one motion vector of a collocated portion of said video frame is zero;    if surrounding portions within said video frame use different reference pictures than a collocated reference picture, then select spatial prediction only;    if a motion flow associated with said portion of said video frame is substantially different than a motion flow associated with a reference picture, then select spatial prediction;    if temporal prediction of direct mode is signaled inside an image header, then selecting temporal prediction; and    if spatial prediction of direct mode is signaled inside said image header, then selecting spatial prediction.    
     
     
         74 . The method as recited in  claim 73 , further comprising: 
 correcting at least one temporally predicted parameter based on spatial information.    
     
     
         75 . The method as recited in  claim 73 , further comprising: 
 correcting at least one spatially predicted parameter based on temporal information.    
     
     
         76 . A computer-readable medium having computer implementable instructions for configuring at least one processing unit to perform acts comprising: 
 selecting between temporal prediction, spatial prediction, or both temporal and spatial prediction for encoding at least a portion of at least one video frame in an enhanced direct mode, such that: 
 temporal prediction is selected if at least one motion vector of a collocated portion of said video frame is zero,  
 only spatial prediction is selected if surrounding portions within said video frame use different reference pictures than a collocated reference picture,  
 spatial prediction is selected if a motion flow associated with said portion of said video frame is substantially different than a motion flow associated with a reference picture,  
 temporal prediction is selected if temporal prediction of direct mode is signaled inside an image header, and  
 spatial prediction is selected if spatial prediction of direct mode is signaled inside said image header.  
   
     
     
         77 . The computer-readable medium as recited in  claim 76 , further comprising: 
 correcting at least one temporally predicted parameter based on spatial information.    
     
     
         78 . The computer-readable medium as recited in  claim 76 , further comprising: 
 correcting at least one spatially predicted parameter based on temporal information.    
     
     
         79 . An apparatus comprising: 
 logic operatively configured to select between and employ temporal prediction, spatial prediction, or both temporal and spatial prediction for encoding at least a portion of at least one video frame in an enhanced direct mode, wherein said logic: 
 selects temporal prediction if at least one motion vector of a collocated portion of said video frame is zero,  
 selects only spatial prediction if surrounding portions within said video frame use different reference pictures than a collocated reference picture,  
 selects spatial prediction if a motion flow associated with said portion of said video frame is substantially different than a motion flow associated with a reference picture,  
 selects temporal prediction if temporal prediction of direct mode is signaled inside an image header, and  
 selects spatial prediction if spatial prediction of direct mode is signaled inside said image header.  
   
     
     
         80 . The apparatus as recited in  claim 79 , wherein said logic is further operatively configured to correct at least one temporally predicted parameter based on spatial information.  
     
     
         81 . The apparatus as recited in  claim 79 , wherein said logic is further operatively configured to correct at least one spatially predicted parameter based on temporal information.  
     
     
         82 . A method for use in encoding video data, the method comprising: 
 selecting a reference portion of a future video frame to serve as a B picture to at least one portion of an earlier video frame;    using motion vectors associated with said reference frame to calculate motion vectors associated with said at least one portion; and    encoding said at least one portion based on said calculated motion vectors associated with said at least one portion.    
     
     
         83 . A method as recited in  claim 82 , wherein using said motion vectors associated with said reference frame to calculate said motion vectors associated with said at least one portion further includes estimating at least one possible prediction for use in direct mode coding by projecting and inverting backward and forward motion vectors of the reference portion.  
     
     
         84 . The method as recited in  claim 83 , wherein encoding said at least one portion based on said calculated motion vectors associated with said at least one portion further includes applying selective projection and inversion based on at least one temporal parameter associated with said reference portion with respect to said at least one portion.  
     
     
         85 . The method as recited in  claim 82 , wherein only one reference portion is used for B pictures when encoding in direct mode.  
     
     
         86 . The method as recited in  claim 82 , wherein encoding said at least one portion based on said calculated motion vectors associated with said at least one portion further includes encoding in a direct mode wherein at least one of said calculated motion vectors is based on at least one projected motion vector that refers to at least two reference portions in two different reference pictures.  
     
     
         87 . The method as recited in  claim 82 , wherein encoding said at least one portion based on said calculated motion vectors associated with said at least one portion further includes encoding in a direct mode wherein at least one of said calculated motion vectors is based on spatial prediction associated with said reference portion.  
     
     
         88 . A computer-readable medium having computer implementable instructions for configuring at least one processing unit to perform acts comprising: 
 selecting a reference portion of a future video frame to serve as a B picture to at least one portion of an earlier video frame;    using motion vectors associated with said reference frame to calculate motion vectors associated with said at least one portion; and    encoding said at least one portion based on said calculated motion vectors associated with said at least one portion.    
     
     
         89 . A computer-readable medium as recited in  claim 88 , wherein using said motion vectors associated with said reference frame to calculate said motion vectors associated with said at least one portion further includes estimating at least one possible prediction for use in direct mode coding by projecting and inverting backward and forward motion vectors of the reference portion.  
     
     
         90 . The computer-readable medium as recited in  claim 89 , wherein encoding said at least one portion based on said calculated motion vectors associated with said at least one portion further includes applying selective projection and inversion based on at least one temporal parameter associated with said reference portion with respect to said at least one portion.  
     
     
         91 . The computer-readable medium as recited in  claim 88 , wherein only one reference portion is used for B pictures when encoding in direct mode.  
     
     
         92 . The computer-readable medium as recited in  claim 88 , wherein encoding said at least one portion based on said calculated motion vectors associated with said at least one portion further includes encoding in a direct mode wherein at least one of said calculated motion vectors is based on at least one projected motion vector that refers to at least two reference portions in two different reference pictures.  
     
     
         93 . The computer-readable medium as recited in  claim 88 , wherein encoding said at least one portion based on said calculated motion vectors associated with said at least one portion further includes encoding in a direct mode wherein at least one of said calculated motion vectors is based on spatial prediction associated with said reference portion.  
     
     
         94 . An apparatus comprising: 
 logic operatively configured to select a reference portion of a future video frame to serve as a B picture to at least one portion of an earlier video frame, use motion vectors associated with said reference frame to calculate motion vectors associated with said at least one portion, and encode said at least one portion based on said calculated motion vectors associated with said at least one portion.    
     
     
         95 . The apparatus as recited in  claim 94 , wherein said logic is further operatively configured to estimate at least one possible prediction for use in direct mode coding by projecting and inverting backward and forward motion vectors of the reference portion.  
     
     
         96 . The apparatus as recited in  claim 95 , wherein said logic is further operatively configured to apply selective projection and inversion based on at least one temporal parameter associated with said reference portion with respect to said at least one portion.  
     
     
         97 . The apparatus as recited in  claim 94 , wherein only one reference portion is used for B pictures when encoding in direct mode.  
     
     
         98 . The apparatus as recited in  claim 94 , wherein said logic is further operatively configured to encode in a direct mode wherein at least one of said calculated motion vectors is based on at least one projected motion vector that refers to at least two reference portions in two different reference pictures.  
     
     
         99 . The apparatus as recited in  claim 94 , wherein said logic is further operatively configured to encode in a direct mode wherein at least one of said calculated motion vectors is based on spatial prediction associated with said reference portion.  
     
     
         100 . A method for use in determining motion vectors during video encoding, the method comprising: 
 selecting at least three predictors A, B and C that each uses a different reference picture having an associated temporal distance TR A , TR B , and TR C  respectively, and a motion vector MV A , MV B , and MV C ; and    predicting a median motion vector MV pred  associated with a current reference picture that has a temporal distance equal to TR.    
     
     
         101 . The method as recited in  claim 100 , wherein said median predictor MV pred  is calculated as:  
       
         
           
             
               
                 
                   MV 
                   → 
                 
                 pred 
               
               = 
               
                 TR 
                 × 
                 
                   
                     Median 
                      
                     
                       ( 
                       
                         
                           
                             
                               MV 
                               → 
                             
                             A 
                           
                           
                             TR 
                             A 
                           
                         
                         , 
                         
                           
                             
                               MV 
                               → 
                             
                             B 
                           
                           
                             TR 
                             B 
                           
                         
                         , 
                         
                           
                             
                               MV 
                               → 
                             
                             C 
                           
                           
                             TR 
                             C 
                           
                         
                       
                       ) 
                     
                   
                   . 
                 
               
             
           
           
           
               
           
         
       
     
     
         102 . The method as recited in  claim 100 , wherein said median predictor MV pred  is calculated as:  
         MV   pred =Median( Ave ( {right arrow over (MV)}   C     1     ,{right arrow over (MV)}   C     2   ), Ave ( {right arrow over (MV)}   A     1     , {right arrow over (MV)}   A     2   ), {right arrow over (MV)}   B ).  
     
     
         103 . The method as recited in  claim 100 , further comprising: 
 selecting at least a fourth predictor D having an associated temporal distance TR D  and a motion vector MV D , and wherein said median predictor MV pred  is calculated as:      {right arrow over (MV)}   pred =Median(Median( {right arrow over (MV)}   C     1     ,{right arrow over (MV)}   C     1     ,{right arrow over (MV)}   D ), . . . Median( {right arrow over (MV)}   D   ,{right arrow over (MV)}   A     1   ,{right arrow over (MV)} C     1   ),Median( {right arrow over (MV)}   B   ,{right arrow over (MV)}   A     1     ,{right arrow over (MV)}   A     2   ))        
     
     
         104 . The method as recited in  claim 100 , further comprising: 
 selecting at least a fourth predictor D having an associated temporal distance TR D  and a motion vector MV D , and wherein said median predictor MV pred  is calculated as:      {right arrow over (MV)}   pred =Median( {right arrow over (MV)}   C     1     ,{right arrow over (MV)}   C     2     , {right arrow over (MV)}   D   , {right arrow over (MV)}   B   ,{right arrow over (MV)}   A     1     , {right arrow over (MV)}   A     2   ).    
     
     
         105 . The method as recited in  claim 100 , further comprising selectively substituting an adjacent portion of a reference frame for a selected portion of said reference frame for use in determining motion vector prediction when intra coding is used.  
     
     
         106 . A computer-readable medium having computer implementable instructions for configuring at least one processing unit to perform acts comprising: 
 selecting at least three predictors A, B and C that each uses a different reference picture having an associated temporal distance TR A , TR B , and TR C  respectively, and a motion vector MV A , MV B , and MV C ; and    predicting a median motion vector MV pred  associated with a current reference picture that has a temporal distance equal to TR.    
     
     
         107 . The computer-readable medium as recited in  claim 106 , wherein said median predictor MV pred  is calculated as:  
       
         
           
             
               
                 
                   MV 
                   → 
                 
                 pred 
               
               = 
               
                 TR 
                 × 
                 
                   
                     Median 
                      
                     
                       ( 
                       
                         
                           
                             
                               MV 
                               → 
                             
                             A 
                           
                           
                             TR 
                             A 
                           
                         
                         , 
                         
                           
                             
                               MV 
                               → 
                             
                             B 
                           
                           
                             TR 
                             B 
                           
                         
                         , 
                         
                           
                             
                               MV 
                               → 
                             
                             C 
                           
                           
                             TR 
                             C 
                           
                         
                       
                       ) 
                     
                   
                   . 
                 
               
             
           
           
           
               
           
         
       
     
     
         108 . The computer-readable medium as recited in  claim 106 , wherein said median predictor MV pred  is calculated as:  
         {right arrow over (MV)}   pred =Median( Ave ( {right arrow over (MV)}   C     1     ,{right arrow over (MV)}   C     2   ), Ave({right arrow over (MV)} A     1   , {right arrow over (MV)} A     2   ),{right arrow over (MV)} B ).  
     
     
         109 . The computer-readable medium as recited in  claim 106 , further comprising: 
 selecting at least a fourth predictor D having an associated temporal distance TR D  and a motion vector MV D , and wherein said median predictor MV pred  is calculated as:      {right arrow over (MV)}   pred =Median(Median( {right arrow over (MV)}   C     1     ,{right arrow over (MV)}   C     2     ,{right arrow over (MV)}   D ), . . . Median( {right arrow over (MV)}   D   ,{right arrow over (MV)}   A     1     ,{right arrow over (MV)}   C     2   ),Median( {right arrow over (MV)}   B   ,{right arrow over (MV)}   A     1     ,{right arrow over (MV)}   A     2   ))    
     
     
         110 . The computer-readable medium as recited in  claim 106 , further comprising: 
 selecting at least a fourth predictor D having an associated temporal distance TR D  and a motion vector MV D , and wherein said median predictor MV pred  is calculated as:      {right arrow over (MV)}   pred =Median( {right arrow over (MV)}   C     1     ,{right arrow over (MV)}   C     2     ,{right arrow over (MV)}   D   ,{right arrow over (MV)}   B   ,{right arrow over (MV)}   A     1     ,{right arrow over (MV)}   A     2   )    
     
     
         111 . The computer-readable medium as recited in  claim 106 , further comprising selectively substituting an adjacent portion of a reference frame for a selected portion of said reference frame for use in determining motion vector prediction when intra coding is used.  
     
     
         112 . An apparatus comprising logic operatively configured to select at least three predictors A, B and C that each uses a different reference picture having an associated temporal distance TR A , TR B , and TR C  respectively, and a motion vector MV A , MV B , and MV C , and predict a median motion vector MV pred  associated with a current reference picture that has a temporal distance equal to TR.  
     
     
         113 . The apparatus as recited in  claim 112 , wherein said median predictor MV pred  is calculated as:  
       
         
           
             
               
                 
                   MV 
                   → 
                 
                 pred 
               
               = 
               
                 TR 
                 × 
                 
                   
                     Median 
                      
                     
                       ( 
                       
                         
                           
                             
                               MV 
                               → 
                             
                             A 
                           
                           
                             TR 
                             A 
                           
                         
                         , 
                         
                           
                             
                               MV 
                               → 
                             
                             B 
                           
                           
                             TR 
                             B 
                           
                         
                         , 
                         
                           
                             
                               MV 
                               → 
                             
                             C 
                           
                           
                             TR 
                             C 
                           
                         
                       
                       ) 
                     
                   
                   . 
                 
               
             
           
           
           
               
           
         
       
     
     
         114 . The apparatus as recited in  claim 112 , wherein said median predictor MV pred  is calculated as:  
         {right arrow over (MV)}   pred =Median( Ave ( {fraction (MV)}   C     1     , {right arrow over (MV)}   C     2   ), Ave( MV   A     1     ,{right arrow over (MV)}   A     2   ),{right arrow over (MV)} B ).  
     
     
         115 . The apparatus as recited in  claim 112 , wherein said logic is further operatively configured to select at least a fourth predictor D having an associated temporal distance TR D  and a motion vector MV D , and wherein said median predictor MV pred  is calculated as:  
         {right arrow over (MV)}   pred =Median(Median( {right arrow over (MV)}   C     1     ,{right arrow over (MV)}   C     2     ,{right arrow over (MV)}   D ), . . . Median( {right arrow over (MV)}   D   ,{right arrow over (MV)}   A     1     ,{right arrow over (MV)}   C     2   ),Median( {right arrow over (MV)}   B   ,{right arrow over (MV)}   A     1     ,{right arrow over (MV)}   A     2   ))  
     
     
         116 . The apparatus as recited in  claim 112 , wherein said logic is further operatively configured to select at least a fourth predictor D having an associated temporal distance TR D  and a motion vector MV D , and wherein said median predictor MV pred  is calculated as:  
         {right arrow over (MV)}   Pred =Median( {right arrow over (MV)}   C     1     , {right arrow over (MV)}   C     2     ,{right arrow over (MV)}   D   ,{right arrow over (MV)}   B   ,{right arrow over (MV)}   A     1     ,{right arrow over (MV)}   A     2   ).  
     
     
         117 . The apparatus as recited in  claim 112 , wherein said logic is further operatively configured to selectively substitute an adjacent portion of a reference frame for a selected portion of said reference frame for use in determining motion vector prediction when intra coding is used.

Join the waitlist — get patent alerts

Track US2004001546A1 — get alerts on status changes and closely related new filings.

We store only your email — no account needed. See our privacy policy.