Virtual temporal affine candidates

Abstract

A video encoder or decoder processes portions of video using virtual temporal affine motion candidates. Under the general aspects, virtual temporal affine candidates are created using only the classical temporal motion buffer information, avoiding the storage of additional affine parameters in a temporal motion buffer. A motion field for encoding or decoding a video block is generated based on the virtual temporal affine candidates. In one embodiment, collocated motion candidates are rescaled by adjusting the picture order count of the determined motion field. In another embodiment, resolution adaptation is performed to enable a current motion buffer to correspond to a reference motion buffer.

1 . A method, comprising:
 determining, for a video block being encoded in a picture, at least one predictor candidate;   determining for the at least one predictor candidate, one or more corresponding control point motion vectors, based on motion information associated to the at least one predictor candidate;   determining for the video block being encoded, one or more corresponding control point motion vectors, based on neighboring sub-blocks surrounding corner sub-blocks of the video block, wherein said neighboring sub-blocks surrounding corner sub-blocks are searched in an order to determine a first neighboring sub-block having a motion vector and using that as a predictor candidate for the corresponding corner;   rescaling the one or more control point motion vectors based on the reference index of both a current and a reference frame;   determining, based on the one or more rescaled corresponding control point motion vectors determined for the video block, a corresponding motion field, wherein the corresponding motion field identifies motion vectors used for prediction of sub-blocks of the video block being encoded; and,   encoding the video block based on the corresponding motion field.   
     
     
         2 . An apparatus for encoding a video block, comprising:
 a processor, configured to:   determine, for a video block being encoded in a picture, at least one predictor candidate;   determine for the at least one predictor candidate, one or more corresponding control point motion vectors, based on motion information associated to the at least one predictor candidate;   determine for the video block being encoded, one or more corresponding control point motion vectors, based on neighboring sub-blocks surrounding corner sub-blocks of the video block, wherein said neighboring sub-blocks surrounding corner sub-blocks are searched in an order to determine a first neighboring sub-block having a motion vector and using that as a predictor candidate for the corresponding corner;   rescaling the one or more control point motion vectors based on the reference index of both a current and a reference frame;   determining, based on the one or more rescaled corresponding control point motion vectors determined for the video block, a corresponding motion field, wherein the corresponding motion field identifies motion vectors used for prediction of sub-blocks of the video block being encoded; and,   encode the video block based on the corresponding motion field.   
     
     
         3 . A method, comprising:
 determining, for a video block being decoded in a picture, at least one predictor candidate;   determining for the at least one predictor candidate, one or more corresponding control point motion vectors, based on motion information associated to the at least one predictor candidate;   determining for the video block being decoded, one or more corresponding control point motion vectors, based on neighboring sub-blocks surrounding corner sub-blocks of the video block, wherein said neighboring sub-blocks surrounding corner sub-blocks are searched in an order to determine a first neighboring sub-block having a motion vector and using that as a predictor candidate for the corresponding corner;   rescaling the one or more control point motion vectors based on the reference index of both a current and a reference frame;   determining, based on the one or more rescaled corresponding control point motion vectors determined for the video block, a corresponding motion field, wherein the corresponding motion field identifies motion vectors used for prediction of sub-blocks of the video block being decoded; and,   decoding the video block based on the corresponding motion field.   
     
     
         4 . An apparatus for decoding a video block, comprising:
 a processor, configured to:   determine, for a video block being decoded in a picture, at least one predictor candidate;   determine for the at least one predictor candidate, one or more corresponding control point motion vectors, based on motion information associated to the at least one predictor candidate;   determine for the video block being decoded, one or more corresponding control point motion vectors, based on neighboring sub-blocks surrounding corner sub-blocks of the video block, wherein said neighboring sub-blocks surrounding corner sub-blocks are searched in an order to determine a first neighboring sub-block having a motion vector and using that as a predictor candidate for the corresponding corner;   rescaling the one or more control point motion vectors based on the reference index of both a current and a reference frame;   determining, based on the one or more rescaled corresponding control point motion vectors determined for the video block, a corresponding motion field, wherein the corresponding motion field identifies motion vectors used for prediction of sub-blocks of the video block being decoded; and,   decode the video block based on the corresponding motion field.   
     
     
         5 . The method of  claim 3 , wherein said order is the corner sub-block of the video block, followed by sub-blocks right, above, left, and below the corner sub-block. 
     
     
         6 . The method of  claim 3 , wherein corners of the video block to find candidate motion vectors to use in determining control point motion vectors are top-left, and either bottom-left or top-right. 
     
     
         7 . The method of  claim 3 , wherein picture order count for said motion field is chosen from the top-left motion vector candidate of the video block. 
     
     
         8 . The method of  claim 3 , wherein picture order count for said motion field is chosen from the top-left motion vector candidate, if available, followed by top-right, if available, and the bottom-left of the video block. 
     
     
         9 . The method of  claim 3 , wherein picture order count of a first image in a reference picture buffer is used if a reference picture order count is not among the reference images in a current reference picture list. 
     
     
         10 . The method of  claim 3 , wherein resolution adaptation is performed on a current motion buffer to correspond to a reference picture buffer by shifting sub-block locations for a candidate motion vector. 
     
     
         11 . A device comprising:
 an apparatus according to  claim 4 ; and   at least one of (i) an antenna configured to receive a signal, the signal including the video block, (ii) a band limiter configured to limit the received signal to a band of frequencies that includes the video block, and (iii) a display configured to display an output representative of the video block.   
     
     
         12 . A non-transitory computer readable medium containing data content generated according to the method of  claim 1 , for playback using a processor. 
     
     
         13 . A signal comprising video data generated according to the method of  claim 1 , for playback using a processor. 
     
     
         14 . A computer program product comprising instructions which, when the program is executed by a computer, cause the computer to carry out the method of  claim 3 .