US2020304790A1PendingUtilityA1

Image processing apparatus and method

Assignee: SONY CORPPriority: Sep 30, 2016Filed: Jun 9, 2020Published: Sep 24, 2020
Est. expirySep 30, 2036(~10.2 yrs left)· nominal 20-yr term from priority
Inventors:Takeshi Tsukuba
H04N 19/176H04N 19/159H04N 19/147H04N 19/12H04N 19/46H04N 19/70
54
PatentIndex Score
0
Cited by
0
References
0
Claims

Abstract

There is provided an image processing apparatus and method that make it possible to suppress reduction of the encoding efficiency. Encoded data is decoded, and based on a value of a transform skip identifier obtained by the decoding, execution of an inverse primary vertical transform and execution of an inverse primary horizontal transform are controlled. Further, based on a value of a transform skip identifier, execution of a primary horizontal transform and execution of a primary vertical transform are controlled, and the transform skip identifier is encoded. The present disclosure can be applied, for example, to an image processing apparatus, an image encoding apparatus, an image decoding apparatus or the like.

Claims

exact text as granted — not AI-modified
1 . An image processing apparatus, comprising:
 a decoding section configured to decode encoded data;   an inverse primary vertical transform controlling section configured to control, based on a value of a transform skip identifier obtained by the decoding of the encoded data by the decoding section, execution of an inverse primary vertical transform that is an inverse primary transform in a vertical direction for transform coefficient data transformed from image data; and   an inverse primary horizontal transform controlling section configured to control, based on the value of the transform skip identifier, execution of an inverse primary horizontal transform that is an inverse primary transform in a horizontal direction for the transform coefficient data transformed from the image data,   wherein an inverse primary vertical transform set and an inverse primary vertical transform set of a transform set are selected on basis of an intra prediction mode,   wherein a vertical transform set contains a plurality of vertical transforms and a horizontal transform set contains a plurality of horizontal transforms, and   wherein the decoding section, the inverse primary vertical transform controlling section, and the inverse primary horizontal transform controlling section are each implemented via at least one processor.   
     
     
         2 . The image processing apparatus according to  claim 1 , wherein
 the inverse primary vertical transform controlling section controls the execution of the inverse primary vertical transform such that,
 where the transform skip identifier indicates that a one-dimensional transform in the vertical direction is not to be skipped, the inverse primary vertical transform for the transform coefficient data is executed, and 
 where the transform skip identifier indicates that the one-dimensional transform in the vertical direction is to be skipped, the inverse primary vertical transform for the transform coefficient data is omitted. 
   
     
     
         3 . The image processing apparatus according to  claim 1 , wherein
 the inverse primary horizontal transform controlling section controls the execution of the inverse primary horizontal transform such that,
 where the transform skip identifier indicates that a one-dimensional transform in the horizontal direction is not to be skipped, the inverse primary horizontal transform for the transform coefficient data is executed, and 
 where the transform skip identifier indicates that the one-dimensional transform in the horizontal direction is to be skipped, the inverse primary horizontal transform for the transform coefficient data is omitted. 
   
     
     
         4 . The image processing apparatus according to  claim 1 , further comprising:
 a selection section configured to select an orthogonal transform that is to be applied to the inverse primary vertical transform and the inverse primary horizontal transform,   wherein the selection section is implemented via at least one processor.   
     
     
         5 . The image processing apparatus according to  claim 4 , wherein
 the selection section
 selects an orthogonal transform to be applied as the inverse primary vertical transform based on a vertical transform set identifier and a primary vertical transform designation flag obtained by the decoding of the encoded data by the decoding section, and 
 selects an orthogonal transform to be applied as the inverse primary horizontal transform based on a horizontal transform set identifier and a primary horizontal transform designation flag obtained by the decoding of the encoded data by the decoding section. 
   
     
     
         6 . The image processing apparatus according to  claim 5 , wherein
 the decoding section derives the primary vertical transform designation flag and the primary horizontal transform designation flag from a primary transform identifier in response to the value of the transform skip identifier.   
     
     
         7 . The image processing apparatus according to  claim 6 , wherein
 the decoding section
 derives, where the transform skip identifier indicates that a two-dimensional transform is not to be skipped, the primary vertical transform designation flag and the primary horizontal transform designation flag by processing the primary transform identifier as a 2-bit bin string, and 
 derives, where the transform skip identifier indicates that a one-dimensional transform in the vertical direction or the horizontal direction is not to be skipped, the primary vertical transform designation flag and the primary horizontal transform designation flag by processing the primary transform identifier as a 1-bit bin string. 
   
     
     
         8 . The image processing apparatus according to  claim 5 , wherein
 the decoding section decodes the primary vertical transform designation flag and the primary horizontal transform designation flag included in the encoded data.   
     
     
         9 . The image processing apparatus according to  claim 1 , wherein,
 where the transform skip identifier indicates that a one-dimensional transform in the vertical direction or the horizontal direction or a two-dimensional transform is not to be skipped, the decoding section omits decoding of the secondary transform identifier and sets the secondary transform identifier to a value that indicates that the secondary transform is not to be performed.   
     
     
         10 . An image processing method, comprising:
 decoding encoded data;   controlling, based on a value of a transform skip identifier obtained by the decoding of the encoded data, execution of an inverse primary vertical transform that is an inverse primary transform in a vertical direction for transform coefficient data transformed from image data; and   controlling, based on the value of the transform skip identifier, execution of an inverse primary horizontal transform that is an inverse primary transform in a horizontal direction for the transform coefficient data transformed from the image data,   wherein an inverse primary vertical transform set and an inverse primary vertical transform set of a transform set are selected on basis of an intra prediction mode, and   wherein a vertical transform set contains a plurality of vertical transforms and a horizontal transform set contains a plurality of horizontal transforms.   
     
     
         11 . An image processing apparatus, comprising:
 a primary horizontal transform controlling section configured to control execution of a primary horizontal transform that is a primary transform in a horizontal direction for residual data between an image and a prediction image based on a value of a transform skip identifier;   a primary vertical transform controlling section configured to control, based on a value of the transform skip identifier, execution of a primary vertical transform that is a primary transform in a vertical direction for the residual data between the image and the prediction image; and   an encoding section configured to encode the transform skip identifier,   wherein an inverse primary vertical transform set and an inverse primary vertical transform set of a transform set are selected on basis of an intra prediction mode,   wherein a vertical transform set contains a plurality of vertical transforms and a horizontal transform set contains a plurality of horizontal transforms, and   wherein the primary horizontal transform controlling section, the primary vertical transform controlling section, and the encoding section are each implemented via at least one processor.   
     
     
         12 . The image processing apparatus according to  claim 11 , wherein
 the primary horizontal transform controlling section controls the execution of the primary horizontal transform such that,
 where the transform skip identifier indicates that a one-dimensional transform in the horizontal direction is not to be skipped, the primary horizontal transform for the residual data is executed, and 
 where the transform skip identifier indicates that the one-dimensional transform in the horizontal direction is to be skipped, the primary horizontal transform for the residual data is omitted. 
   
     
     
         13 . The image processing apparatus according to  claim 11 , wherein
 the primary vertical transform controlling section controls the execution of the primary horizontal transform such that,
 where the transform skip identifier indicates that a one-dimensional transform in the vertical direction is not to be skipped, the primary vertical transform for the residual data is executed, and 
 where the transform skip identifier indicates that the one-dimensional transform in the vertical direction is to be skipped, the primary vertical transform for the residual data is omitted. 
   
     
     
         14 . The image processing apparatus according to  claim 11 , further comprising:
 a selection section configured to select an orthogonal transform that is to be applied to the primary horizontal transform and the inverse primary vertical transform,   wherein the selection section is implemented via at least one processor.   
     
     
         15 . The image processing apparatus according to  claim 14 , wherein
 the selection section
 selects an orthogonal transform to be applied as the primary horizontal transform based on a horizontal transform set identifier and a primary horizontal transform designation flag, and 
 selects an orthogonal transform to be applied as the primary vertical transform based on a vertical transform set identifier and a primary vertical transform designation flag. 
   
     
     
         16 . The image processing apparatus according to  claim 15 , wherein
 the encoding section derives a primary transform identifier from the primary horizontal transform designation flag and the primary vertical transform designation flag in response to the value of the transform skip identifier.   
     
     
         17 . The image processing apparatus according to  claim 15 , wherein
 the encoding section
 derives, where the transform skip identifier indicates that the two-dimensional transform is not to be skipped, the primary transform identifier of a 2-bit bin string using the primary horizontal transform designation flag and the primary vertical transform designation flag, and 
 derives, where the transform skip identifier indicates that the one-dimensional transform in the vertical direction or the horizontal direction is not to be skipped, the primary transform identifier of a 1-bit bin string using the primary horizontal transform designation flag or the primary vertical transform designation flag. 
   
     
     
         18 . The image processing apparatus according to  claim 15 , wherein
 the encoding section encodes the primary horizontal transform designation flag and the primary vertical transform designation flag.   
     
     
         19 . The image processing apparatus according to  claim 11 , wherein,
 where the transform skip identifier indicates that a one-dimensional transform in the vertical direction or the horizontal direction or a two-dimensional transform is not to be skipped, the encoding section omits encoding of the secondary transform identifier.   
     
     
         20 . An image processing method, comprising:
 controlling execution of a primary horizontal transform that is a primary transform in a horizontal direction for residual data between an image and a prediction image based on a value of a transform skip identifier;   controlling, based on a value of the transform skip identifier, execution of a primary vertical transform that is a primary transform in a vertical direction for the residual data between the image and the prediction image; and   encoding the transform skip identifier,   wherein an inverse primary vertical transform set and an inverse primary vertical transform set of a transform set are selected on basis of an intra prediction mode, and   wherein a vertical transform set contains a plurality of vertical transforms and a horizontal transform set contains a plurality of horizontal transforms.

Join the waitlist — get patent alerts

Track US2020304790A1 — get alerts on status changes and closely related new filings.

We store only your email — no account needed. See our privacy policy.