Method and device for overlaying 3d graphics over 3d video

Abstract

A method of decoding and outputting video information suitable for three-dimensional [3D] display, the video information comprising encoded main video information suitable for displaying on a 2D display and encoded additional video information for enabling three-dimensional [3D] display, the method comprising: receiving or generating three-dimensional [3D] overlay information to be overlayed over the video information; buffering a first part of the overlay information to be overlayed over the main video information in a first buffer; buffering a second part of overlay information to be overlayed over the additional video information in a second buffer; decoding the main video information and the additional video information and generating as a series of time interleaved video frames, each outputted video frame being either main video frame or additional video frame; determining a type of an video frame to be outputted being either a main video frame or an additional video frame; overlaying either first or second part of the overlay information on an video frame to be outputted in agreement with the determined type of frame outputting the video frames and the overlayed information.

1 . A method of decoding and outputting video information suitable for three-dimensional [3D] display, the video information comprising encoded main video information suitable for displaying on a 2D display and encoded additional video information for enabling three-dimensional [3D] display,
 the method comprising:
 receiving or generating three-dimensional [3D] overlay information to be overlayed over the video information; 
 buffering a first part of the overlay information to be overlayed over the main video information in a first buffer; 
 buffering a second part of overlay information to be overlayed over the additional video information in a second buffer; 
 decoding the main video information and the additional video information and generating as a series of time interleaved video frames, each outputted video frame being either main video frame or additional video frame; 
 determining a type of an video frame to be outputted being either a main video frame or an additional video frame; 
 overlaying either first or second part of the overlay information on an video frame to be outputted in agreement with the determined type of frame 
 outputting the video frames and the overlayed information. 
   
     
     
         2 . A method according to  claim 1  wherein the main video information is a left video frame and the additional video information is a right video frame. 
     
     
         3 . A method according to  claim 2  wherein the overlay information is real time graphics. 
     
     
         4 . A method according to  claim 3 , wherein the real time graphics is generated by a Java application running on a Java Virtual machine. 
     
     
         5 . A method according to  claim 3 , wherein timing information is used to controlling the overlaying either first or second part of the overlay information on an video frame to be outputted in agreement with the determined type of frame. 
     
     
         6 . A method according to  claim 1  wherein the additional video information comprised depth information with respect to the video information. 
     
     
         7 . A method according to  claim 1  wherein the additional video information further comprises depth and occlusion information. 
     
     
         8 . A device for decoding and outputting video information suitable for three-dimensional [3D] display, the video information comprising encoded main video information suitable for displaying on a 2D display and encoded additional video information for enabling three-dimensional [3D] display,
 the device comprising
 input means for receiving three-dimensional [3D] overlay information to be overlayed over the video information or generation means for generating three-dimensional [3D] overlay information to be overlayed over the video information 
 a decoder for decoding the main video information and the additional video information, the decoder further adapted to generating as a series of time interleaved video frames, each outputted video frame being either main video frame or additional video frame; 
 means for receiving or generating three-dimensional [3D] overlay information to be overlayed over the video information 
   a graphics processing unit comprising a first buffer for buffering a first part of the overlay information to be overlayed over the main video information and a second buffer for buffering a second part of overlay information to be overlayed over the additional video information;   the graphics processing unit further comprising a controller for determining a type of an video frame to be outputted being either a main video frame or an additional video frame   a mixer for overlaying either first or second part of the overlay information on an video frame to be outputted in agreement with the determined type of frame
 output means for outputting the video frames and the overlayed information. 
   
     
     
         9 . A device according to  claim 8  wherein the main video information is a left video frame and the additional video information is a right video frame. 
     
     
         10 . A device according to  claim 9  wherein the overlay information is real time graphics. 
     
     
         11 . A device according to  claim 10 , wherein the real time graphics is generated by a Java application running on a Java Virtual machine. 
     
     
         12 . A device according to  claim 11 , wherein timing information is used to controlling the overlaying either first or second part of the overlay information on an video frame to be outputted in agreement with the determined type of frame. 
     
     
         13 . A device according to  claim 8  wherein the additional video information comprised depth information with respect to the video information. 
     
     
         14 . A device according to  claim 9  wherein the additional video information further comprises depth and occlusion information. 
     
     
         15 . A device according to  claim 8  wherein the controller is adapted to copy parts of a first overlay frame in the first buffer or parts of a second overlay frame in the second buffer at frame frequency for generating an overlay frame.