Object-based audio-visual terminal and bitstream structure

Abstract

As information to be processed at an object-based video or audio-visual (AV) terminal, an object-oriented bitstream includes objects, composition information, and scene demarcation information. Such bitstream structure allows on-line editing, e.g. cut and paste, insertion/deletion, grouping, and special effects. In the interest of ease of editing, AV objects and their composition information are transmitted or accessed on separate logical channels (LCs). Objects which have a lifetime in the decoder beyond their initial presentation time are cached for reuse until a selected expiration time. The system includes a de-multiplexer, a controller which controls the operation of the AV terminal, input buffers, AV objects decoders, buffers for decoded data, a composer, a display, and an object cache.

1 . A method for processing audio data, comprising:
 receiving in a data bitstream audio information and composition information, wherein said audio information includes a plurality of objects, each object being individually encoded, and wherein said composition information includes decoding time information and presentation time information;   processing said composition information received in the data bitstream to compose a single audio arrangement from said audio information, wherein a duration corresponding to the presentation time information of at least two of said individually encoded objects overlaps; and   outputting said single audio arrangement.   
     
     
         2 . The method of  claim 1 , wherein the receiving includes receiving from a network connection. 
     
     
         3 . The method of  claim 1 , wherein the receiving includes receiving from local memory. 
     
     
         4 . The method of  claim 1 , wherein said plurality of objects has immediate aural relevancy. 
     
     
         5 . The method of  claim 4 , further comprising storing said audio information in memory. 
     
     
         6 . The method of  claim 5 , wherein said memory is a cache memory. 
     
     
         7 . The method of  claim 6 , further comprising storing said audio information beyond its initial presentation time. 
     
     
         8 . The method of  claim 1 , wherein the outputting further includes outputting the single audio arrangement via a plurality of speakers. 
     
     
         9 . The method of  claim 1 , wherein the outputting further includes transmitting the single audio arrangement. 
     
     
         10 . A system for processing audio data, comprising:
 a controller circuit for receiving in a data bitstream audio information and composition information, wherein said audio information includes a plurality of objects, each object being individually encoded, and wherein said composition information includes decoding time information and presentation time information;   a composer circuit for processing said composition information received in the data bitstream to compose a single audio arrangement from said audio information, wherein a duration corresponding to the presentation time information of at least two of said individually encoded objects overlaps; and   an output circuit for outputting said single audio arrangement.   
     
     
         11 . The system of  claim 10 , wherein the controller circuit is adapted for receiving from a network connection. 
     
     
         12 . The system of  claim 10 , wherein the controller circuit is adapted for receiving from local memory. 
     
     
         13 . The system of  claim 10 , wherein said plurality of objects has immediate aural relevancy. 
     
     
         14 . The system of  claim 13 , further comprising a storage circuit for storing said audio information in memory. 
     
     
         15 . The system of  claim 14 , wherein said memory is a cache memory. 
     
     
         16 . The system of  claim 15 , wherein the storage circuit is further configured to store said audio information beyond its initial presentation time. 
     
     
         17 . The system of  claim 10 , further comprising a plurality of speakers coupled with the output circuit for performing the single audio arrangement. 
     
     
         18 . The system of  claim 10 , further comprising a transmitter coupled with the output circuit for transmitting the single audio arrangement. 
     
     
         19 . A method for processing audio data, comprising:
 receiving in a data bitstream audio information and composition information, wherein said audio information includes a plurality of objects, each object being individually encoded, and wherein said composition information includes decoding time information and presentation time information;   processing said composition information received in the data bitstream to compose a single audio arrangement from said audio information, wherein a presentation time stamp corresponding to at least one of said individually encoded objects indicates a time for presentation of the individually encoded object during a presentation of at least one other of said individually encoded objects, such that a duration corresponding to the presentation time info nation of the at least two individually encoded objects overlaps; and   outputting said single audio arrangement.