System and method for evaluation of network performance

Abstract

Systems and methods are provided for evaluating an effect of a simulated communication network to media data. The method includes encoding media data to produce a plurality of packets, each packet being associated with a packet index number, a packet size and a packet transmission time. The packet index number, packet size and packet transmission time for each of the plurality of packets can be input to a communication network simulator to create trace packets corresponding to the plurality of packets. The communication network simulator output indicates at least one effect of the simulated communication network to input trace packets.

1. A method for evaluating an effect of a simulated communication network to media data, the method comprising the acts of:
 encoding, by an encoder, media data to produce a plurality of packets to encode the media data; 
 generating, by the encoder, a packet index number, a packet size and a packet transmission time, separate from the plurality of packets and associated with each of the plurality of packets; 
 inputting the packet index number, packet size and packet transmission time for each of the plurality of packets to a communication network simulator, wherein the communication network simulator creates trace packets based on the packet index number, packet size and packet transmission time and corresponding to the plurality of packets; 
 receiving, at a decoder, from the encoder by a first communication link the plurality of packets and from the communication network simulator by a second communication link an output indicating at least one effect of the simulated communication network to the trace packets; 
 decoding, at the decoder, the media data encoded in the received plurality of packets while accounting for the effect of the simulated communication network; and 
 correlating the decoded media data to a performance rating. 
 
     
     
       2. The method of  claim 1 , wherein the media data includes at least one of voice, video and audio data. 
     
     
       3. The method of  claim 1 , wherein the output from the communication network simulator identifies a time of receipt of the trace packets. 
     
     
       4. The method of  claim 3 , further comprising determining the at least one effect based, at least in part, on the time and order of receipt of the trace packets. 
     
     
       5. The method of  claim 1 , wherein the at least one transmission effect includes at least one of packet loss, packet delay, jitter and a communication network impairment. 
     
     
       6. The method of  claim 1 , wherein the output indicating at least one effect of the simulated communication network to the trace packets is received in real time. 
     
     
       7. The method of  claim 1 , wherein correlating decoded media data to a performance rating includes translating decoded media data to at least one of a mean opinion score and a subjective performance rating. 
     
     
       8. A system comprising:
 an encoder which receives media data, produces a plurality of packets to encode the media data, and generates a packet index number, a packet size and a packet transmission time, separate from the plurality of packets and associated with each of the plurality of packets; 
 a communication network simulator, coupled to the encoder by a first communication link, which
 receives the packet index number, packet size and packet transmission time by the first communication link; 
 generates input trace packets based on the packet index number, packet size and packet transmission time corresponding to the plurality of packets, 
 applies the input trace packets to a simulated communication network, and 
 generates output trace packets comprising an indication of at least one effect of the simulated communication network; 
 
 a decoder, which receives the plurality of packets from the encoder by a second communication link and the output trace packets from the communication network simulator by a third communication link, decodes the media data encoded in the received plurality of packets and applies the at least one effect to the decoded media data based on the output of the communication network simulator; and 
 an output device, coupled to the decoder, that correlates the decoded media data to a performance rating. 
 
     
     
       9. The system of  claim 8 , wherein the media data includes at least one of voice, video and audio data. 
     
     
       10. The system of  claim 8 , wherein the output trace packets are each associated with an index number and a timestamp of receipt. 
     
     
       11. The system of  claim 10 , wherein the output device determines the at least one effect based, at least in part, on the index number and the timestamp of the output trace packets. 
     
     
       12. The system of  claim 8 , wherein the at least one transmission effect includes at least one of packet loss, packet delay, jitter and a communication network impairment in general. 
     
     
       13. The system of  claim 8 , wherein a communication interface outputs the media data in real time. 
     
     
       14. The system of  claim 8 , wherein the decoded device translates output media data to at least one of a mean opinion score and a subjective performance rating in general.