Measuring and Using Interactivity in Video Conferencing

Abstract

Measuring and using interactivity in video conferencing can include identifying two or more client devices to be added to the video conference and establishing the video conference with the two client devices. Medica content can be generated, exchanged, and received via a video conferencing service, and quality of experience metric data associated with the video conference can be obtained. The quality of experience metric data can define interactivity associated with the video conference based on observable behavior associated with the video conference. Based on the quality of experience metric data, a projected quality of experience can be compared to a defined quality of experience measure, and if the projected quality of experience does not satisfy the defined quality of experience measure, a change to improve the projected quality of experience can be determined and a command can be generated and sent to cause a recipient to make the change.

The invention claimed is: 
     
         1 . A system comprising:
 a processor; and   a memory that stores computer-executable instructions that, when executed by the processor, cause the processor to perform operations comprising
 detecting a request to initiate a video conference, 
 identifying two client devices that are to be added to the video conference, 
 triggering a signaling server to establish the video conference with the two client devices, wherein the two client devices generate, exchange, and receive media content with one another via a video conferencing service, 
 obtaining quality of experience metric data associated with the video conference, wherein the quality of experience metric data defines an interactivity associated with the video conference and is based on observable behavior associated with the video conference, 
 determining, based on the quality of experience metric data, if a projected quality of experience associated with the video conference satisfies a defined quality of experience measure, and 
 if a determination is made that the projected quality of experience associated with the video conference does not satisfy the defined quality of experience measure,
 determining a change to be made to the video conference to improve the projected quality of experience, 
 generating a command that, when executed, causes a recipient to make the change, and 
 sending the command to the recipient. 
 
   
     
     
         2 . The system of  claim 1 , wherein the quality of experience metric data comprises data representing a turnaround time, a silence time ratio, an overlap time ratio, an overlap rate, a useful conversation time ratio, a repeat rate, and turn-taking freedom associated with the video conference, wherein a first portion of the quality of experience metric data is generated by the computer by analyzing an audio and video stream associated with the video conference, wherein a second portion of the quality of experience metric data is provided to the computer by the two client devices, and wherein the two client devices generate the quality of experience metric data based on analyzing the media content received by the two client devices. 
     
     
         3 . The system of  claim 1 , wherein the quality of experience metric data is generated at the computer by analyzing an audio and video stream associated with the video conference. 
     
     
         4 . The system of  claim 3 , wherein analyzing the audio and video stream comprises detecting repeated phrases, overlapping speech, and a silence time ratio using machine learning that is trained on simulated video conferences. 
     
     
         5 . The system of  claim 1 , wherein the quality of experience metric data is provided to the computer by the two client devices, and wherein the two client devices generate the quality of experience metric data based on analyzing the media content received by the two client devices. 
     
     
         6 . The system of  claim 1 , wherein the command causes one client device of the two client devices to introduce delay into audio and video associated with the video conference at the one client device. 
     
     
         7 . The system of  claim 1 , wherein the command causes the two client devices to reconnect to the video conference using a different communication path. 
     
     
         8 . A method comprising:
 detecting, at a computer comprising a processor, a request to initiate a video conference;   identifying, by the processor, two client devices that are to be added to the video conference;   triggering, by the processor, a signaling server to establish the video conference with the two client devices, wherein the two client devices generate, exchange, and receive media content with one another via a video conferencing service;   obtaining, by the processor, quality of experience metric data associated with the video conference, wherein the quality of experience metric data defines an interactivity associated with the video conference and is based on observable behavior associated with the video conference;   determining, by the processor and based on the quality of experience metric data, if a projected quality of experience associated with the video conference satisfies a defined quality of experience measure; and   if a determination is made that the projected quality of experience associated with the video conference does not satisfy the defined quality of experience measure,
 determining, by the processor, a change to be made to the video conference to improve the projected quality of experience, 
 generating, by the processor, a command that, when executed, causes a recipient to make the change, and 
 sending, by the processor, the command to the recipient. 
   
     
     
         9 . The method of  claim 8 , wherein the quality of experience metric data comprises data representing a turnaround time, a silence time ratio, an overlap time ratio, an overlap rate, a useful conversation time ratio, a repeat rate, and turn-taking freedom associated with the video conference, wherein a first portion of the quality of experience metric data is generated by the computer by analyzing an audio and video stream associated with the video conference, wherein a second portion of the quality of experience metric data is provided to the computer by the two client devices, and wherein the two client devices generate the quality of experience metric data based on analyzing the media content received by the two client devices. 
     
     
         10 . The method of  claim 8 , wherein the quality of experience metric data is generated at the computer by analyzing an audio and video stream associated with the video conference. 
     
     
         11 . The method of  claim 10 , wherein analyzing the audio and video stream comprises detecting repeated phrases, overlapping speech, and a silence time ratio using machine learning that is trained on simulated video conferences. 
     
     
         12 . The method of  claim 8 , wherein the quality of experience metric data is provided to the computer by the two client devices, and wherein the two client devices generate the quality of experience metric data based on analyzing the media content received by the two client devices. 
     
     
         13 . The method of  claim 8 , wherein the command causes one client device of the two client devices to introduce delay into audio and video associated with the video conference at the one client device. 
     
     
         14 . A computer storage medium having computer-executable instructions stored thereon that, when executed by a processor, cause the processor to perform operations comprising:
 detecting a request to initiate a video conference;   identifying two client devices that are to be added to the video conference;   triggering a signaling server to establish the video conference with the two client devices, wherein the two client devices generate, exchange, and receive media content with one another via a video conferencing service;   obtaining quality of experience metric data associated with the video conference, wherein the quality of experience metric data defines an interactivity associated with the video conference and is based on observable behavior associated with the video conference;   determining, based on the quality of experience metric data, if a projected quality of experience associated with the video conference satisfies a defined quality of experience measure; and   if a determination is made that the projected quality of experience associated with the video conference does not satisfy the defined quality of experience measure,
 determining a change to be made to the video conference to improve the projected quality of experience, 
 generating a command that, when executed, causes a recipient to make the change, and 
 sending the command to the recipient. 
   
     
     
         15 . The computer storage medium of  claim 14 , wherein the quality of experience metric data comprises data representing a turnaround time, a silence time ratio, an overlap time ratio, an overlap rate, a useful conversation time ratio, a repeat rate, and turn-taking freedom associated with the video conference, wherein a first portion of the quality of experience metric data is generated by the computer by analyzing an audio and video stream associated with the video conference, wherein a second portion of the quality of experience metric data is provided to the computer by the two client devices, and wherein the two client devices generate the quality of experience metric data based on analyzing the media content received by the two client devices. 
     
     
         16 . The computer storage medium of  claim 14 , wherein the quality of experience metric data is generated at the computer by analyzing an audio and video stream associated with the video conference. 
     
     
         17 . The computer storage medium of  claim 16 , wherein analyzing the audio and video stream comprises detecting repeated phrases, overlapping speech, and a silence time ratio using machine learning that is trained on simulated video conferences. 
     
     
         18 . The computer storage medium of  claim 14 , wherein the quality of experience metric data is provided to the computer by the two client devices, and wherein the two client devices generate the quality of experience metric data based on analyzing the media content received by the two client devices. 
     
     
         19 . The computer storage medium of  claim 14 , wherein the command causes one client device of the two client devices to introduce delay into audio and video associated with the video conference at the one client device. 
     
     
         20 . The computer storage medium of  claim 14 , wherein the command causes the two client devices to reconnect to the video conference using a different communication path.