US2023231973A1PendingUtilityA1

Streaming data processing for hybrid online meetings

Assignee: MICROSOFT TECHNOLOGY LICENSING LLCPriority: Aug 25, 2021Filed: Mar 20, 2023Published: Jul 20, 2023
Est. expiryAug 25, 2041(~15.1 yrs left)· nominal 20-yr term from priority
H04N 7/15G06V 40/172G06T 7/174H04L 51/10H04L 65/403H04L 51/18H04L 12/1827H04N 23/695G10L 17/02G10L 25/78H04L 65/60H04N 5/2628
59
PatentIndex Score
0
Cited by
0
References
0
Claims

Abstract

Techniques of streaming data processing for hybrid online meetings are disclosed herein. In one example, a method includes receiving, at the remote server, a video stream captured by a camera in the conference room. The video stream captures images of multiple local participants of an online meeting. The method also includes determining identities of the captured images of the multiple local participants in the received video stream using meeting information of the online meeting and generating a set of individual video streams each corresponding to one of the multiple local participants. The set of individual video streams can then be transmitted to the second computing device corresponding to a remote participant of the online meeting as if the multiple local participants are virtually joining the online meeting.

Claims

exact text as granted — not AI-modified
1 . (canceled) 
     
     
         2 . A method of presenting video streams across local and remote devices for a hybrid meeting including a combination of local and remote participants, the method comprising:
 receiving, at a server device, a first remote video stream captured by a first remote computing device;   receiving, at the server device, a local video stream captured by a local computing device located in a conference room with a plurality of local participants;   generating a plurality of individual video streams from the local video stream for the plurality of local participants, wherein generating the plurality of individual video streams comprises:
 determining identities of the plurality of local participants based on a combination of video content and audio content from the local video stream captured by the local computing device; and 
 generating a set of individual video streams, each individual video stream from the set of individual video streams being associated with a local participant from the plurality of local participants; and 
   causing the first remote video stream and the set of individual video streams to be distributed to the first remote computing device.   
     
     
         3 . The method of  claim 2 , wherein determining the identities of the plurality of local participants includes identifying one or more local participants from the plurality of local participants based on an analysis of video content from the local video stream. 
     
     
         4 . The method of  claim 2 , wherein determining the identities of the plurality of local participants includes identifying at least one local participant from the plurality of local participants based on an analysis of audio content from the local video stream. 
     
     
         5 . The method of  claim 2 , further comprising:
 determining that a first remote participant associated with the first remote computing device is joining the hybrid meeting remotely; and   in response to determining that the first remote participant is joining the hybrid meeting remotely, skip determining an identity of the first remote participant.   
     
     
         6 . The method of  claim 2 , further comprising:
 retrieving, from a network storage, data representing meeting information of the hybrid meeting, the meeting information including a contact list containing data representing identities of all the participants of the hybrid meeting, the data from the contact list including identification photos associated with users of an organization;   determining that a first remote participant associated with the first remote computing device is joining the hybrid meeting remotely based on a comparison of video content from the first remote video stream and an identification photo retrieved from the contact list.   
     
     
         7 . The method of  claim 2 , further comprising:
 retrieving, from a network storage, data representing meeting information of the hybrid meeting, the meeting information including voice samples associated with users of an organization;   determining that a first remote participant associated with the first remote computing device is joining the hybrid meeting remotely based on a comparison audio content from the first remote video stream and a voice sample from the meeting information.   
     
     
         8 . The method of  claim 2 , wherein causing the first remote video stream and the set of individual video streams to be distributed to the first remote computing device includes providing a presentation of a plurality of video streams on the first remote computing device as if each of the plurality of local participants are attending the hybrid meeting virtually. 
     
     
         9 . The method of  claim 2 , further comprising:
 receiving, at the server device, a second remote video stream captured by a second remote computing device;   causing the first remote video stream and the set of individual video streams to be further distributed to the second remote computing device; and   causing the second remote video stream to be distributed to each of the first remote computing device, second remote computing device, and the local computing device.   
     
     
         10 . The method of  claim 2 , wherein generating the plurality of individual video streams comprises, for a first local participant from the plurality of local participants:
 cropping the local video stream to remove other local participants from the received local video stream; and   saving the cropped local video stream as one of the individual video streams of the set of individual video streams.   
     
     
         11 . The method of  claim 10 , wherein saving the cropped local video stream comprises saving an enlarged version of the cropped video stream that has been digitally enlarged into a preset size. 
     
     
         12 . The method of  claim 2 , wherein the server device is a remote server on a distributed computing system in communication with the first remote computing device and the local computing device via a network. 
     
     
         13 . A system, comprising:
 at least one processor;   memory in electronic communication with the at least one processor; and   instructions stored in the memory, the instructions being executable by the at least one processor to:
 receive, at a server device, a first remote video stream captured by a first remote computing device; 
 receive, at the server device, a local video stream captured by a local computing device located in a conference room with a plurality of local participants; 
 generate a plurality of individual video streams from the local video stream for the plurality of local participants, wherein generating the plurality of individual video streams comprises:
 determining identities of the plurality of local participants based on a combination of video content and audio content from the local video stream captured by the local computing device; and 
 generating a set of individual video streams, each individual video stream from the set of individual video streams being associated with a local participant from the plurality of local participants; and 
 
 cause the first remote video stream and the set of individual video streams to be distributed to the first remote computing device. 
   
     
     
         14 . The system of  claim 13 , wherein determining the identities of the plurality of local participants includes identifying one or more local participants from the plurality of local participants based on an analysis of video content from the local video stream. 
     
     
         15 . The system of  claim 13 , wherein determining the identities of the plurality of local participants includes identifying at least one local participant from the plurality of local participants based on an analysis of audio content from the local video stream. 
     
     
         16 . The system of  claim 13 , wherein causing the first remote video stream and the set of individual video streams to be distributed to the first remote computing device includes providing a presentation of a plurality of video streams on the first remote computing device as if each of the plurality of local participants are attending the hybrid meeting virtually. 
     
     
         17 . The system of  claim 13 , further comprising instructions being executable by the at least one processor to:
 receive, at the server device, a second remote video stream captured by a second remote computing device;   cause the first remote video stream and the set of individual video streams to be further distributed to the second remote computing device; and   cause the second remote video stream to be distributed to each of the first remote computing device, second remote computing device, and the local computing device.   
     
     
         18 . The system of  claim 13 , wherein generating the plurality of individual video streams comprises, for a first local participant from the plurality of local participants:
 cropping the local video stream to remove other local participants from the received local video stream; and   saving the cropped local video stream as one of the individual video streams of the set of individual video streams.   
     
     
         19 . The system of  claim 13 , wherein the server device a remote server on a distributed computing system in communication with the first remote computing device and the local computing device via a network. 
     
     
         20 . A non-transitory computer readable media storing instructions thereon being executable by at least one processor to:
 receive, at a server device, a first remote video stream captured by a first remote computing device;   receive, at the server device, a local video stream captured by a local computing device located in a conference room with a plurality of local participants;   generate a plurality of individual video streams from the local video stream for the plurality of local participants, wherein generating the plurality of individual video streams comprises:
 determining identities of the plurality of local participants based on a combination of video content and audio content from the local video stream captured by the local computing device; and 
 generating a set of individual video streams, each individual video stream from the set of individual video streams being associated with a local participant from the plurality of local participants; and 
   cause the first remote video stream and the set of individual video streams to be distributed to the local computing device.   
     
     
         21 . The non-transitory computer readable media of  claim 20 , wherein determining the identities of the plurality of local participants includes identifying one or more local participants from the plurality of local participants based on an analysis of video content from the local video stream, and wherein determining the identities of the plurality of local participants includes identifying at least one local participant from the plurality of local participants based on an analysis of audio content from the local video stream.

Join the waitlist — get patent alerts

Track US2023231973A1 — get alerts on status changes and closely related new filings.

We store only your email — no account needed. See our privacy policy.