US2016198125A1PendingUtilityA1
Dynamic facial feature substitution for video conferencing
Est. expiryJun 30, 2034(~7.9 yrs left)· nominal 20-yr term from priority
G06V 10/75G06F 18/22G10L 17/06G06T 2207/10016H04N 7/155H04L 12/1827H04L 65/4038G06Q 99/00H04N 7/157G06T 7/20H04L 12/18G06T 2207/30201H04L 12/1831H04N 7/152G06K 9/00302G06K 9/6202G06K 9/00281H04L 65/75G06V 40/171G06V 40/176G06V 40/166G06V 40/174G06V 40/16
51
PatentIndex Score
0
Cited by
0
References
0
Claims
Abstract
In an approach to determine facial feature substitution in a video conference, a computer receives one or more pre-recorded videos of an attendee of a video conference. The computer then substitutes one or more portions of the one or more pre-recorded videos into an avatar, the substitution corresponding to at least one targeted facial feature of the attendee in the video conference.
Claims
exact text as granted — not AI-modifiedWhat is claimed is:
1 . A method for facial feature substitution in a video conference, the method comprising:
receiving, by one or more computing devices, one or more pre-recorded videos of an attendee of a video conference; and substituting, by one or more computing devices, one or more portions of the one or more pre-recorded videos into an avatar, the substitution corresponding to at least one targeted facial feature of the attendee.
2 . The method of claim 1 , wherein substituting, by one or more computing devices, the one or more portions of the one or more pre-recorded videos into the avatar further comprise:
creating, by one or more computing devices, a co-ordinate map of one or more key facial elements of the attendee in the one or more pre-recorded videos; creating, by one or more computing devices, a co-ordinate map of one or more key facial elements of the attendee in the video of the attendee in the video conference; matching, by one or more computing devices, the co-ordinate map of the one or more pre-recorded videos to the co-ordinate map of the video of the attendee in the video conference; and substituting, by one or more computing devices, based, at least in part, on the matched co-ordinate maps, the one or more portions of the one or more pre-recorded videos into the avatar.
3 . The method of claim 1 , wherein the one or more portions of the one or more pre-recorded videos of the attendee correspond to the at least one targeted facial feature of the attendee in the video of the attendee in the video conference.
4 . The method of claim 1 , further comprising determining, by one or more computing devices, the one or more portions of the one or more pre-recorded videos correspond to the at least one targeted facial feature of the attendee in the video of the attendee in the video conference using one or more facial recognition algorithms to correlate facial expressions and facial movements in the video to the one or more pre-recorded videos.
5 . The method of claim 1 , further comprising determining, by one or more computing devices, the one or more portions of the one or more pre-recorded videos correspond to the at least one targeted facial feature of the attendee in the video of the attendee in the video conference using at least one of natural language processing and speech recognition to match corresponding one or more words in the video of the attendee to one or more words in the one or more pre-recorded videos.
6 . The method of claim 1 , further comprising determining, by one or more computing devices, the one or more portions of the one or more pre-recorded videos correspond to the at least one targeted facial feature of the attendee in the video of the attendee in the video conference using sentiment analysis to correlate the sentiment of the video of the attendee to sentiment of the one or more portions of the one or more pre-recorded videos.
7 . The method of claim 1 , further comprising determining, by one or more computing devices, the one or more portions of the one or more pre-recorded videos of the attendee correspond to at least one targeted facial feature of the attendee in the video of the attendee in the video conference using three dimensional facial recognition algorithms to correlate the video of the attendee with one or more portions of the one or more pre-recorded videos.
8 . The method of claim 1 , wherein the one or more pre-recorded videos of the attendee include a pre-recorded video with at least one of: an attendee speaking or the attendee exhibiting one or more facial expressions.
9 . A computer program product for facial feature substitution in a video conference, the computer program product comprising:
one or more computer readable storage media and program instructions stored on the one or more computer readable storage media, the program instructions executable by a processor, the program instructions comprising: program instructions to receive one or more pre-recorded videos of an attendee of a video conference; and program instructions to substitute one or more portions of the one or more pre-recorded videos into an avatar, the substitution corresponding to at least one targeted facial feature of the attendee.
10 . The computer program product of claim 9 , wherein the program instructions to substitute the one or more portions of the one or more pre-recorded videos into the avatar further comprise:
program instructions to create a co-ordinate map of one or more key facial elements of the attendee in the one or more pre-recorded videos; program instructions to create a co-ordinate map of one or more key facial elements of the attendee in the video of the attendee in the video conference; program instructions to match the co-ordinate map of the one or more pre-recorded videos to the co-ordinate map of the video of the attendee in the video conference; and program instructions to substitute, based, at least in part, on the matched co-ordinate maps, the one or more portions of the one or more pre-recorded videos into the avatar.
11 . The computer program product of claim 9 , further comprising program instructions to determine one or more portions of the one or more pre-recorded videos of the attendee correspond to at least one targeted facial feature of the attendee in the video of the attendee in the video conference using facial recognition algorithms to correlate facial expressions and facial movements in the video to the one or more pre-recorded videos.
12 . The computer program product of claim 9 , further comprising program instructions to determine one or more portions of the one or more pre-recorded videos of the attendee correspond to at least one targeted facial feature of the attendee in the video of the attendee in the video conference using at least one of natural language processing and speech recognition to match corresponding one or more words in the video of the attendee in the video conference to one or more words in the one or more pre-recorded videos.
13 . The computer program product of claim 9 , further comprising program instructions to determine one or more portions of the one or more pre-recorded videos of the attendee correspond to at least one targeted facial feature of the attendee in the video of the attendee in the video conference using sentiment analysis to correlate a sentiment of the video of the attendee in the video conference to a sentiment the one or more portions of the one or more pre-recorded videos.
14 . The computer program product of claim 9 , wherein the one or more pre-recorded videos of the attendee include a pre-recorded video with at least one of: an attendee speaking or the attendee exhibiting one or more facial expressions.
15 . A computer system for facial feature substitution in a video conference, the computer system comprising:
one or more computer processors; one or more computer readable storage media; program instructions stored on the computer readable storage media for execution by at least one of the one or more processors, the program instructions comprising: program instructions to receive one or more pre-recorded videos of an attendee of a video conference; and program instructions to substitute one or more portions of the one or more pre-recorded videos into an avatar, the substitution corresponding to at least one targeted facial feature of the attendee.
16 . The computer system of claim 15 , wherein the program instructions to substitute the one or more portions of the one or more pre-recorded videos into the avatar further comprise:
program instructions to create a co-ordinate map of one or more key facial elements of the attendee in the one or more pre-recorded videos; program instructions to create a co-ordinate map of one or more key facial elements of the attendee in the video of the attendee in the video conference; program instructions to match the co-ordinate map of the one or more pre-recorded videos to the co-ordinate map of the video of the attendee in the video conference; and program instructions to substitute, based, at least in part, on the matched co-ordinate maps, the one or more portions of the one or more pre-recorded videos into the avatar.
17 . The computer system of claim 15 , further comprising program instructions to determine one or more portions of the one or more pre-recorded videos of the attendee correspond to at least one targeted facial feature of the attendee in the video of the attendee in the video conference using one or more facial recognition algorithms to correlate facial expressions and facial movements in the video to the one or more pre-recorded videos.
18 . The computer system of claim 15 , further comprising program instructions to determine one or more portions of the one or more pre-recorded videos of the attendee correspond to at least one targeted facial feature of the attendee in the video of the attendee in the video conference using at least one of natural language processing and speech recognition to match corresponding one or more words in the video of the attendee in the video conference to one or more words in the one or more pre-recorded videos.
19 . The computer system of claim 15 , further comprising program instructions to determine one or more portions of the one or more pre-recorded videos of the attendee correspond to at least one targeted facial feature of the attendee in the video of the attendee in the video conference using sentiment analysis to correlate a sentiment of the video of the attendee in the video conference to a sentiment the one or more portions of the one or more pre-recorded videos.
20 . The computer system of claim 15 , wherein the one or more pre-recorded videos of the attendee include a pre-recorded video with at least one of: an attendee speaking or the attendee exhibiting one or more facial expressions.Join the waitlist — get patent alerts
Track US2016198125A1 — get alerts on status changes and closely related new filings.
We store only your email — no account needed. See our privacy policy.