US11647334B2ActiveUtilityA1

Information processing apparatus, information processing method, and video sound output system

Assignee: SONY GROUP CORPPriority: Aug 10, 2018Filed: Jul 24, 2019Granted: May 9, 2023
Est. expiryAug 10, 2038(~12 yrs left)· nominal 20-yr term from priority
H04R 1/403A61B 2017/00119H04R 5/04H04R 7/045H04R 5/02H04R 2440/05A61B 90/361H04R 2499/13H04N 21/431H04R 2499/15H04S 7/40H04S 7/302H04S 2400/11H04R 1/406H04N 21/439A61B 2090/365A61B 34/25H04R 2201/401H04S 7/303
56
PatentIndex Score
0
Cited by
32
References
12
Claims

Abstract

The information processing apparatus includes a control section that detects a position of a sound source appearing in a video displayed on a screen of a display unit and that uses one or more vibrators to vibrate the display unit and thereby control output of sound such that a sound image of sound in synchronization with the video is localized at the position where the sound source appears on the screen displaying the video. In a case of displaying videos of two or more video sources on individual windows, the control section localizes a sound image of a sound source detected from the video of each video source at a position where the sound source appears in the corresponding window.

Claims

exact text as granted — not AI-modified
The invention claimed is: 
     
       1. An information processing apparatus comprising:
 circuitry configured to
 detect a position of a sound source appearing in a video displayed on a screen of a display, the sound source being placed in a plane of an image frame of the video; and 
 
 control one or more vibrators to vibrate the display, and thereby control output of sound such that a sound image of sound in synchronization with the video is localized at a position corresponding to the position, on the screen displaying the image frame of the video, of the sound source placed in the plane. 
 
     
     
       2. The information processing apparatus according to  claim 1 , wherein
 the circuitry is configured to detect the sound source appearing in a video of broadcast or an OTT service or in an externally input video. 
 
     
     
       3. The information processing apparatus according to  claim 1 , wherein
 the circuitry is configured to detect the sound source appearing in a video of visual communication. 
 
     
     
       4. The information processing apparatus according to  claim 1 , wherein
 the circuitry is configured to detect, as the position of the sound source, a position of a graphic displayed on the screen and localize a sound image of sound related to the graphic. 
 
     
     
       5. The information processing apparatus according to  claim 4 , wherein
 the circuitry is configured to detect, as the position of the graphic displayed on the screen, a position of a graphic of a sound agent executed on the information processing apparatus. 
 
     
     
       6. The information processing apparatus according to  claim 5 , further comprising:
 a sensor configured to detect a user interacting with the sound agent, wherein 
 the circuitry is configured to control a display position of a character according to a position of the user. 
 
     
     
       7. The information processing apparatus according to  claim 4 , wherein
 the circuitry is configured to detect, as the position of the graphic displayed on the screen, a position of a graphic of OSD or UI appearing on the screen and localize a sound image of a sound effect associated with the graphics in synchronization with display of the graphics on the screen. 
 
     
     
       8. The information processing apparatus according to  claim 1 , wherein,
 the circuitry is configured to, in a case of displaying videos of two or more video sources on individual windows, localize a sound image of a sound source detected from the video of each video source at a position corresponding to a position of the sound source appearing in the corresponding window. 
 
     
     
       9. An information processing method comprising:
 detecting a position of a sound source appearing in a video displayed on a screen of a display, the sound source being placed in a plane of an image frame of the video; and 
 using one or more vibrators to vibrate the display, and thereby control output of sound such that a sound image of sound in synchronization with the video is localized at a position corresponding to the position, on the screen displaying the image frame of the video, of the sound source placed in the plane. 
 
     
     
       10. A video sound output system comprising:
 a display; 
 one or more vibrators configured to vibrate the display, and thereby output sound; and 
 circuitry to detect a position of a sound source appearing in a video displayed on a screen of the display, the sound source being placed in a plane of an image frame of the video, and to control the output of sound such that a sound image of sound in synchronization with the video is localized at a position corresponding to the position, on the screen displaying the image frame of the video, of the sound source placed in the plane. 
 
     
     
       11. The information processing apparatus according to  claim 1 , wherein
 the plane is configured such that a video signal of the video is allocated thereto and is stored in a video memory. 
 
     
     
       12. The information processing apparatus according to  claim 1 , wherein
 the image frame of the video comprises a plurality of planes, and 
 the circuitry is configured to place the sound source in one of the plurality of planes according to a type of the video including the sound source.

Join the waitlist — get patent alerts

Track US11647334B2 — get alerts on status changes and closely related new filings.

We store only your email — no account needed. See our privacy policy.