Second screen haptics
Abstract
A multi-device system includes at least one media server system, a primary viewing device including a display screen, and a secondary device including a haptic output device. The at least one media server system includes a source of audio-video content and haptic content and is configured to transfer the audio-video content and the haptic content. The haptic content is associated with the audio-video content. The primary viewing device is configured to output the audio-video content received from the at least one media server system. The secondary device is configured to output the haptic content received from the at least one media server system as a haptic effect via the haptic output device.
Claims
exact text as granted — not AI-modified1 - 20 . (canceled)
21 . A system comprising:
a primary viewing device including a display, a first receiver, and a transmitter, the primary viewing device being configured to: receive a streamed composite signal including audio-video content and haptic content via the first receiver from at least one cloud streaming service, the haptic content being correlated with the audio-video content to enhance the substance of the audio-video content, recognize and output the audio-video content of the streamed composite signal; separate the haptic content from the composite signal, and transmit the haptic content to a secondary device; and the secondary device including a second receiver and a haptic output device, the second receiver being configured to: receive the haptic content from the transmitter of the primary viewing device, and process the haptic content to output the haptic content correlated with the audio-video content, wherein the primary viewing device and the secondary device are configured to cause the haptic content to be output on the secondary device in a synchronized fashion with the audio-video content being output on the primary viewing device.
22 . The system of claim 21 , wherein the secondary device is a gaming peripheral.
23 . The system of claim 21 , wherein the primary viewing device includes a playback locator that determines a temporal reference point representing a temporal playback position in the audio-video content and wherein the primary viewing device is configured to communicate the playback locator to the secondary device to communicate the temporal playback position in the audio-video content to the secondary device to synchronize playback of the haptic content on the secondary device to playback of the audio-video content on the primary viewing device.
24 . The system of claim 21 , wherein the secondary device includes a display screen configured to output the audio-video content.
25 . The system of claim 23 , wherein the secondary device is further configured to:
receive the haptic content and audio-video content together as the composite signal; and separate the haptic content from the composite signal for output.
26 . The system of claim 21 , wherein the gaming peripheral is a wearable device.
27 . The system of claim 21 , further including a second secondary device including a third receiver and a second haptic output device, the third receiver being configured to receive the haptic content from the transmitter of the primary viewing device, the second haptic output device being configured to output the haptic content correlated with the audio-video content.
28 . The system of claim 21 , wherein the primary viewing device is configured to provide a virtual environment and the secondary device is configured to permit user interaction with the virtual environment.
29 . A method of conveying haptic content to a viewer of audio-video content, the method comprising:
receiving, by a primary viewing device including a display, a first receiver, and a transmitter, a streamed composite signal including audio-video content and haptic content from at least one cloud streaming service, the haptic content being correlated with the audio-video content to enhance the substance of the audio-video content; recognizing and outputting the audio-video content of the streamed composite signal; separating the haptic content from the composite signal; transmitting, from the primary viewing device to a secondary device including a second receiver and a haptic output device, the haptic content; receiving, at the secondary device, the haptic content from the transmitter of the primary viewing device; processing, at the secondary device, the haptic content to output the haptic content correlated with the audio-video content; and outputting the haptic content correlated with the audio-video content by the secondary device in a synchronized fashion with the audio-video content being output on the primary viewing device.
30 . The method of claim 29 , wherein the secondary device is a gaming peripheral.
31 . The method of claim 29 , wherein communicating between the primary viewing device and the secondary device includes communicating a playback locator from the primary viewing device to the secondary device, the playback locator determining a temporal reference point representing a temporal playback position in the audio-video content.
32 . The method of claim 29 , further comprising:
receiving, at the secondary device, the haptic content and audio-video content together as the composite signal; and outputting the audio-video content via a display of the secondary device.
33 . The method of claim 29 , further comprising:
receiving, at the secondary device, the haptic content and audio-video content together as the composite signal; and separating, at the secondary device, the haptic content from the composite signal for output.
34 . A system comprising:
at least one cloud streaming service, wherein the at least one cloud streaming service includes a source of audio-video content and haptic content and is configured to stream the audio-video content and the haptic content as a streamed composite signal, the haptic content being correlated with the audio-video content to enhance the substance of the audio-video content, wherein the at least one cloud streaming service is configured to stream the audio-video content and the haptic content to a remotely-located primary viewing device, the primary viewing device including a display, a first receiver, and a transmitter and being configured to recognize and output the audio-video content of the streamed composite signal, separate the haptic content from the composite signal, and transmit the haptic content to the secondary device, and wherein the secondary device is configured to receive the haptic content from the transmitter of the primary viewing device, and process the haptic content to output the haptic content correlated with the audio-video content, wherein the audio-video content is output by the primary viewing device and the haptic content correlated with the audio-video content is output by the secondary device in a synchronized fashion with the audio-video content being rendered on the primary viewing device.
35 . The system of claim 34 , wherein the secondary device is a gaming peripheral.
36 . The system of claim 34 , wherein the primary viewing device includes a playback locator that determines a temporal reference point representing a temporal playback position in the audio-video content and wherein the primary viewing device is configured to communicate the playback locator to the secondary device to communicate the temporal playback position in the audio-video content to the secondary device to synchronize playback of the haptic content on the secondary device to playback of the audio-video content on the primary viewing device.
37 . A method of conveying a haptic effect to a viewer of audio-video content, the method comprising:
streaming, from at least one cloud streaming service, a composite signal including audio-video content and haptic content to a remotely-located primary viewing device including a display, a first receiver, and a transmitter, the haptic content being correlated with the audio-video content to enhance the substance of the audio-video content; recognizing and outputting the audio-video content of the streamed composite signal by the primary viewing device; separating the haptic content from the composite signal, and transmitting the haptic content to the secondary device; and streaming, from the primary viewing device, the haptic content correlated to a secondary device including a haptic output device and being configured to process the haptic content to output the haptic content correlated with the audio-video content in a synchronized fashion with the audio-video content being output on the primary viewing device.
38 . The method of claim 37 , wherein the secondary device is a gaming peripheral.
39 . The method of claim 37 , further comprising communicating between the primary viewing device and the secondary device to communicate a playback locator from the primary viewing device to the secondary device, the playback locator determining a temporal reference point representing a temporal playback position in the audio-video content.
40 . The method of claim 37 , further comprising transmitting, to the secondary device, the audio-video content.Join the waitlist — get patent alerts
Track US2020245038A1 — get alerts on status changes and closely related new filings.
We store only your email — no account needed. See our privacy policy.