Detecting Sensor-Based Interactions with Client Device in Conjunction with Presentation of Content

Abstract

A content replacement system sends a content item with one or more content replacement parts to be consumed by a user of a client device. The content item is further associated with an interaction pattern that corresponds to a particular user interaction and a defined action that is to be executed by the client device when the particular user interaction is performed on the client device. While the content replacement part is played on the client device, one or more sensors of the client device acquire data regarding user interactions performed by the user on the client device. The acquired data is processed to determine whether the user has performed a user interaction that matches the interaction pattern. Upon detecting a match, the client device sends a notification to the content replacement system indicating that the match has occurred and further executes the defined action.

What is claimed is: 
     
         1 . A method comprising:
 receiving, by a client device, a content replacement part and an interaction pattern;   determining, by the client device, that a break marker of a content item has been reached;   responsive to detecting that the break marker of the content item has been reached:
 playing, by the client device, the content replacement part, and 
 acquiring, by the client device, signals during playback of the content replacement part, wherein the signals are acquired while the client device is locked; 
   comparing, by the client device, the acquired signals to the interaction pattern; and   responsive to determining, by the client device based on the comparing, that the acquired signals match the interaction pattern, performing, by the client device, a defined action corresponding to the interaction pattern.   
     
     
         2 . The method of  claim 1 , further comprising:
 transmitting, by the client device, a request associated with the defined action.   
     
     
         3 . The method of  claim 2 , wherein the request is to retrieve additional information related to the content replacement part corresponding to the interaction pattern. 
     
     
         4 . The method of  claim 2 , wherein the request is to retrieve additional information related to contacting the user. 
     
     
         5 . The method of  claim 1 , wherein the signals are acquired using one or more sensors of the client device. 
     
     
         6 . The method of  claim 5 , wherein the interaction pattern specifies a signal pattern received by the one or more sensors that corresponds to a user interaction with the client device. 
     
     
         7 . The method of  claim 6 , wherein the user interaction is one or more of: shaking the client device, tapping on the client device, tilting the client device in a particular orientation, drawing a gesture on the client device, holding an object in proximity to a proximity sensor of the client device, providing a noise input to the client device, providing a temperature change to the client device, providing a visual image, and providing a fingerprint. 
     
     
         8 . The method of  claim 6 , wherein the one or more sensors of the client device is one or more of an accelerometer, a gyroscope, a capacitive screen, a resistive screen, a temperature sensor, a microphone, a camera, a button, and a fingerprint sensor. 
     
     
         9 . A non-transitory computer-readable medium comprising memory with instructions encoded thereon, the instructions, when executed by one or more processors, causing the one or more processors to perform operations, the instructions comprising instructions to:
 receive, by a client device, a content replacement part and an interaction pattern;   determine, by the client device, that a break marker of a content item has been reached;   responsive to detecting that the break marker of the content item has been reached:
 play, by the client device, the content replacement part, and 
 acquire, by the client device, signals during playback of the content replacement part, wherein the signals are acquired while the client device is locked; 
   compare, by the client device, the acquired signals to the interaction pattern; and   responsive to determining, by the client device based on the comparing, that the acquired signals match the interaction pattern, perform, by the client device, a defined action corresponding to the interaction pattern.   
     
     
         10 . The non-transitory computer-readable medium of  claim 9 , the instructions further comprising instructions to transmit, by the client device, a request associated with the defined action. 
     
     
         11 . The non-transitory computer-readable medium of  claim 10 , wherein the request is to retrieve additional information related to the content replacement part corresponding to the interaction pattern. 
     
     
         12 . The non-transitory computer-readable medium of  claim 10 , wherein the request is to retrieve additional information related to contacting the user. 
     
     
         13 . The non-transitory computer-readable medium of  claim 9 , wherein the signals are acquired using one or more sensors of the client device. 
     
     
         14 . The non-transitory computer-readable medium of  claim 13 , wherein the interaction pattern specifies a signal pattern received by the one or more sensors that corresponds to a user interaction with the client device. 
     
     
         15 . The non-transitory computer-readable medium of  claim 13 , wherein the user interaction is one or more of: shaking the client device, tapping on the client device, tilting the client device in a particular orientation, drawing a gesture on the client device, holding an object in proximity to a proximity sensor of the client device, providing a noise input to the client device, providing a temperature change to the client device, providing a visual image, and providing a fingerprint. 
     
     
         16 . The non-transitory computer-readable medium of  claim 14 , wherein the one or more sensors of the client device is one or more of an accelerometer, a gyroscope, a capacitive screen, a resistive screen, a temperature sensor, a microphone, a camera, a button, and a fingerprint sensor. 
     
     
         17 . A system comprising:
 memory with instructions encoded thereon; and   one or more processors that, when executing the instructions, are caused to perform operations comprising:
 receiving, by a client device, a content replacement part and an interaction pattern; 
 determining, by the client device, that a break marker of a content item has been reached; 
 responsive to detecting that the break marker of the content item has been reached:
 playing, by the client device, the content replacement part, and 
 acquiring, by the client device, signals during playback of the content replacement part, wherein the signals are acquired while the client device is locked; 
 
 comparing, by the client device, the acquired signals to the interaction pattern; and 
 responsive to determining, by the client device based on the comparing, that the acquired signals match the interaction pattern, performing, by the client device, a defined action corresponding to the interaction pattern. 
   
     
     
         18 . The system of  claim 17 , the operations further comprising:
 transmitting, by the client device, a request associated with the defined action.   
     
     
         19 . The system of  claim 18 , wherein the request is to retrieve additional information related to the content replacement part corresponding to the interaction pattern. 
     
     
         20 . The system of  claim 18 , wherein the request is to retrieve additional information related to contacting the user.