Real-time content filtering and replacement

Abstract

Methods, systems, and apparatus include computer programs encoded on a computer-readable storage medium, including a method for augmenting video streams. A video stream is received. Prior to presentation on a device, the video stream is processed to identify objects to be replaced in the video stream. A profile associated with a user who will view the video stream is identified. Preferences of the user are determined regarding subject matter embodied in objects that preferably be included or excluded from video. A determination is made whether the video stream includes first objects that embody subject matter that preferably should be excluded from presentation. If the user has indicated a replacement preference, replacement content is inserted in the video stream associated with the first objects. If the user has indicated an alteration preference for altering content, first objects are altered in accordance with the alteration preference. The updated video stream is provided.

What is claimed is: 
     
         1 . A computer-implemented method comprising:
 receiving a video stream; and   prior to presenting the video stream on a device to an end user, processing the video stream and identifying one or more objects to be replaced in the video stream including:
 identifying a profile associated with the end user that is to view the video stream; 
 determining one or more preferences of the end user regarding subject matter embodied in objects that preferably be included or excluded from video presented to the end user; 
 determining, based on the one or more preferences, whether the video stream includes first objects that embody subject matter that preferably should be excluded from presentation to the end user; 
 determining when the end user has indicated a replacement preference for replacement content and when so, inserting the replacement content at a location in the video stream associated with the first objects producing an updated video stream; 
 determining when the end user has indicated an alteration preference for altering content and when so, altering the first objects in accordance with the alteration preference producing the updated video stream; and 
 providing the updated video stream to the end user. 
   
     
     
         2 . The method of  claim 1  wherein determining whether the video stream includes the first objects includes evaluating metadata for the video to locate objects of interest. 
     
     
         3 . The method of  claim 1  wherein determining whether the video stream includes the first objects includes buffering the video stream, evaluating individual frames of the video stream included in the buffer, locating the first objects, and replacing or altering the first objects in accordance with the replacement and alteration preferences. 
     
     
         4 . The method of  claim 3  wherein the first objects include ad slots and wherein evaluating individual frames includes locating ad slots in individual frames and replacing or altering content included in a located ad slot based on the replacement and alteration preferences. 
     
     
         5 . The method of  claim 1  wherein the first objects are related to a first subject matter and wherein determining whether the video stream includes the first objects includes evaluating individual frames of the video stream, locating features in a respective video frame, evaluating the features to determine when the features are associated with the subject matter and altering or replacing features in accordance with the alteration and replacement preferences. 
     
     
         6 . The method of  claim 1  wherein determining whether the video stream includes first objects includes determining whether a frame of the video includes a product, and when so, replacing or altering a portion of the frame to exclude or alter presentation of the product based on the alteration and replacement preferences. 
     
     
         7 . The method of  claim 1  wherein determining whether the video stream includes first objects includes determining whether each frame in the video stream includes an advertisement and when so, replacing or altering a portion of the frame that includes the advertisement in accordance with the alteration and replacement preferences. 
     
     
         8 - 21 . (canceled) 
     
     
         22 . A system comprising:
 one or more processors; and   one or more memory devices including instructions that, when executed, cause the one or more processors to perform operations comprising:
 receiving a video stream; and 
 prior to presenting the video stream on a device to an end user, processing the video stream and identifying one or more objects to be replaced in the video stream including:
 identifying a profile associated with the end user that is to view the video stream; 
 determining one or more preferences of the end user regarding subject matter embodied in objects that preferably be included or excluded from video presented to the end user; 
 determining, based on the one or more preferences, whether the video stream includes first objects that embody subject matter that preferably should be excluded from presentation to the end user; 
 determining when the end user has indicated a replacement preference for replacement content and when so, inserting the replacement content at a location in the video stream associated with the first objects producing an updated video stream; 
 determining when the end user has indicated an alteration preference for altering content and when so, altering the first objects in accordance with the alteration preference producing the updated video stream; and 
 providing the updated video stream to the end user. 
 
   
     
     
         23 . The system of  claim 22  wherein determining whether the video stream includes the first objects includes evaluating metadata for the video to locate objects of interest. 
     
     
         24 . The system of  claim 22  wherein determining whether the video stream includes the first objects includes buffering the video stream, evaluating individual frames of the video stream included in the buffer, locating the first objects, and replacing or altering the first objects in accordance with the replacement and alteration preferences. 
     
     
         25 . The system of  claim 24  wherein the first objects include ad slots and wherein evaluating individual frames includes locating ad slots in individual frames and replacing or altering content included in a located ad slot based on the replacement and alteration preferences. 
     
     
         26 . The system of  claim 22  wherein the first objects are related to a first subject matter and wherein determining whether the video stream includes the first objects includes evaluating individual frames of the video stream, locating features in a respective video frame, evaluating the features to determine when the features are associated with the subject matter and altering or replacing features in accordance with the alteration and replacement preferences. 
     
     
         27 . The system of  claim 22  wherein determining whether the video stream includes first objects includes determining whether a frame of the video includes a product, and when so, replacing or altering a portion of the frame to exclude or alter presentation of the product based on the alteration and replacement preferences. 
     
     
         28 . The system of  claim 22  wherein determining whether the video stream includes first objects includes determining whether each frame in the video stream includes an advertisement and when so, replacing or altering a portion of the frame that includes the advertisement in accordance with the alteration and replacement preferences. 
     
     
         29 . A non-transitory computer-readable medium storing instructions, that when executed, cause one or more processors to perform operations comprising:
 receiving a video stream; and   prior to presenting the video stream on a device to an end user, processing the video stream and identifying one or more objects to be replaced in the video stream including:
 identifying a profile associated with the end user that is to view the video stream; 
 determining one or more preferences of the end user regarding subject matter embodied in objects that preferably be included or excluded from video presented to the end user; 
 determining, based on the one or more preferences, whether the video stream includes first objects that embody subject matter that preferably should be excluded from presentation to the end user; 
 determining when the end user has indicated a replacement preference for replacement content and when so, inserting the replacement content at a location in the video stream associated with the first objects producing an updated video stream; 
 determining when the end user has indicated an alteration preference for altering content and when so, altering the first objects in accordance with the alteration preference producing the updated video stream; and 
 providing the updated video stream to the end user. 
   
     
     
         30 . The non-transitory computer-readable medium of  claim 29  wherein determining whether the video stream includes the first objects includes evaluating metadata for the video to locate objects of interest. 
     
     
         31 . The non-transitory computer-readable medium of  claim 29  wherein determining whether the video stream includes the first objects includes buffering the video stream, evaluating individual frames of the video stream included in the buffer, locating the first objects, and replacing or altering the first objects in accordance with the replacement and alteration preferences. 
     
     
         32 . The non-transitory computer-readable medium of  claim 31  wherein the first objects include ad slots and wherein evaluating individual frames includes locating ad slots in individual frames and replacing or altering content included in a located ad slot based on the replacement and alteration preferences. 
     
     
         33 . The non-transitory computer-readable medium of  claim 29  wherein the first objects are related to a first subject matter and wherein determining whether the video stream includes the first objects includes evaluating individual frames of the video stream, locating features in a respective video frame, evaluating the features to determine when the features are associated with the subject matter and altering or replacing features in accordance with the alteration and replacement preferences. 
     
     
         34 . The non-transitory computer-readable medium of  claim 29  wherein determining whether the video stream includes first objects includes determining whether a frame of the video includes a product, and when so, replacing or altering a portion of the frame to exclude or alter presentation of the product based on the alteration and replacement preferences. 
     
     
         35 . The non-transitory computer-readable medium of  claim 29  wherein determining whether the video stream includes first objects includes determining whether each frame in the video stream includes an advertisement and when so, replacing or altering a portion of the frame that includes the advertisement in accordance with the alteration and replacement preferences.