Scene-aware selection of filters and effects for visual digital media content

Abstract

Provided are mechanisms and processes for scene-aware selection of filters and effects for visual digital media content. In one example, a digital media item is analyzed with a processor to identify one or more characteristics associated with the digital media item, where the characteristics include a physical object represented in the digital media item. Based on the identified characteristics, a digital media modification is selected from a plurality of digital media modifications for application to the digital media item. The digital media modification may then be provided for presentation in a user interface for selection by a user.

What is claimed is: 
     
         1 . A method comprising:
 analyzing a visual digital media item with a processor to identify one or more characteristics associated with the visual digital media item, wherein the characteristics include a physical object represented in the visual digital media item;   based on the identified characteristics, selecting a visual digital media modification from a plurality of visual digital media modifications for application to the visual digital media item; and   providing the selected visual digital media modification for presentation in a user interface for selection by a user.   
     
     
         2 . The method recited in  claim 1 , wherein the visual digital media item is a video stream. 
     
     
         3 . The method recited in  claim 2 , the raw video stream is a live camera view captured via a camera. 
     
     
         4 . The method recited in  claim 1 , wherein the visual digital media item includes a surround view of the object, wherein the surround view of the object includes spatial information, scale information, or a plurality of different viewpoint images of the object. 
     
     
         5 . The method recited in  claim 1 , wherein the characteristics include structure information indicating a physical context in which the physical object is positioned. 
     
     
         6 . The method recited in  claim 1 , wherein the characteristics include pose information indicating an attitude or position associated with the physical object. 
     
     
         7 . The method recited in  claim 1 , wherein the characteristics include movement information indicating a degree of velocity or acceleration of the object. 
     
     
         8 . The method recited in  claim 1 , wherein the visual digital media modification includes a virtual object positioned within the visual digital media item. 
     
     
         9 . The method recited in  claim 1 , wherein the visual digital media modification includes an artificial light source that appears to be blocked by the physical object in the visual digital media item. 
     
     
         10 . The method recited in  claim 1 , wherein the visual digital media modification includes motion blur indicating movement associated with the object or a change to the color of a portion of the visual digital media item. 
     
     
         11 . The method recited in  claim 1 , wherein the object is a human being, and wherein the visual digital media modification includes a text bubble appearing in proximity to a face. 
     
     
         12 . The method recited in  claim 1 , the method further comprising:
 receiving the visual digital media item at a server via a network from a client device, wherein providing the visual digital media modification for presentation in a user interface includes transmitting a message via the network to the client device.   
     
     
         13 . The method recited in  claim 1 , wherein analyzing the visual digital media item comprises transmitting the visual digital media item to a server via a network from a client device and receiving a response message at the client device, the response message identifying the one or more characteristics. 
     
     
         14 . The method recited in  claim 1 , wherein the visual digital media modification is automatically applied to the visual digital media item when it is determined that the visual digital media modification meets one or more designated criteria. 
     
     
         15 . The method recited in  claim 1 , wherein the one or more designated criteria includes determining that the object is a person raising a hand. 
     
     
         16 . A computing device comprising:
 a camera configured to capture a visual digital media item;   a processor configured to identify one or more characteristics associated with the visual digital media item, wherein the characteristics include a physical object represented in the visual digital media item and to select, based on the identified characteristics, visual digital media modification from a plurality of visual digital media modifications for application to the visual digital media item; and   a display screen configured to present a user interface providing the selected visual digital media modification for user selection.   
     
     
         17 . The computing device recited in  claim 16 , wherein the visual digital media item includes a surround view of the object, wherein the surround view of the object includes spatial information, scale information, and a plurality of different viewpoint images of the object. 
     
     
         18 . The computing device recited in  claim 16 , wherein identifying the object comprises transmitting the visual digital media item to a server via a network from the computing device and receiving a response message at the computing device, the response message identifying the one or more characteristics. 
     
     
         19 . The computing device recited in  claim 16 , wherein the characteristics include information selected from the group consisting of: structure information indicating a physical context in which the physical object is positioned, pose information indicating an attitude or position associated with the physical object, and movement information indicating a degree of velocity or acceleration of the object. 
     
     
         20 . One or more non-transitory computer readable media having instructions stored thereon for performing a method, the method comprising:
 analyzing a visual digital media item with a processor to identify one or more characteristics associated with the visual digital media item, wherein the characteristics include a physical object represented in the visual digital media item;   based on the identified characteristics, selecting a visual digital media modification from a plurality of visual digital media modifications for application to the visual digital media item; and   providing the visual digital media modification for presentation in a user interface for selection by a user.