Touch Display Device with Tactile Feedback

Abstract

An apparatus comprising: an image processor configured to determine at least one image parameter with respect to at least one image displayed on at least one display; a touch controller configured to determine at least one touch parameter with respect to the at least one display configured to display the at least one image; and a tactile effect generator configured to generate at least one tactile signal based on the at least one touch parameter and the at least one image parameter.

1 - 20 . (canceled) 
     
     
         21 . An apparatus comprising:
 at least one processor, and   at least one non-transitory memory including computer program code for one or more programs,   the at least one non-transitory memory and the computer program code configured to, with the at least one processor, cause the apparatus at least to:
 determine one or more image parameters with respect to at least one image displayed on at least one display; 
 determine at least one touch parameter when at least one touch input is detected with respect to the at least one display, wherein the at least one detected touch input at least partially interferes with the at least one image; 
 generate, in response to the at least one detected touch input, at least one information overlay based, at least partially, on the one or more image parameters, wherein the at least one information overlay is configured to partially overlay the at least one image; 
 generate at least one tactile effect based, at least partially, on the one or more image parameters when the at least one touch input is detected; and 
 generate at least one audio signal based, at least partially, on the one or more image parameters when the at least one touch input is detected. 
   
     
     
         22 . The apparatus of  claim 21 , wherein the at least one non-transitory memory and the computer program code are configured to, with the at least one processor, cause the apparatus to:
 determine, based on the at least one image parameter, at least one of:
 at least one texture associated with at least part of the at least one image, wherein at least one of the at least one tactile effect, the at least one audio signal, or the at least one information overlay is based, at least partially, on the at least one texture; 
 at least one directionality associated with at least part of the at least one image, wherein at least one of the at least one tactile effect, the at least one audio signal, or the at least one information overlay is based, at least partially, on the at least one directionality; or 
 at least one force sensitivity associated with at least part of the at least one image, wherein at least one of the at least one tactile effect, the at least one audio signal, or the at least one information overlay is based, at least partially, on the at least one force sensitivity. 
   
     
     
         23 . The apparatus of  claim 21 , wherein the at least one image comprises a live camera image, wherein the at least one information overlay is configured to convey information based, at least partially, on the one or more image parameters, wherein the information comprises at least one of:
 an identification associated with at least part of the at least one image,   a plane associated with at least part of the at least one image,   a polygon associated with at least part of the at least one image,   a depth associated with at least part of the at least one image,   a rating associated with at least part of the at least one image,   a location associated with at least part of the at least one image, or   a distance associated with at least part of the at least one image.   
     
     
         24 . The apparatus of  claim 21 , wherein the at least one image parameter comprises at least one of:
 at least one polygon identifier,   at least one plane identifier,   at least one edge identifier,   at least one image luma value,   at least one image chroma value,   at least one image depth,   at least one image plane,   at least one image polygon,   at least one image line, or   at least one image edge.   
     
     
         25 . The apparatus of  claim 21 , wherein the at least one touch parameter comprises at least one of:
 at least one touch location,   at least one touch speed,   at least one touch direction,   at least one touch velocity,   at least one touch acceleration,   at least one touch force,   at least one touch depth, or   at least one touch pressure.   
     
     
         26 . The apparatus of  claim 21 , wherein the at least one tactile effect is configured for output at a location proximate a location of the at least one detected touch input. 
     
     
         27 . The apparatus of  claim 21 , wherein the at least one audio signal is configured for output at a location proximate a location of the at least one detected touch input. 
     
     
         28 . The apparatus of  claim 21 , wherein the at least one tactile effect and the at least one audio signal are generated based on at least one same image parameter of the one or more image parameters. 
     
     
         29 . The apparatus of  claim 21 , wherein the at least one tactile effect and the at least one audio signal are generated based on different ones of the one or more image parameters. 
     
     
         30 . The apparatus of  claim 21 , wherein generating the at least one tactile effect comprises the at least one non-transitory memory and the computer program code are configured to, with the at least one processor, cause the apparatus to:
 generate the at least one tactile effect based, at least partially, on the at least one touch parameter.   
     
     
         31 . The apparatus of  claim 21 , wherein the at least one display comprises a tactile audio display component actuated with at least one actuator. 
     
     
         32 . The apparatus of  claim 21 , wherein determining the at least one image parameter comprises the at least one non-transitory memory and the computer program code are configured to, with the at least one processor, cause the apparatus to:
 segment the at least one image into a plurality of regions;   group each of the plurality of regions into groups of similar regions; and   generate a depth map based on the groups of similar regions.   
     
     
         33 . The apparatus of  claim 21 , wherein the at least one non-transitory memory and the computer program code are configured to, with the at least one processor, cause the apparatus to:
 determine the at least one touch parameter based on at least one bias associated with the at least one image, wherein the at least one bias comprises at least one of:
 a pressure bias dependent on at least one material characteristic of at least one polygon in the at least one image; 
 a depth bias dependent on at least one depth map associated with the at least one image; 
 a force bias dependent on a force parameter provided with a touch controller; or 
 a distance bias dependent on the at least one depth map associated with the at least one image. 
   
     
     
         34 . The apparatus of  claim 21 , wherein the at least one generated audio signal is configured to be audibly output as a loop for a duration of detection of the at least one touch parameter. 
     
     
         35 . The apparatus of  claim 21 , wherein the at least one image is received from one or more cameras associated with the at least one display. 
     
     
         36 . A method comprising:
 determining one or more image parameters with respect to at least one image displayed on at least one display;   determining at least one touch parameter when at least one touch input is detected with respect to the at least one display, wherein the at least one detected touch input at least partially interferes with the at least one image;   generating, in response to the at least one detected touch input, at least one information overlay based, at least partially, on the one or more image parameters, wherein the at least one information overlay is configured to partially overlay the at least one image;   generating at least one tactile effect based, at least partially, on the one or more image parameters when the at least one touch input is detected; and   generating at least one audio signal based, at least partially, on the one or more image parameters when the at least one touch input is detected.   
     
     
         37 . The method of  claim 36 , further comprising determining, based on the at least one image parameter, at least one of:
 at least one texture associated with at least part of the at least one image, wherein at least one of the at least one tactile effect, the at least one audio signal, or the at least one information overlay is based, at least partially, on the at least one texture;   at least one directionality associated with at least part of the at least one image, wherein at least one of the at least one tactile effect, the at least one audio signal, or the at least one information overlay is based, at least partially, on the at least one directionality; or   at least one force sensitivity associated with at least part of the at least one image, wherein at least one of the at least one tactile effect, the at least one audio signal, or the at least one information overlay is based, at least partially, on the at least one force sensitivity.   
     
     
         38 . The method of  claim 36 , wherein the at least one image comprises a live camera image, wherein the at least one information overlay is configured to convey information based, at least partially, on the one or more image parameters, wherein the information comprises at least one of:
 an identification associated with at least part of the at least one image,   a plane associated with at least part of the at least one image,   a polygon associated with at least part of the at least one image,   a depth associated with at least part of the at least one image,   a rating associated with at least part of the at least one image,   a location associated with at least part of the at least one image, or   a distance associated with at least part of the at least one image.   
     
     
         39 . The method of  claim 36 , wherein the at least one image parameter comprises at least one of:
 at least one polygon identifier,   at least one plane identifier,   at least one edge identifier,   at least one image luma value,   at least one image chroma value,   at least one image depth,   at least one image plane,   at least one image polygon,   at least one image line, or   at least one image edge.   
     
     
         40 . A non-transitory computer-readable medium comprising program instructions stored thereon which, when executed with at least one processor, cause the at least one processor to:
 determine one or more image parameters with respect to at least one image displayed on at least one display;   determine at least one touch parameter when at least one touch input is detected with respect to the at least one display, wherein the at least one detected touch input at least partially interferes with the at least one image;   generate, in response to the at least one detected touch input, at least one information overlay based, at least partially, on the one or more image parameters, wherein the at least one information overlay is configured to partially overlay the at least one image;   generate at least one tactile effect based, at least partially, on the one or more image parameters when the at least one touch input is detected; and   generate at least one audio signal based, at least partially, on the one or more image parameters when the at least one touch input is detected.