Device for rendering display output associated with printed content overlayed by the device

Abstract

A device for interacting with printed content is disclosed. The device has an optical sensor for imaging an area of a printed substrate containing the printed content when the device is placed over the printed content. A touch-sensitive display screen is also provided for displaying display content. The device further has a processor for determining an identity of the printed substrate from output of the optical sensor and then retrieves display data based on the identity of the printed substrate. The processor also determines the position and orientation of the device relative to the printed substrate. Display content is rendered to the touch-sensitive display screen, with the display content being based on the retrieved display data, the position and orientation of the device relative to the printed substrate. User input is received from the touch-sensitive display screen when the user interacts with the display data.

1 . A device for interacting with printed content, said device comprising:
 an optical sensor for imaging an area of a printed substrate containing the printed content when the device is placed over the printed content;   a touch-sensitive display screen for displaying display content; and   a processor for:
 determining an identity of the printed substrate from output of the optical sensor; 
 determining position and orientation of the device relative to the printed substrate from the output of the optical sensor and; 
 retrieving display data based on the identity of the printed substrate; 
 rendering display content to the touch-sensitive display screen, said display content being based on the retrieved display data, the position and orientation of the device relative to the printed substrate; and 
 receiving from the touch-sensitive display screen user input. 
   
     
     
         2 . The device of  claim 1 , wherein the display contents includes the printed content underneath the device. 
     
     
         3 . The device of  claim 2 , wherein the display content rendered to the touch-sensitive display screen is updated upon determination of changes to the position and orientation of the device relative to the printed substrate. 
     
     
         4 . The device of  claim 1 , wherein the display content includes a hyperlink, and upon receiving a selection of the hyperlink as user input, the processor further retrieves and renders hyperlinked information to the touch-sensitive display screen. 
     
     
         5 . The device of  claim 1  further comprising an audio output system, wherein the processor further retrieves audio data based on the identity of the printed substrate, and controls the audio output system to emit audio based upon the retrieved audio data and the position of the device relative to the printed substrate.