Augmented reality system and method

Abstract

An augmented reality system is described for providing a user with a facility to try out virtual clothing or accessories. The system comprises a database storing data defining at least one augmented reality object and a set of associated audio clips, each audio clip in the set corresponding to a different characteristic, trait or parameter of an associated augmented reality object, a camera for imaging a scene containing the user, logic for detecting the motion of a feature within the scene, a display device for displaying an image of the scene in which an augmented reality object is superimposed, an audio processing module for selecting an audio clip associated with the superimposed augmented reality object, and an audio device for playing a sound associated with the augmented reality object, wherein the sound is varied in accordance with the detected motion.

1 . An augmented reality system for providing a user with a facility to try out virtual clothing or accessories, the system comprising:
 a database storing data defining at least one augmented reality object and a set of associated audio clips, each audio clip in the set corresponding to a different characteristic, trait or parameter of an associated augmented reality object;   a camera operable to image a scene containing the user;   a motion detector module operable to detect the motion of a feature within the scene;   a display device operable to display an image of the scene in which an augmented reality object is superimposed;   an audio processing module operable to select at least one audio clip associated with the superimposed augmented reality object; and   an audio device operable to output a sound associated with the augmented reality object, wherein the sound is varied in accordance with the detected motion.   
     
     
         2 . An augmented reality system according to  claim 1 , further comprising a user input receiver operable to receive user input selection of an augmented reality object to be superimposed, and at least one associated characteristic, trait or parameter of the augmented reality object. 
     
     
         3 . An augmented reality system according to  claim 2 , wherein the audio processing module is operable to select at least one audio clip in dependence on the user input selection. 
     
     
         4 . An augmented reality system according to  claim 3 , wherein the audio processing module is further operable to vary the selected at least one audio clip in accordance with the detected motion. 
     
     
         5 . An augmented reality system according to  claim 1 , wherein each audio clip in the set corresponds to a different parameter of detected motion. 
     
     
         6 . An augmented reality system according to  claim 5 , wherein the audio processing module is operable to select at least one audio clip in dependence on a correspondence between a detected velocity of the movement of the feature and a velocity range associated with each object in the database. 
     
     
         7 . An augmented reality system according to  claim 5 , wherein the audio processing module is operable to vary the sound by selecting different audio clips in dependence on a detected velocity of the movement. 
     
     
         8 . An augmented reality system according to  claim 6 , wherein the different audio clips comprise a first audio clip and a second audio clip, and wherein the first audio clip is played when the detected velocity is between a first threshold value and a second threshold value, and the second audio clip is played when the detected velocity is above the second threshold value. 
     
     
         9 . An augmented reality system according to  claim 8 , wherein the second audio clip is longer than the first audio clip. 
     
     
         10 . An augmented reality system according to  claim 7 , wherein a plurality of audio clips associated with the object can be played concurrently. 
     
     
         11 . An augmented reality system according to  claim 10 , wherein when one of the audio clips associated with the combination of the augmented reality object and the feature starts playing, a first time delay elapses before another audio clip associated with that combination of the augmented reality object and the feature is permitted to start playing. 
     
     
         12 . An augmented reality system according to  claim 11 , wherein the first time delay is varied using a random number each time it elapses. 
     
     
         13 . An augmented reality system according to  claim 8 , wherein one or more of the threshold values are varied using a random number. 
     
     
         14 . An augmented reality system according to  claim 7 , wherein the first audio clip is played if the detected velocity is between the first threshold and the second threshold for at least a first time period. 
     
     
         15 . An augmented reality system according to  claim 1 , wherein the feature is a trackable marker moveable by the user, and the augmented reality object is superimposed at the position of the trackable marker. 
     
     
         16 . An augmented reality system according to  claim 15 , wherein the sound is played at a volume which is varied in dependence on a distance between the trackable marker and the user's head. 
     
     
         17 . An augmented reality system according to  claim 1 , wherein the feature is one or a group of node points within a skeleton model representing at least part of the user's body, and wherein the augmented reality object is an item of clothing superimposed over the user's body. 
     
     
         18 . An augmented reality system according to  claim 17 , wherein the detected motion comprises one or both of the rotational and linear velocity of one node point with respect to another node point. 
     
     
         19 . An augmented reality system according to  claim 17 , wherein the sound is varied in dependence on the proximity of the node point feature to another node point, or to a vector joining two node points. 
     
     
         20 . An augmented reality system according to  claim 17 , wherein a first vector joins a first node and a second node within the skeleton model and a second vector joins the second node and a third node within the skeleton model, and wherein the detected movement comprises a rotational velocity defined by a rate of change of the angle between the first and second vectors. 
     
     
         21 . An augmented reality system according to  claim 20 , wherein the volume of the sound is higher when the angle between the first and second vectors is less than a predetermined value than when the angle between the first and second vectors is greater than the predetermined value. 
     
     
         22 . An augmented reality system according to  claim 18 , wherein a first vector joins a first node and a second node within the skeleton model and a second vector joins the second node and a third node within the skeleton model, and wherein the sound is played when both the angle between the first and second vectors is greater than a predetermined value and the detected movement is above a predetermined amount. 
     
     
         23 . An augmented reality system according to  claim 1 , wherein the sound is played to the user with a time offset at one ear compared with the other ear to simulate the origin of the sound being at the object to which the sound corresponds. 
     
     
         24 . A method of providing a user with a facility to try out virtual clothing or accessories, the method comprising:
 storing data defining at least one augmented reality object and a set of associated audio clips, each audio clip in the set corresponding to a different characteristic, trait or parameter of an associated augmented reality object;   imaging a scene containing the user;   detecting the motion of a feature within the scene;   displaying an image of the scene in which an augmented reality object is superimposed;   selecting at least one audio clip associated with the superimposed augmented reality object; and   outputting a sound associated with the augmented reality object, wherein the sound is varied in accordance with the detected motion.   
     
     
         25 . A non-transitory computer-readable medium comprising computer-executable instructions, that when executed perform a method of:
 storing data defining at least one augmented reality object and a set of associated audio clips, each audio clip in the set corresponding to a different characteristic, trait or parameter of an associated augmented reality object;   imaging a scene containing the user;   detecting the motion of a feature within the scene;   displaying an image of the scene in which an augmented reality object is superimposed;   selecting at least one audio clip associated with the superimposed augmented reality object; and   outputting a sound associated with the augmented reality object, wherein the sound is varied in accordance with the detected motion.