Method of identification based on smart glasses

Abstract

The present invention relates to the field of smart identification, in particular a method of identification based on smart glasses, comprising the following steps: obtains real-time data transmitted from an inertial sensor on the glasses and determines the head position; obtains reading states and contents; reminder for reading. The beneficial effects of the present invention are as below: it detects and identifies users' cognitive state, and provides users with corresponding cognitive assistant measures, to further improve the reading efficiency.

1 . A method of identification based on smart glasses, characterized in that they comprise the following steps: obtain real-time data transmitted from an inertial sensor on the glasses and determine the head position; obtain the reading states and contents; reminder for reading. 
     
     
         2 . The method of identification based on smart glasses as claimed in  claim 1 , characterized in that further includes: read data from an inertial sensor on the glasses; determine people's reading states by judging various head positions; when the head position fits the range of head position during reading and people are not moving, it is deemed as a reading state, and when the head position does not fit the range of head position or people are moving, it is deemed as a not-reading state. 
     
     
         3 . The method of identification based on smart glasses as claimed in  claim 1 , characterized in that, in Step, by converting images transmitted from an eye camera on the glasses into a gray value, it sets a threshold value so as to obtain the coordinates of the eyeballs; by judging the coordinates of the eyeballs as time changes, it obtains people's various reading states; and by setting coordinates of images from a scene camera on the glasses and using a calibrating method, keeps the coordinates of images from the scene camera in one-to-one correspondence with the coordinates of the eyeballs, so as to obtain contents that users are reading now. 
     
     
         4 . The method of identification based on smart glasses as claimed in  claim 1 , characterized in that, in Step, it provides various reading aids for readers according to reading states. 
     
     
         5 . The method of identification based on smart glasses as claimed in  claim 3 , characterized in that, in Step, to obtain various reading states, it further includes the following steps: turn on an IR emitter and shine it on the eyes, turn on the eye camera to capture eye position images, and turn on the scene camera to capture images that the eyes have seen; by converting images transmitted from an eye camera into a gray value and reversing it, set a threshold value of the gray value so as to obtain the positions of the pupils, and set the coordinates of the pupil centers; determine people's reading states via eyeball movements. 
     
     
         6 . The method of identification based on smart glasses as claimed in  claim 1 , characterized in that the reading states include normal reading state, thinking state, glancing state, reviewing state and distracted state; the normal reading state is that the eyeball movement speed remains in a certain range; the thinking state is that the eyeball movement speed remains in a certain range and the time exceeds a threshold value; the glancing state is that the eyeball movement speed exceeds a threshold value; the reviewing state is that the eyeballs move in an opposite direction; and the distracted state is that the eyeball movement speed is lower than a threshold value for more than a period of time. 
     
     
         7 . The method of identification based on smart glasses as claimed in  claim 1 , characterized in that, in Step, it divides images obtained from the scene camera into nine squares and sets coordinates, and uses a calibrating method to keep the coordinates of scene images in one-to-one correspondence with the coordinates of the eyeballs; by obtaining the reading states, it conducts reading instruction. 
     
     
         8 . The method of identification based on smart glasses as claimed in  claim 7 , characterized in that, by multiplying the eyeball coordinate matrix by the matrix calculated based on calibration, it works out coordinates of scene images. 
     
     
         9 . The method of identification based on smart glasses as claimed in  claim 6 , characterized in that, when the reading state stays in a thinking state, it will automatically search the contents that users are reading and then display the search results; when users are in a distracted state, it will automatically make a sound as reminder.