Smart home appliances, operating method of thereof, and voice recognition system using the smart home appliances

Abstract

Provided is a smart home appliance. The smart home appliance includes: a voice input unit collecting a voice; a voice recognition unit recognizing a text corresponding to the voice collected through the voice input unit; a capturing unit collecting an image for detecting a user's visage or face; a memory unit mapping the text recognized by the voice recognition unit and a setting function and storing the mapped information; and a control unit determining whether to perform a voice recognition service on the basis of at least one information of image information collected by the capturing unit and voice information collected by the voice input unit.

1 - 30 . (canceled) 
     
     
         31 . A smart home appliance comprising:
 a voice input unit collecting a voice;   a voice recognition unit recognizing a text corresponding to the voice collected through the voice input unit;   a capturing unit collecting an image for detecting a user's visage;   a memory unit mapping the text recognized by the voice recognition unit and a setting function and storing the mapped information, and storing a keyword information that a user may input to start a voice recognition service; and   a control unit determining whether to perform a voice recognition service on the basis of at least one information of image information collected by the capturing unit and voice information collected by the voice input unit, and   a region recognition unit determining a user's region on the basis of information on the voice collected through the voice input unit; and   an output unit outputting region customized information on the basis of information on a region determined by the region recognition unit and information on the setting function.   wherein the control unit comprises a face detection unit recognizing that a user is in a staring state for voice input when image information on a user's visage is collected for more than a setting time through the capturing unit, and   wherein the control unit determines that a voice recognition service standby state is entered when it is recognized that there is keyword information in a voice through the voice input unit and a user is in the staring state through the face detection unit.   
     
     
         32 . The smart home appliance according to  claim 31 , further comprising:
 a filter unit removing a noise sound from the voice inputted through the voice input unit; and   a memory unit mapping voice information related to an operation of the smart home appliance and voice information unrelated to an operation of the smart home appliance in the voice inputted through the voice input unit and storing the mapped information.   
     
     
         33 . The smart home appliance according to  claim 31 , wherein
 the setting function comprises a plurality of functions divided according to regions; and   the region customized information including one function matching information on the region among the plurality of functions is outputted through the output unit.   
     
     
         34 . The smart home appliance according to  claim 31 , wherein the output unit outputs the region customized information by using a dialect in the region determined by the region recognition unit. 
     
     
         35 . The smart home appliance according to  claim 31 , wherein the output unit outputs a keyword for security setting and the voice input unit sets a reply word corresponding to the keyword. 
     
     
         36 . A smart home appliance comprising:
 a voice input unit collecting a voice;   a voice recognition unit recognizing a text corresponding to the voice collected through the voice input unit;   a capturing unit collecting an image for detecting a user's visage;   a memory unit mapping the text recognized by the voice recognition unit and a setting function and storing the mapped information, and storing a keyword information that a user may input to start a voice recognition service; and   a control unit determining whether to perform a voice recognition service on the basis of at least one information of image information collected by the capturing unit and voice information collected by the voice input unit, and   an emotion recognition unit and an output unit,   wherein the voice recognition unit recognizes a text corresponding to first voice information in the voice collected through the voice input unit, and   the emotion recognition unit extracts a user's emotion on the basis of second voice information in the voice collected through the voice input unit; and   the output unit outputs user customized information on information on a user's emotion determined by the emotion recognition unit and information on the setting function, and   wherein the control unit comprises a face detection unit recognizing that a user is in a staring state for voice input when image information on a user's visage is collected for more than a setting time through the capturing unit, and   wherein the control unit determines that a voice recognition service standby state is entered when it is recognized that there is keyword information in a voice through the voice input unit and a user is in the staring state through the face detection unit.   
     
     
         37 . The smart home appliance according to  claim 36 , wherein
 the first voice information comprises a language element in the collected voice; and   the second voice information comprises a non-language element related to a user's emotion.   
     
     
         38 . The smart home appliance according to  claim 36 , wherein
 the emotion recognition unit comprises a database where information on user's voice characteristics and information on an emotion state are mapped; and   the information on the user's voice characteristics comprises information on a speech spectrum having characteristics for each user's emotion.   
     
     
         39 . The smart home appliance according to  claim 36 , wherein
 the setting function comprises a plurality of functions to be recommended or selected; and   the user customized information including one function matching the information on the user's emotion among the plurality of functions is outputted through the output unit.   
     
     
         40 . A smart home appliance comprising:
 a voice input unit collecting a voice;   a voice recognition unit recognizing a text corresponding to the voice collected through the voice input unit;   a capturing unit collecting an image for detecting a user's visage;   a memory unit mapping the text recognized by the voice recognition unit and a setting function and storing the mapped information, and storing a keyword information that a user may input to start a voice recognition service; and   a control unit determining whether to perform a voice recognition service on the basis of at least one information of image information collected by the capturing unit and voice information collected by the voice input unit, and   a position information recognition unit recognizing position information; and   an output unit outputting the information on the setting function on the basis of position information recognized by the position information recognition unit, and   wherein the control unit comprises a face detection unit recognizing that a user is in a staring state for voice input when image information on a user's visage is collected for more than a setting time through the capturing unit, and   wherein the control unit determines that a voice recognition service standby state is entered when it is recognized that there is keyword information in a voice through the voice input unit and a user is in the staring state through the face detection unit.   
     
     
         41 . The smart home appliance according to  claim 40 , wherein the position information recognition unit comprises:
 a GPS reception unit receiving a position coordinate from a position information transmission unit; and   a first communication module communicably connected to a second communication module equipped in a server.   
     
     
         42 . The smart home appliance according to  claim 40 , wherein the output unit comprises a voice output unit outputting the information on the setting function as a voice, by using the position recognized by the position information recognition unit or a dialect used in a region. 
     
     
         43 . The smart home appliance according to  claim 40 , wherein the output unit outputs information optimized for a region recognized by the position information recognition unit among a plurality of information on the setting function. 
     
     
         44 . The smart home appliance according to  claim 40 , wherein the position information recognized by the position information recognition unit comprises weather information. 
     
     
         45 . An operating method of a smart home appliance comprising:
 a voice input unit collecting a voice;   a voice recognition unit recognizing a text corresponding to the voice collected through the voice input unit;   a capturing unit collecting an image for detecting a user's visage;   a memory unit mapping the text recognized by the voice recognition unit and a setting function and storing the mapped information, and storing a keyword information that a user may input to start a voice recognition service; and   a control unit determining whether to perform a voice recognition service on the basis of at least one information of image information collected by the capturing unit and voice information collected by the voice input unit, and   wherein the control unit comprises a face detection unit recognizing that a user is in a staring state for voice input when image information on a user's visage is collected for more than a setting time through the capturing unit, and   wherein the control unit determines that a voice recognition service standby state is entered when it is recognized that there is keyword information in a voice through the voice input unit and a user is in the staring state through the face detection unit, and   the method comprising:   collecting a voice through a voice input unit;   recognizing whether keyword information is included in the collected voice;   collecting image information on a user's visage through a capturing unit equipped in the smart home appliance; and   entering a standby state of a voice recognition service on the basis of the image information on the user's visage.   
     
     
         46 . The method according to  claim 45 , further comprising performing a security setting,
 wherein the performing of the security setting comprises:   outputting a predetermined key word; and   inputting a reply word in response to the outputted key word.   
     
     
         47 . The method according to  claim 45 , further comprising:
 extracting a user's emotion state on the basis of information on the collected voice; and   recommending an operation mode on the basis of information on the user's emotion state.   
     
     
         48 . The method according to  claim 45 , further comprising:
 recognizing an installation position of the smart home appliance through a position information recognition unit; and   driving the smart home appliance on the basis of information on the installation position.   
     
     
         49 . The method according to  claim 48 , wherein the recognizing of the installation position of the smart home appliance comprises receiving GPS coordinate information from a GPS satellite or a communication base station. 
     
     
         50 . The method according to  claim 48 , wherein the recognizing of the installation position of the smart home appliance comprises checking a communication address as a first communication module equipped in the smart home appliance is connected to a second communication module equipped in a server.