Home appliance and method for controlling thereof

Abstract

A home appliance is provided. The home appliance includes a sensor, a microphone, a speaker, and a processor. The processor is configured to, based on one of a first event wherein a user action is detected through the sensor or a second event wherein a trigger command for initiating a voice recognition mode is input through the microphone occurring, operate in the voice recognition mode, and control the speaker to output an audio signal corresponding to the event occurred, and the audio signal is an audio signal set differently for each of the first event and the second event.

What is claimed is: 
     
         1 . A home appliance comprising:
 a main body including a door; and   at least one processor configured to perform processing to: 
 detect a user action related to the door, and 
 based on detecting the user action, initiate a voice recognition mode of the home appliance. 
   
     
     
         2 . The home appliance as in  claim 1 , wherein the user action comprises at least one of an opening of the door or a closing of the door. 
     
     
         3 . The home appliance as in  claim 1 , wherein the at least one processor is further configured to perform processing to:
 based on detecting an opening of the door, initiate the voice recognition mode, and   based on detecting a closing of the door while the voice recognition mode is initiated, convert from the voice recognition mode to a standby state of the home appliance.   
     
     
         4 . The home appliance as in  claim 3 , further comprising:
 a microphone, and   wherein the at least one processor is further configured to perform processing to: 
 based on detecting the closing of the door after a user utterance is detected through the microphone while the voice recognition mode is initiated, maintain the voice recognition mode. 
   
     
     
         5 . The home appliance as in  claim 4 , wherein the at least one processor is further configured to perform processing to, based on detecting the closing of the door after the user utterance is detected, maintain the voice recognition mode and output a signal requesting an additional user utterance. 
     
     
         6 . The home appliance as in  claim 1 , wherein the at least one processor is further configured to perform processing to, based on a predetermined time being reached without a user utterance after initiating the voice recognition mode, convert from the voice recognition mode to a standby state of the home appliance. 
     
     
         7 . The home appliance as in  claim 1 , further comprising:
 a microphone, and   wherein the at least one processor is further configured to perform processing to: 
 receive a user utterance through the microphone while the voice recognition mode is initiated, 
 based on a control command or an inquiry being included in the user utterance, maintain the voice recognition mode, and 
 based on the control command or the inquiry being not included in the user utterance, convert from the voice recognition mode to a standby state of the home appliance. 
   
     
     
         8 . The home appliance as in  claim 1 , further comprising:
 a speaker,   wherein the at least one processor is further configured to perform processing to: 
 based on the voice recognition mode being initiated, output an audio signal requesting an user utterance related to an operation of the home appliance through the speaker. 
   
     
     
         9 . The home appliance as in  claim 8 , further comprising:
 a microphone,   wherein the at least one processor is further configured to perform processing to: 
 receive a user utterance through the microphone while the voice recognition mode is initiated, 
 obtain a result of voice recognition regarding the user utterance, and 
 perform an operation of the home appliance based on the result of voice recognition. 
   
     
     
         10 . The home appliance as in  claim 9 , further comprising:
 a communication device,   wherein the at least one processor is further configured to perform processing to: 
 control the communication device to transmit voice information regarding the user utterance to an external server, and 
 receive, through the communication device, the result of voice recognition regarding the voice information from the external server. 
   
     
     
         11 . A method of a home appliance comprising:
 detecting a user action related to a door included in the home appliance; and   based on detecting the user action, initiating a voice recognition mode of the home appliance.   
     
     
         12 . The method as in  claim 11 , wherein the user action comprises at least one of an opening of the door or a closing of the door. 
     
     
         13 . The method as in  claim 11 , wherein
 the initiating comprises, based on detecting an opening of the door, initiating the voice recognition mode, and   the method further comprising: 
 based on detecting a closing of the door while the voice recognition mode is initiated, converting from the voice recognition mode to a standby state of the home appliance. 
   
     
     
         14 . The method as in  claim 13 , further comprising:
 based on detecting the closing of the door after a user utterance is detected while the voice recognition mode is initiated, maintaining the voice recognition mode.   
     
     
         15 . The method as in  claim 14 , wherein the maintaining comprises, based on detecting the closing of the door after the user utterance is detected, maintaining the voice recognition mode and outputting a signal requesting an additional user utterance. 
     
     
         16 . The method as in  claim 11 , further comprising:
 based on a predetermined time being reached without a user utterance after initiating the voice recognition mode, converting from the voice recognition mode to a standby state of the home appliance.   
     
     
         17 . The method as in  claim 11 , further comprising:
 receiving a user utterance while the voice recognition mode is initiated;   based on a control command or an inquiry being included in the user utterance, maintaining the voice recognition mode, and   based on the control command or the inquiry being not included in the user utterance, converting from the voice recognition mode to a standby state of the home appliance.   
     
     
         18 . The method as in  claim 11 , further comprising:
 based on the voice recognition mode being initiated, outputting an audio signal requesting an user utterance related to an operation of the home appliance.   
     
     
         19 . The method as in  claim 18 , further comprising:
 receiving a user utterance while the voice recognition mode is initiated;   obtaining a result of voice recognition regarding the user utterance; and   performing an operation of the home appliance based on the result of voice recognition.   
     
     
         20 . The method as in  claim 19 , the obtaining comprises:
 transmitting voice information regarding the user utterance to an external server; and   receiving the result of voice recognition regarding the voice information from the external server.