Computer-based system for feeding a baby and methods of use thereof

Abstract

A system includes a memory, an optical subsystem, an audio system, a plurality of sensors outputting sensor data, a communication circuitry and a processor. The processor is configured to input to a baby-specific behavioral state detection machine learning model, image data, audio signal data, sensor data, and baby-specific personal data associated with a baby, to receive an output from the baby-specific behavioral state detection machine learning model that the baby is hungry, to transmit instructions that causes a foodstuff preparation controller to prepare at least one foodstuff in preparation to feed the at least one baby based on the determination that the at least one baby is hungry.

1 . A system, comprising:
 a non-volatile memory;   at least one electronic resource comprising at least one database;   wherein the at least one database comprises:
 (i) baby-specific stimuli data for a plurality of baby-specific stimuli provided to a plurality of babies, 
 (ii) baby-specific response data for a plurality of baby-specific responses acquired in response to the plurality of baby-specific stimuli provided to the plurality of babies, and 
 (iii) baby-specific personal data for each baby in the plurality of babies; 
   an imaging device configured to acquire image data of an image of at least one baby from the plurality of babies;   a microphone configured to receive audio signal data from the at least one baby;   a plurality of sensors outputting sensor data;   a communication circuitry configured to communicate over a communication network with at least one communication device of at least one user associated with the at least one baby;   a foodstuff preparation controller; and   at least one processor configured to execute code stored in the non-volatile memory that causes the at least one processor to:
 receive the image data, the audio signal data, and the sensor data associated with the at least one baby; 
 determine baby-specific physiological data of the at least one baby based on the image data, the sensor data, and the audio signal data; 
 wherein the baby-specific physiological data comprises: 
 (i) breathing rate signal data of the at least one baby, 
 (ii) spatial body temperature distribution data of the at least one baby, 
 (iii) heartbeat signal data of the at least one baby, 
 (iv) baby motion data of the at least one baby, and 
 (v) baby voice classification data of the at least one baby; 
 input to at least one baby-specific behavioral state detection machine learning model, the image data, the audio signal data, the sensor data, the baby-specific physiological data, and the baby-specific personal data associated with the at least one baby;
 wherein the at least one baby-specific behavioral state detection machine learning model is trained using datasets based at least in part on the baby-specific stimuli data, the baby-specific response data, and the baby-specific personal data associated with the plurality of babies; 
 
 receive at least one indication from the at least one baby-specific behavioral state detection machine learning model providing a determination that the at least one baby is hungry; 
 transmit instructions that causes the foodstuff preparation controller to prepare at least one foodstuff in preparation to feed the at least one baby based on the determination that the at least one baby is hungry; 
 transmit over the communication network, to the at least one communication device of the at least one user, an alert to feed the at least one baby, the sensor data, or both, based on the determination that the at least one baby is hungry; and 
 transmit over the communication network, to the at least one communication device of the at least one user the sensor data based on the determination that the at least one baby is satiated. 
   
     
     
         2 . The system according to  claim 1 , wherein the foodstuff preparation controller comprises a temperature controller; and wherein the at least one processor is configured to transmit instructions that causes the temperature controller to change a predefined temperature of the at least one foodstuff in the preparation to feed the at least one baby based on the determination that the at least one baby is hungry. 
     
     
         3 . The system according to  claim 1 , wherein the at least one processor is further configured to receive user-instructions from the at least one user through a graphic user interface on the at least one communication device associated with the at least one user. 
     
     
         4 . The system according to  claim 3 , wherein the at least one processor is further configured to transmit the instructions based on the at least one indication and the user-instructions from the graphic user interface. 
     
     
         5 . The system according to  claim 1 , wherein a sensor from the plurality of sensors is selected from the group consisting of a thermal imager, an infrared (IR) camera, a lidar device, and a radio frequency (RF) device. 
     
     
         6 . The system according to  claim 1 , further comprising a vibration unit operatively coupled to the at least one baby, and wherein the at least one processor is further configured to transmit instructions to the vibration unit that causes the vibration unit to apply a vibration to the at least one baby when the at least one baby is hungry. 
     
     
         7 . A method, comprising:
 receiving, by a processor, from at least one database stored in at least one electronic resource:
 (i) baby-specific stimuli data for a plurality of baby-specific stimuli provided to a plurality of babies, 
 (ii) baby-specific response data for a plurality of baby-specific responses acquired in response to the plurality of baby-specific stimuli provided to the plurality of babies, and 
 (iii) baby-specific personal data for each baby in the plurality of babies; 
   receiving, by the processor, from an imaging device, image data of an image of at least one baby from a plurality of images;   receiving, by the processor, from a microphone, audio signal data of the at least one baby;   receiving, by the processor, from a plurality of sensors, sensor data associated with the at least one baby;   determining, by the processor, baby-specific physiological data of the at least one baby based on the image data, the sensor data, and the audio signal data;
 wherein the baby-specific physiological data comprises: 
 (i) breathing rate signal data of the at least one baby, 
 (ii) spatial body temperature distribution data of the at least one baby, 
 (iii) heartbeat signal data of the at least one baby, 
 (iv) baby motion data of the at least one baby, and 
 (v) baby voice classification data of the at least one baby; 
   inputting, by the processor, to at least one baby-specific behavioral state detection machine learning model, the image data, the audio signal data, the sensor data, the baby-specific physiological data, and the baby-specific personal data associated with the at least one baby;
 wherein the at least one baby-specific behavioral state detection machine learning model is trained using a dataset based at least in part on the baby-specific stimuli data, the baby-specific response data, and the baby-specific personal data associated with the plurality of babies; 
   receiving, by the processor, an output from the at least one baby-specific behavioral state detection machine learning model that at least one indication from the at least one baby-specific behavioral state detection machine learning model providing a determination that the at least one baby is hungry;   transmitting, by the processor, instructions that causes a foodstuff preparation controller to prepare at least one foodstuff in preparation to feed the at least one baby based on the determination that the at least one baby is hungry;   transmitting, by the processor, over a communication network, to at least one communication device of at least one user, an alert to feed the at least one baby, the sensor data, or both, based on the determination that the at least one baby is hungry; and   transmitting, by the processor, over the communication network, to the at least one communication device of the at least one user, the sensor data based on the determination that the at least one baby is satiated.   
     
     
         8 . The method according to  claim 7 , wherein the foodstuff preparation controller comprises a temperature controller; and wherein the transmitting of the instructions causes the temperature controller to change a predefined temperature of the at least one foodstuff in preparation to feed the at least one baby based on the determination that the at least one baby is hungry. 
     
     
         9 . The method according to  claim 7 , further comprising receiving, by the processor, user-instructions from the at least one user through a graphic user interface on the at least one communication device associated with the at least one user. 
     
     
         10 . The method according to  claim 9 , further comprising transmitting, by the processor, the instructions based on the at least one indication and the user-instructions from the graphic user interface. 
     
     
         11 . The method according to  claim 7 , wherein a sensor from the plurality of sensors is selected from the group consisting of a thermal imager, an infrared (IR) camera, a lidar device, and a radio frequency (RF) device. 
     
     
         12 . A method, comprising:
 receiving, by a processor, from at least one database stored in at least one electronic resource:
 (i) baby-specific stimuli data for a plurality of baby-specific stimuli provided to each baby in a plurality of babies, 
 (ii) baby-specific response data for a plurality of baby-specific responses for each baby acquired in response to the baby-specific stimuli data provided to each baby, and 
 (iii) baby-specific personal data for each baby in the plurality of babies; 
   determining, by the processor, from the baby-specific stimuli data and the baby-specific response data for each baby, sensor data from a plurality of sensors, image data from an image device, and audio signal data from a microphone acquired while monitoring each baby in the plurality of babies;   determining, by the processor, baby-specific physiological data for each baby based on the image data, the sensor data, and the audio signal data;
 wherein the baby-specific physiological data comprises: 
 (i) breathing rate signal data for each baby, 
 (ii) spatial body temperature distribution data for each baby, 
 (iii) heartbeat signal data for each baby, 
 (iv) baby motion data for each baby, and 
 (v) baby voice classification data for each baby; 
   executing, by the processor, a physics algorithm module that generates baby-specific features and environmental-specific features for each baby in the plurality of babies unique to a baby feeding use case from the baby-specific physiological data, the image data, the audio signal data, the sensor data, and the baby-specific personal data for each baby;   executing, by the processor, a time driven pipeline software module configured to calculate from the baby-specific features and the environmental-specific features for each baby unique to the baby feeding use case, time-dependent baby-specific features and time dependent environmental-specific features for each baby based at least in part on a time series generated from the baby-specific features and the environmental-specific features that characterize feature progression over time;   executing, by the processor, a behavioral model configured to generate a digital twin model for each baby in the plurality of babies based at least in part on:
 (1) a correlation between baby-specific behavioral features from the baby-specific features and the environmental-specific features for each baby, and 
 (2) the baby-specific stimuli data, the baby-specific response data, and the baby-specific personal data for each baby;
 wherein the digital twin model comprises a set of parameters representing different responses to different stimuli for each baby in the plurality of babies based on each baby being in different behavioral states during different time intervals; 
 
   executing, by the processor, a feedback environmental generator using the digital twin model of each baby to output at least one recommendation, at least one action, or both to change a behavioral state of each baby in accordance with the baby feeding use case for each baby; and   generating, by the processor, a training dataset for the baby feeding use case based at least in part on:
 (1) input features for each baby from the plurality of babies comprising:
 (A) the baby-specific features for each baby, 
 (B) the environmental-specific features for each baby, 
 (C) the time-dependent baby-specific features for each baby, and 
 (D) the time dependent environmental-specific features for each baby, and 
 
 (2) output features for each baby from the plurality of babies comprising:
 (A) the at least one recommendation for each baby, 
 (B) the at least one action for each baby, or 
 (C) both. 
 
   
     
     
         13 . The method according to  claim 12 , further comprising training, by the processor, at least one baby-specific behavioral state detection machine learning model with the training dataset unique to the baby feeding use case. 
     
     
         14 . The method according to  claim 10 , wherein the at least one action for at least one baby from the plurality of babies comprises preparing at least one foodstuff in preparation to feed the at least one baby. 
     
     
         15 . The method according to  claim 14 , wherein preparing the at least one foodstuff comprises warming the at least one foodstuff.