Unified system and method for animal behavior characterization in home cages using video analysis

Abstract

Systems and methods for finding the position and shape of an animal using video are disclosed. The invention includes a system with a video camera coupled to a computer in which the computer is configured to automatically provide animal segmentation and identification, animal motion tracking (for moving animals), animal posture classification, and behavior identification. In a preferred embodiment, the present invention may use background subtraction for animal identification and tracking, and a combination of decision tree classification and rule-based classification for posture and behavior identification. Thus, the present invention is capable of automatically monitoring a video image to identify, track and classify the actions of various animals and the animal's movements within the image. The image may be provided in real time or from storage.

1 . A method for characterizing animal behavior, comprising: 
 segregating images of an animal from video images;    classifying a posture of the animal in each of a series of images of the animal;    identifying at least one body segment of the animal in each of the series of images of the animal; and    identifying behavior of the animal as one of a set of predetermined behaviors using the postures and the body segments of the animal over the series of images of the animal.    
     
     
         2 . The method of  claim 1 , wherein segregating images of an animal from video images includes subtracting a background image from a video image containing an image of an animal.  
     
     
         3 . The method of  claim 1 , wherein classifying a posture of the animal includes classifying a posture of the animal as one of a set of predetermined postures.  
     
     
         4 . The method of  claim 3 , wherein the set of predetermined postures includes horizontal side view posture, vertical posture, cuddled posture, horizontal front/back view posture, partially reared posture, stretched posture, hang vertical posture, hang cuddled posture, eating posture, and drinking posture.  
     
     
         5 . The method of  claim 1 , wherein the at least one body segment is a head.  
     
     
         6 . The method of  claim 1 , wherein the at least one body segment is a forelimb.  
     
     
         7 . The method of  claim 1 , wherein the at least one body segment is an abdomen.  
     
     
         8 . The method of  claim 1 , wherein the at least one body segment is a hind limb.  
     
     
         9 . The method of  claim 1 , wherein the at least one body segment is a tail.  
     
     
         10 . The method of  claim 1 , wherein the at least one body segment is a lower back.  
     
     
         11 . The method of  claim 1 , wherein the at least one body segment is an upper back.  
     
     
         12 . The method of  claim 1 , wherein the at least one body segment is an ear.  
     
     
         13 . A method for characterizing animal behavior, comprising: 
 segregating images of an animal from video images;    identifying a posture of the animal in each of a series of images of the animal;    identifying each of a set of body segments of the animal in each of the series of images of the animal; and    characterizing behavior of the animal as one of a set of predetermined behaviors using the postures and the sets of body segments of the animal over the series of images of the animal.    
     
     
         14 . The method of  claim 13 , wherein segregating images of an animal from video images includes subtracting a background image from a video image containing an image of an animal.  
     
     
         15 . The method of  claim 13 , wherein classifying a posture of the animal includes classifying a posture of the animal as one of a set of predetermined postures.  
     
     
         16 . The method of  claim 15 , wherein the set of predetermined postures includes horizontal side view posture, vertical posture, cuddled posture, horizontal front/back view posture, partially reared posture, stretched posture, hang vertical posture, hang cuddled posture, eating posture, and drinking posture.  
     
     
         17 . The method of  claim 13 , wherein the set of body segments includes a head, a forelimb, an abdomen, a hind limb, a tail, a lower back, an upper back, and an ear.  
     
     
         18 . A computer-readable medium including instructions for performing: 
 segregating images of an animal from video images;    identifying a posture of the animal in each of a series of images of the animal;    identifying each of a set of body segments of the animal in each of the series of images of the animal; and    characterizing behavior of the animal as one of a set of predetermined behaviors using the postures and the sets of body segments of the animal over the series of images of the animal.    
     
     
         19 . The computer-readable medium of  claim 18 , wherein segregating images of an animal from video images includes subtracting a background image from a video image containing an image of an animal.  
     
     
         20 . The computer-readable medium of  claim 18 , wherein classifying a posture of the animal includes classifying a posture of the animal as one of a set of predetermined postures.  
     
     
         21 . The computer-readable medium of  claim 20 , wherein the set of predetermined postures includes horizontal side view posture, vertical posture, cuddled posture, horizontal front/back view posture, partially reared posture, stretched posture, hang vertical posture, hang cuddled posture, eating posture, and drinking posture.  
     
     
         22 . The computer-readable medium of  claim 18 , wherein the set of body segments includes a head, a forelimb, an abdomen, a hind limb, a tail, a lower back, an upper back, and an ear.