Systems and methods for detecting applied railcar brakes using thermal imaging

Abstract

Systems and techniques for detecting applied railcar brakes within a railroad classification yard using thermal imaging. A thermal imaging system, including at least one thermal imaging sensor, captures a plurality of thermal images of railcar wheels. The thermal imaging system determines if a temperature within a user-defined bounding box on the thermal sensor's field of view exceeds a predetermined temperature threshold for a specified amount of time. Alternatively, a neural network may be used to detect the excessive temperature. In response, the thermal imaging system sends a system message, and a computer processor receives the system message and, if it meets reporting criteria, identifies the particular railcar and generates and transmits an alert message indicating a potential issue with the wheels of the railcar.

What is claimed is: 
     
         1 . A method for detecting potential issues within a railroad classification yard, the method comprising:
 capturing, using at least one thermal imaging sensor, a plurality of thermal images of at least a portion of an object within the railroad classification yard;   determining, based on analysis of the plurality of thermal images, that a temperature within a bounding box on the plurality of thermal images has exceeded a predetermined temperature threshold assigned to the bounding box for a predetermined amount of time;   generating, in response to determining that the temperature within the bounding box has exceeded the predetermined temperature threshold assigned to the bounding box for the predetermined amount of time, an alert message indicating a potential issue with the object within the railroad classification yard; and   transmitting the alert message to at least one of a classification yard control system or a user interface prior to a railcar associated with the object being released to free-roll within the railroad classification yard.   
     
     
         2 . The method of  claim 1 , further comprising, sending an automated signal to at least one component of the railroad classification yard to cause one or more physical components of the railroad classification yard to be actuated to release a brake system of the railcar associated with the object. 
     
     
         3 . The method of  claim 1 , wherein generating the alert message includes:
 sending, in response to determining that the temperature within the bounding box has exceeded the predetermined temperature threshold assigned to the bounding box for the predetermined amount of time, to a logic controller:   a system message including one or more of: data indicating a camera location, a timestamp, and the predetermined temperature threshold that was exceeded; and   the plurality of thermal images captured by the at least one thermal imaging sensor.   
     
     
         4 . The method of  claim 3 , wherein the logic controller is configured to:
 determine that the system message meets a reporting criteria; and   in response to determining that the system message meets the reporting criteria:
 determining an identification of the object associated with the system message; and 
 generating and transmitting the alert message indicating the potential issue with the object within the railroad classification yard. 
   
     
     
         5 . The method of  claim 1 , wherein the bounding box includes a user-defined area of a field of view of the at least one thermal imaging sensor. 
     
     
         6 . The method of  claim 5 , wherein the field of view of the at least one thermal imaging sensor is configured to view the at least a portion of the object. 
     
     
         7 . The method of  claim 1 , wherein the object includes a wheel of a railcar, and wherein the potential issue is potential applied brake condition. 
     
     
         8 . The method of  claim 1 , wherein determining that the temperature of the object has exceeded the predetermined temperature threshold comprises utilizing a neural network. 
     
     
         9 . The method of  claim 1 , wherein the at least one thermal imaging sensor includes one or more of:
 a mobile sensor attached to a vehicle or an aircraft; and   a stationary sensor disposed within the railroad classification yard.   
     
     
         10 . The method of  claim 1 , wherein the object includes one or more of: a rail heater, a classification yard retarder, an air plant, air conditioning equipment, electrical switching equipment, a motor, a gearbox, hydraulic equipment, a rail switch, a rail derail, and signaling equipment. 
     
     
         11 . A system for detecting potential issues within a railroad classification yard, the system comprising:
 at least one thermal imaging sensor configured to:
 capture a plurality of thermal images of at least a portion of an object within the railroad classification yard; 
 determine, based on analysis of the plurality of thermal images, that a temperature within a bounding box on the plurality of thermal images has exceeded a predetermined temperature threshold assigned to the bounding box for a predetermined amount of time; and 
 send, in response to determining that the temperature within the bounding box has exceeded the predetermined temperature threshold assigned to the bounding box for the predetermined amount of time, a system message and the plurality of thermal images; and 
   a logic controller configured to:
 receive the system message and the plurality of thermal images from the at least one thermal imaging sensor; 
 determine that the system message meets a reporting criteria; and 
 sending, in response to determining that the system message meets the reporting criteria, an alert message to at least one of a classification yard control system or a user interface prior to a railcar associated with the object being released to free-roll within the railroad classification yard. 
   
     
     
         12 . The system of  claim 11 , wherein sending the alert message includes:
 determining an identification of the object associated with the system message;   generating the alert message indicating a potential issue with the object within the railroad classification yard; and   transmitting the alert message to at least one of a classification yard control system or a user interface prior to a railcar associated with the object being released to free-roll within the railroad classification yard.   
     
     
         13 . The system of  claim 11 , wherein the system is configured to send an automated signal to at least one component of the railroad classification yard to cause one or more physical components of the railroad classification yard to be actuated to release a brake system of the railcar associated with the object. 
     
     
         14 . The system of  claim 11 , wherein the system message includes one or more of: data indicating a camera location, a timestamp, and the predetermined temperature threshold that was exceeded. 
     
     
         15 . The system of  claim 11 , wherein the bounding box includes a user-defined area of a field of view of the at least one thermal imaging sensor. 
     
     
         16 . The system of  claim 15 , wherein the field of view of the at least one thermal imaging sensor is configured to view the at least a portion of the object. 
     
     
         17 . The system of  claim 11 , wherein the object includes a wheel of a railcar, and wherein the potential issue is potential applied brake condition. 
     
     
         18 . The system of  claim 11 , wherein the at least one thermal imaging sensor includes one or more of:
 a mobile sensor attached to a vehicle or an aircraft; and   a stationary sensor disposed within the railroad classification yard.   
     
     
         19 . The system of  claim 11 , wherein the object includes one or more of: a rail heater, a classification yard retarder, an air plant, air conditioning equipment, electrical switching equipment, a motor, a gearbox, hydraulic equipment, a rail switch, a rail derail, and signaling equipment. 
     
     
         20 . A computer-based tool for detecting potential issues within a railroad classification yard including non-transitory computer readable media having stored thereon computer code which, when executed by a processor, causes a computing device to perform operations comprising:
 capturing, using at least one thermal imaging sensor, a plurality of thermal images of at least a portion of an object within the railroad classification yard;   determining, based on analysis of the plurality of thermal images, that a temperature within a bounding box on the plurality of thermal images has exceeded a predetermined temperature threshold assigned to the bounding box for a predetermined amount of time;   generating, in response to determining that the temperature within the bounding box has exceeded the predetermined temperature threshold assigned to the bounding box for the predetermined amount of time, an alert message indicating a potential issue with the object within the railroad classification yard; and   transmitting the alert message to at least one of a classification yard control system or a user interface prior to a railcar associated with the object being released to free-roll within the railroad classification yard.