Remote image management system (RIMS)

Abstract

A data processing system is provided which enables an operator to rapidly perform object detection, identification, recognition, and location using remote imagery from Mini Unmanned Air Vehicles when sensor performance is severely limited due to size, weight, and power constraints. The system receives down linked images from an Unmanned Air Vehicle as well as vehicle geographic position and sensor attitude data. The imagery is processed on the ground using detection, identification, recognition and moving target detection algorithms to eliminate clutter and preselect potential objects of interest. The objects of interest are identified by the operator from the preselected list of objects automatically presented to him. The target location is simultaneously calculated for selected objects using the down linked vehicle location and sensor pointing angle and displayed to the operator.

1 - 14 . (canceled)  
   
   
       15 . A remote image data processing system for use in an aircraft comprising: 
 a. an aircraft including an adjustable propulsion and control system and connected to servos;    b. an image detector located in the aircraft and oriented to detect images on the ground during flight;    c. an apparatus located in the aircraft capable of controllably adjusting the image detector's line of sight with the ground;    d. a geographic positioning device located in the aircraft;    e. a first radio transmitter located in the aircraft connected to the image detector, line of sight sensor and geographic positioning device and configured transmit images, line of sight angle and geographic position of the sensor from the aircraft as data;    f. a first radio receiver located in the aircraft capable of receiving inputs to control the aircraft's flight and directing the orientation of the line of sight apparatus transmitted to the receiver and configured and connected to servos capable of actuating the aircraft's flight controls and the line of sight adjustment apparatus;    g. a second radio receiver remote from the aircraft and configured to receive images, line of sight angle and geographic position data transmitted by the first transmitter;    h. a second radio transmitter remote from the aircraft capable transmitting control signals to the aircraft to control the aircraft's flight and direct the orientation of the line of sight apparatus;    i. a computer connected to the first receiver configured to store, analyze, identify and display images detected by the image detector to a human operator and connected to the second transmitter, the computer being additionally connected to the second transmitter the computer being configured to generate control signals capable of transmission by the second transmitter and receipt by the first receiver to control the aircraft's flight and direct the orientation of the line of sight    
   
   
       16 . A remote image data processing system for use in an aircraft comprising: 
 a. a MAUV including adjustable control surfaces and propulsion systems connected to servos;    b. an uncooled infra red camera located in the MAUV and oriented to detect images on the ground during flight;    c. an apparatus located in the aircraft capable of controllably adjusting the image detector's line of sight with the ground;    d. a GPS located in the aircraft;    e. a first radio transmitter located in the aircraft connected to the image detector, line of sight sensor and geographic positioning device and configured transmit images, line of sight angle and geographic position of the sensor from the aircraft as data;    f. a first radio receiver located in the aircraft capable of receiving control signals to control the aircraft's flight and directing the orientation of the line of sight apparatus transmitted to the receiver and configured and connected to servos capable of actuating the aircraft's flight controls and the line of sight adjustment apparatus;    g. a second radio receiver remote from the aircraft and configured to receive images, line of sight angle and geographic position data transmitted by the first transmitter;    h. a second radio transmitter remote from the aircraft capable transmitting control signals to the aircraft to control the aircraft's flight and direct the orientation of the line of sight apparatus;    a. a computer connected to the first receiver and transmitter configured to store, analyze, identify and display images detected by the image detector, as well as the image's geographic position to a human operator, the computer also being configured to display at the operator's option, images in unanalyzed format in real time, on a frame by frame basis, at varying speeds to alert the operator when the computer identifies an object of interest, the computer being additionally connected to the second transmitter the computer being configured to generate control signals capable of transmission by the second transmitter and receipt by the first receiver.    
   
   
       17 . A remote image data processing system for use in an aircraft as claimed in  claim 16  above wherein an apparatus capable of measuring the angle of the line of sight relative to the image detector sensor attached to the line of site apparatus;  
   
   
       18 . A remote image data processing system for use in an aircraft as claimed in  claim 16  above wherein said apparatus for resolving detected images is a motor drive telephoto lens connected to the infra red camera;  
   
   
       19 . A remote image data processing system for use in an aircraft as claimed in  claim 16  above wherein said apparatus for adjusting image detector line of sight is a three axis pan and tilt mechanism.  
   
   
       20 . A remote image data processing system for use in an aircraft as claimed in  claim 16  above, wherein the control signals actuate the aircraft's flight controls, direct the orientation of the line of sight apparatus, adjust the line of sight adjustment apparatus, redirect the aircraft back to an object of interest and fix the image sensor orientation on the object, the control signals being transmitted in real time as a part of pre-programmed flight instructions.  
   
   
       21 . A method for remote image detection, location and identification for use on an aircraft comprising the steps of: 
 a. detecting images using an image detector, located in an aircraft;    b. determining the aircraft's geographic position;    c. measuring the angle line of sight of the image detector relative to the object;    d. calculating a geographic position of the object relative to the aircraft using the aircraft's geographic position and the line of sight angle and correlating the object geographic location with a matching object image frame;    e. analyzing object images using object identification, recognition algorithms to prescreen objects of interest to the operator;    f. sorting and collating frames containing objects identified by use of object identification, recognition algorithms for review by the operator.    
   
   
       22 . The method as recited in  claim 20 , further comprising the step of: viewing the detected images as they are received in real time with out use of object identification/recognition algorithms.  
   
   
       23 . The method as recited in  claim 20 , wherein the aircraft position location is obtained from GPS data.  
   
   
       24 . The method as recited in  claim 20 , wherein the aircraft position location is obtained from an inertial guidance system.  
   
   
       26 . (canceled)  
   
   
       27 . (canceled)