Method and system for handling image data

Abstract

A method for handling image data of an unmanned aerial vehicle (UAV) includes an imaging device carried by a carrier of the UAV acquiring a plurality of images while the UAV being in flight, continuing to acquire additional images by the imaging device, a processor of the UAV applying a first compression and a second compression to the plurality of images to generate first image data and second image data, respectively, storing the first image data to a storage device configured on the UAV without transmitting the first image data to any devices remote from the UAV, transmitting the second image data to a remote device through a direct connection between the UAV and the remote device for a real-time display at the remote device, and controlling an actuation mechanism of the carrier to cause an angular movement and a linear movement of the imaging device relative to the UAV.

What is claimed is: 
     
         1 . A method for handling image data of an unmanned aerial vehicle (UAV), comprising:
 acquiring, by an imaging device carried by a carrier of the UAV, a plurality of images while the UAV being in flight;   after acquiring the plurality of images, continuing to acquire additional images by the imaging device;   while the imaging device continuing to acquire the additional images and the UAV being in flight, applying, by a processor of the UAV, a first compression and a second compression to the plurality of images to generate first image data and second image data, respectively, wherein the second image data has a smaller data size than the first image data;   while the UAV being in flight, storing the first image data to a storage device configured on the UAV without transmitting the first image data to any devices remote from the UAV, and simultaneously transmitting, by the processor of the UAV, the second image data to a remote device through a direct connection between the UAV and the remote device for a real-time display at the remote device; and   while the imaging device continuing to acquire the additional images and the UAV being in flight, controlling an actuation mechanism of the carrier to cause an angular movement and a linear movement of the imaging device relative to the UAV;   wherein the first image data is configured for post-processing after the UAV has been landed.   
     
     
         2 . The method of  claim 1 , wherein the first compression is a lossless or near-lossless compression. 
     
     
         3 . The method of  claim 1 , wherein applying the second compression to the plurality of images to generate the second image data reduces a resolution of the plurality of images. 
     
     
         4 . The method of  claim 1 , wherein applying the second compression to the plurality of images to generate the second image data decreases a frame rate of the plurality of images. 
     
     
         5 . The method of  claim 1 , wherein the one or more processors include an image signal processor (ISP), and the ISP processes the plurality of images to generate the second image data. 
     
     
         6 . The method of  claim 5 , wherein the ISP is implemented in a field-programmable gate array (FPGA) or in an Application-Specific Integrated Circuit (ASIC). 
     
     
         7 . The method of  claim 1 , wherein the second image data is streamed to the remote device and is displayed at the remote device in real-time. 
     
     
         8 . The method of  claim 1 , wherein the imaging device is coupled to the storage device through an image signal processor (ISP). 
     
     
         9 . The method of  claim 8 , wherein the ISP is connected to the storage device via a Peripheral Component Interconnect Express (PCIe) interface or via a Serial AT Attachment (SATA) interface. 
     
     
         10 . The method of  claim 1 , further comprising:
 transmitting the first image data to an external device coupled to the storage device after the UAV has been landed, wherein the external device includes a plurality of image signal processors (ISPs) configured to perform a plurality of processing operations on the first image data.   
     
     
         11 . The method of  claim 1 , wherein the second compression is associated with a dynamic range of the plurality of images. 
     
     
         12 . A system for handling image data of an unmanned aerial vehicle (UAV), comprising:
 an imaging device carried by a carrier of the UAV;   a storage device configured on the UAV; and   one or more processors coupled to the imaging device and the storage device, the one or more processors being configured to:
 acquire, through the imaging device, a plurality of images while the UAV being in flight; 
 after acquiring the plurality of images, continue to acquire additional images through the imaging device; 
 while the imaging device continuing to acquire the additional images and the UAV being in flight, apply a first compression and a second compression to the plurality of images to generate first image data and second image data, respectively, wherein the second image data has a smaller data size than the first image data; 
 while the UAV being in flight, store the first image data to the storage device without transmitting the first image data to any devices remote from the UAV, and simultaneously transmit the second image data to a remote device through a direct connection between the UAV and the remote device for a real-time display at the remote device; and 
 while the imaging device continuing to acquire the additional images and the UAV being in flight, control an actuation mechanism of the carrier to cause an angular movement and a linear movement of the imaging device relative to the UAV; 
 wherein the first image data is configured for post-processing after the UAV has been landed. 
   
     
     
         13 . The system of  claim 12 , wherein the first compression includes a lossless or near-lossless compression that is applied to the plurality of images to generate the first image data. 
     
     
         14 . The system of  claim 12 , wherein the second compression applied to the plurality of images reduces a resolution of the plurality of images to generate the second image data. 
     
     
         15 . The system of  claim 12 , wherein the second compression applied to the plurality of images decreases a frame rate of the plurality of images to generate the second image data. 
     
     
         16 . The system of  claim 12 , wherein the one or more processors include an image signal processor (ISP), and the ISP processes the plurality of images to generate the second image data. 
     
     
         17 . The system of  claim 16 , wherein the ISP is implemented in a field-programmable gate array (FPGA) or in an Application-Specific Integrated Circuit (ASIC). 
     
     
         18 . The system of  claim 12 , wherein the second image data is streamed to the remote device and is displayed at the remote device in real-time. 
     
     
         19 . The system of  claim 12 , wherein the second compression is associated with a dynamic range of the plurality of images. 
     
     
         20 . An unmanned aerial vehicle (UAV), comprising:
 a propulsion system;   an imaging device carried by a carrier of the UAV;   a storage device; and   one or more processors coupled to the propulsion system, the imaging device, and the storage device, the one or more processors being configured to perform:
 acquiring, by the imaging device, a plurality of images; 
 after acquiring the plurality of images, continuing to acquire additional images by the imaging device; 
 while the imaging device continuing to acquire the additional images and the UAV being in flight, applying a first compression and a second compression to the plurality of images to generate first image data and second image data, respectively, wherein the second image data has a smaller data size than the first image data; 
 while the UAV being in flight, storing the first image data to the storage device configured on the UAV without transmitting the first image data to any devices remote from the UAV, and simultaneously transmitting the second image data to a remote device through a direct connection between the UAV and the remote device for a real-time display at the remote device; and 
 while the imaging device continuing to acquire the additional images and the UAV being in flight, controlling an actuation mechanism of the carrier to cause an angular movement and a linear movement of the imaging device relative to the UAV; 
 wherein the first image data is configured for post-processing after the UAV has been landed.