US2021227146A1PendingUtilityA1

Autofocus initialization based on target detection

Assignee: SZ DJI TECHNOLOGY CO LTDPriority: May 19, 2016Filed: Mar 12, 2021Published: Jul 22, 2021
Est. expiryMay 19, 2036(~9.8 yrs left)· nominal 20-yr term from priority
Inventors:Lifu Yu
B64U 10/13H04N 23/671H04N 23/673B64U 2101/30G02B 7/28G03B 13/20H04N 7/185G03B 15/006G03B 13/36B64C 2201/027B64C 2201/127H04N 5/232123B64C 39/024H04N 5/232121
62
PatentIndex Score
0
Cited by
0
References
0
Claims

Abstract

One or more depth sensors are configured to acquire one or more depth measurements associated with at least one object. One or more orientation sensors are configured to determine orientation information of an imaging device based on orientation information of an optical device of the imaging device. An object distance between the imaging device and one of the at least one object is estimated based on the one or more depth measurements and the orientation information of the imaging device. The optical device is moved from a first position to a second position according to the object distance and focal information of the optical device, and is moved from the second position to a third position according to an autofocus operation.

Claims

exact text as granted — not AI-modified
What is claimed is: 
     
         1 . A focusing method comprising:
 acquiring, by one or more depth sensors, one or more depth measurements associated with at least one object;   determining, by one or more orientation sensors, orientation information of an imaging device based on orientation information of an optical device of the imaging device, the imaging device capturing one of the at least one object;   estimating an object distance between the imaging device and the one of the at least one object based on the one or more depth measurements and the orientation information of the imaging device;   moving the optical device from a first position to a second position according to the object distance and focal information of the optical device; and   moving the optical device from the second position to a third position according to an autofocus operation.   
     
     
         2 . The method of  claim 1 , wherein the autofocus operation comprises a contrast autofocus operation. 
     
     
         3 . The method of  claim 1 , wherein one of the one or more depth sensors has an orientation along one direction in a space, and one of the one or more depth measurements includes depth information indicative of a projection of the object distance on the direction. 
     
     
         4 . The method of  claim 3 , wherein acquiring, by the one or more depth sensors, the one or more depth measurements comprises:
 generating, by a signal generator, a signal; and   detecting, by the one or more depth sensors, a reflection signal of the signal from the at least one object along the direction of the one or the one or more depth sensors.   
     
     
         5 . The method of  claim 1 , wherein the orientation information of the imaging device indicates an orientation of a center axis of the optical device with respect to at least one direction in a space. 
     
     
         6 . The method of  claim 5 , wherein the one or more depth sensors comprise at least one of:
 a first depth sensor that has a first orientation along a first axis of a coordinate system, the coordinate system including a Cartesian coordinate system;   a second depth sensor that has a second orientation along a second axis of the coordinate system; or   a third depth sensor that has a third orientation along a third axis of the coordinate system.   
     
     
         7 . The method of  claim 6 , wherein the orientation information of the imaging device is indicative of:
 a first angle between the center axis of the optical device and the first axis; and   a second angle based on the first angle and a third angle between the center axis of the optical device and the second axis.   
     
     
         8 . The method of  claim 6 , wherein estimating the object distance between the imaging device and the one of the at least one object comprises:
 determining, using the orientation information of the imaging device, a first angle between the center axis of the optical device and the first axis;   determining, using the orientation information of the imaging device, a second angle between:
 a projection of the center axis of the optical device on a plane defined by the second axis and the third axis, and 
 the second axis; and 
   estimating the object distance based on the first angle, the second angle, and the one or more depth measurements.   
     
     
         9 . An unmanned aerial vehicle (UAV) comprising:
 a propulsion system;   an imaging device comprising an optical device;   one or more depth sensors configured to acquire one or more depth measurements associated with at least one object;   one or more orientation sensors configured to determine orientation information of the imaging device based on orientation information of the optical device, the imaging device capturing one of the at least one object; and   one or more processors coupled to the propulsion system, the one or more depth sensors, the one or more orientation sensors, and the imaging device, and configured to:
 estimate an object distance between the imaging device and the one of the at least one object based on the one or more depth measurements and the orientation information of the imaging device; 
 control the optical device to move from a first position to a second position according to the object distance and focal information of the optical device; and 
 control the optical device to move from the second position to a third position according to an autofocus operation. 
   
     
     
         10 . The UAV of  claim 9 , wherein the autofocus operation comprises a contrast autofocus operation. 
     
     
         11 . The UAV of  claim 9 , wherein one of the one or more depth sensors has an orientation along one direction in a space, and one of the one or more depth measurements includes depth information indicative of a projection of the object distance on the direction. 
     
     
         12 . The UAV of  claim 11 , wherein the one or more depth sensors are configured to acquire the one or more depth measurements by detecting a reflection signal of a signal from the at least one object along the direction of the one of the one or more depth sensors, the signal being generated by a signal generator. 
     
     
         13 . The UAV of  claim 9 , wherein the orientation information of the imaging device indicates an orientation of a center axis of the optical device with respect to at least one direction in a space. 
     
     
         14 . The UAV of  claim 13 , wherein the one or more depth sensors comprise at least one of:
 a first depth sensor that has a first orientation along a first axis of a coordinate system, the coordinate system including a Cartesian coordinate system;   a second depth sensor that has a second orientation along a second axis of the coordinate system; and   a third depth sensor that has a third orientation along a third axis of the coordinate system.   
     
     
         15 . The UAV of  claim 14 , wherein the orientation information of the imaging device is indicative of:
 a first angle between the center axis of the optical device and the first axis; and   a second angle based on the first angle and a third angle between the center axis of the optical device and the second axis.   
     
     
         16 . The UAV of  claim 14 , wherein the one or more processors are configured to estimate the object distance between the imaging device and the one of the at least one object by:
 determining, using the orientation information of the imaging device, a first angle between the center axis of the optical device and the first axis;   determining, using the orientation information of the imaging device, a second angle between:
 a projection of the center axis of the optical device on a plane defined by the second axis and the third axis, and 
 the second axis; and 
   estimating the object distance based on the first angle, the second angle, and the one or more depth measurements.   
     
     
         17 . The UAV of  claim 9 , wherein the one or more depth sensors comprise at least one of a pressure sensor, an infrared sensor, an ultrasonic sensor, a stereo camera, or a time-of-flight camera. 
     
     
         18 . The UAV of  claim 9 , wherein the one or more orientation sensors comprise at least one of an accelerometer, a magnetometer, a potentiometer, a Hall sensor, or a gyroscope. 
     
     
         19 . A focusing system, comprising:
 one or more depth sensors configured to acquire one or more depth measurements associated with at least one object;   one or more orientation sensors configured to determine orientation information of an imaging device based on orientation information of an optical device of the imaging device, the imaging device capturing one of the at least one object; and   one or more processors coupled to the one or more depth sensors, the one or more orientation sensors, and the imaging device, and configured to:
 estimate an object distance between the imaging device and the one of the at least one object based on the one or more depth measurements and the orientation information of the imaging device; 
 control the optical device to move from a first position to a second position according to the object distance and focal information of the optical device; and 
 control the optical device to move from the second position to a third position according to an autofocus operation. 
   
     
     
         20 . The system of  claim 19 , wherein the autofocus operation comprises a contrast autofocus operation.

Join the waitlist — get patent alerts

Track US2021227146A1 — get alerts on status changes and closely related new filings.

We store only your email — no account needed. See our privacy policy.