USRE43490EExpiredUtility
Wide-angle dewarping method and apparatus
Est. expiryMay 27, 2014(expired)· nominal 20-yr term from priority
H04N 5/2628G06T 3/047
89
PatentIndex Score
22
Cited by
23
References
42
Claims
Abstract
A method and apparatus for transforming wide angle video into perspective corrected viewing zones which either a single user or multiple users may select, orient and magnify. The present invention first captures a wide angle digital video input by any suitable means. The captured image is then stored in a suitable memory means so portions of the image may be selected at a later time. When a portion of the stored video is selected for viewing, a plurality of discrete viewing vectors in three dimensional space are chosen on the video input and transformed to a plurality of control points in a two dimensional plane or any other suitable surface. The area between these points which is still warped from the original wide angle image capture is then transformed to a perspective corrected field of view. The perspective corrected field of view is then displayed on a suitable displaying apparatus, such as a monitor or head mounted display.
Claims
exact text as granted — not AI-modified1. A method for providing perspective corrected images from at least one distorted image, the method comprising steps of:
receiving said distorted image;
storing a portion of said distorted image;
transforming a set of control vectors to a set of control points that defines an area that associates said portion of said distorted image with a portion of a perspective corrected image;
transforming said portion of said distorted image associated with said area to said portion of said perspective corrected image using a global bivariate polynomial transformation;
displaying said portion of said perspective corrected image;
sensing inputted information; and
controlling the transformation and display of said perspective corrected image through said inputted information.
2. The method of claim 1 wherein the step of transforming said portion of said distorted image is accomplished using:
u
=
∑
N
i
=
0
∑
N
-
i
j
=
0
a
ij
x
i
y
j
v
=
∑
N
i
=
0
∑
N
-
i
j
=
0
b
ij
x
i
y
j
.
as said global bivariate polynomial transformation.
3. The method of claim 2 wherein N is 2 or 3.
4. The method of claim 1 wherein said set of control points contains a number of control points, said number having a lower limit of five and an upper limit of one-half of the number of pixels in said portion of said perspective corrected image.
5. The method of claim 1 wherein said distorted image is received from a computer storage device.
6. The method of claim 1 wherein said distorted image is received from a network.
7. The method of claim 6 wherein said network is a computer network.
8. The method of claim 6 wherein said network is in communication with the Internet.
9. The method of claim 1 wherein said distorted image is a result of imaging an environment through at least one wide-angle lens.
10. The method of claim 1 wherein said distorted image is a result of imaging an environment through at least one fisheye lens.
11. The method of claim 1 wherein said distorted image includes an image of at least one sixth of an environment.
12. An apparatus for providing perspective corrected images from at least one distorted image, the apparatus comprising:
an input configured to receive said distorted image;
a memory, coupled to the input, configured to store a portion of said distorted image;
a processor, coupled to the memory, configured to transform a set of control vectors to a set of control points that defines an area that associates said portion of said distorted image with a portion of a perspective corrected image, the processor further configured to transform said portion of said distorted image associated with said area to said portion of said perspective corrected image using a global bivariate polynomial transformation;
a presentation mechanism, coupled to the memory, configured to present said portion of said perspective corrected image; and
a selection mechanism, coupled to the processor, configured to specify said set of control vectors.
13. The apparatus of claim 12 wherein the transformation of said portion of said distorted image is accomplished using:
u
=
∑
N
i
=
0
∑
N
-
i
j
=
0
a
ij
x
i
y
j
v
=
∑
N
i
=
0
∑
N
-
i
j
=
0
b
ij
x
i
y
j
.
as said global bivariate polynomial transformation.
14. The method of claim 13 wherein N is 2 or 3.
15. The apparatus of claim 12 wherein said set of control points contains a number of control points, said number having a lower limit of five and an upper limit of one-half of the number of pixels in said portion of said perspective corrected image.
16. The apparatus of claim 12 wherein said distorted image is received from a computer storage device.
17. The apparatus of claim 12 wherein said distorted image is received from a network.
18. The apparatus of claim 17 wherein said network is a computer network.
19. The apparatus of claim 17 wherein said network is in communication with the Internet.
20. The apparatus of claim 12 wherein said distorted image is a result of imaging an environment through at least one wide-angle lens.
21. The apparatus of claim 12 wherein said distorted image is a result of imaging an environment through at least one fisheye lens.
22. The apparatus of claim 12 wherein said plurality of distorted images includes an image of at least one sixth of an environment.
23. A method of providing perspective corrected views of live, prerecorded or simulated environments from wide angle video signals, the method comprising:
receiving video input data at a computing device; transforming, by the computing device, a plurality of viewing vectors defining a portion of the video input data to a plurality of control points; transforming, by the computing device, pixel data in an area between the plurality of control points to define perspective corrected pixel data; and sending the perspective corrected pixel data to a display for display of the perspective corrected pixel data.
24. The method of claim 23 further comprising determining the plurality of viewing vectors at the computing device based on position and orientation information of a device and a horizontal field of view and a vertical field of view.
25. The method of claim 23 further comprising receiving a selection of the plurality of viewing vectors at the computing device.
26. The method of claim 23 wherein the plurality of viewing vectors define an area of interest.
27. The method of claim 23 wherein a global bivariate polynomial transformation is used to define the perspective corrected pixel data.
28. The method of claim 27 wherein the global bivariate polynomial transformation is a biquadratic polynomial transformation.
29. A system comprising:
a computer-readable memory configured to store video input data; and a processor operably coupled to the computer-readable memory to receive the stored video input data, the processor configured to perform operations comprising
transforming a plurality of viewing vectors defining a portion of the stored video input data to a plurality of control points;
transforming pixel data in an area between the plurality of control points to define perspective corrected pixel data; and
sending the perspective corrected pixel data to a display.
30. The system of claim 29, wherein the processor is an ASIC.
31. The system of claim 29, wherein the computer-readable memory has computer-executable instructions stored thereon execution of which by the processor causes the processor to perform the operations.
32. The system of claim 29, wherein the operations further comprise determining the plurality of viewing vectors based on position and orientation information of a device, a horizontal field of view, and a vertical field of view.
33. The system of claim 29, wherein the operations further comprise receiving a selection of the plurality of viewing vectors.
34. The system of claim 29, wherein the plurality of viewing vectors define an area of interest.
35. The system of claim 29, wherein a global bivariate polynomial transformation is used to define the perspective corrected pixel data.
36. The system of claim 35, wherein the global bivariate polynomial transformation is a biquadratic polynomial transformation.
37. A method of performing perspective correction, the method comprising:
transforming, by a computing device, a set of control vectors into a set of control points using a function that models a wide angle lens; generating, by the computing device, a polynomial transform function that maps the control points into rectangular points; transforming, by the computing device, an area of image data proximate the set of control points using the polynomial transform function; and sending the transformed area of image data to a display for display of the transformed area of image data.
38. The method of claim 37, wherein the polynomial transformation function comprises a global bivariate polynomial.
39. The method of claim 37, wherein the polynomial transformation comprises a biquadratic polynomial.
40. The method of claim 37, wherein the set of control vectors comprise a principal viewing vector and eight surrounding vectors that form a rectangular view.
41. The method of claim 37, wherein the wide-angle lens comprises a fish eye lens.
42. A system comprising:
a computer-readable memory configured to store captured image data; and a processor operably coupled to the computer-readable memory to receive the stored captured image data, the processor configured to perform operations comprising
transforming a set of control vectors into a set of control points using a function that models a wide angle lens;
generating a polynomial transform function that maps the control points into rectangular points;
transforming an area of the captured image data proximate the set of control points using the polynomial transform function; and
sending the transformed area of image data to a display.Join the waitlist — get patent alerts
Track USRE43490E — get alerts on status changes and closely related new filings.
We store only your email — no account needed. See our privacy policy.