US2011007129A1PendingUtilityA1

Omniview motionless camera orientation system

Assignee: SONY CORPPriority: May 13, 1991Filed: Apr 6, 2010Published: Jan 13, 2011
Est. expiryMay 13, 2011(expired)· nominal 20-yr term from priority
H04N 25/00H04N 23/58H04N 23/698H04N 1/217H04N 7/183G06F 16/40H04N 1/2158H04N 7/002H04N 5/2628A61B 2090/0813G08B 13/19689G08B 13/19628G06T 3/047
47
PatentIndex Score
0
Cited by
0
References
0
Claims

Abstract

An apparatus and method is provided for converting digital images for use in an imaging system. The apparatus includes a data memory which stores digital data representing an image having a circular or spherical field of view such as an image captured by a fish-eye lens, a control input for receiving a signal for selecting a portion of the image, and a converter responsive to the control input for converting digital data corresponding to the selected portion into digital data representing a planar image for subsequent display. Various methods include the steps of storing digital data representing an image having a circular or spherical field of view, selecting a portion of the image, and converting the stored digital data corresponding to the selected portion into digital data representing a planar image for subsequent display. In various embodiments, the data converter and data conversion step may use an orthogonal set of transformation algorithms.

Claims

exact text as granted — not AI-modified
1 - 31 . (canceled) 
     
     
         32 . A system for providing perspective corrected views of a selected portion of a received optical image captured using a wide angle lens, the received optical image being distorted, the system comprising:
 image capture means for receiving signals corresponding to the received optical image and for digitizing the signal;   input image memory means for receiving the digitized signal;   input means for selecting a portion of the received image to view;   image transform processor means for processing the digitized signals to produce an output signal corresponding to a perspective corrected image of the selected portion of the received image;   output image memory means for receiving the output signal from the image transform processor means; and   output means connected to the output image memory means for recording or displaying the perspective corrected image of the selected portion;   wherein the image transform processor means comprises transform parameter calculation means for calculating transform parameters for the selected portion of the image and processes the digitized signal based on the calculated transform parameters to generate the output signal.   
     
     
         33 . A system according to  claim 32 , comprising a camera imaging system for receiving the optical image and for producing the signals corresponding to the received optical image for output to the image capture means. 
     
     
         34 . A system according to  claim 33 , comprising wide angle lens means mounted on the camera imaging system for producing the optical image for optical conveyance to the camera imaging system. 
     
     
         35 . A system according to  claim 34 , wherein the lens means is one or more fish-eye lenses. 
     
     
         36 . A system according to  claim 32 , wherein the input means provides for input to the image transform processor means of one or more of: a direction of view, tilting of a viewing angle, rotation of a viewing angle, pan of the viewing angle, focus of the image and magnification of the selected portion of the image. 
     
     
         37 . A system according to  claim 36 , wherein tilting of the viewing angle through at least 180 degrees is provided for. 
     
     
         38 . A system according to  claim 36 , wherein rotation of the viewing angle through 360 degrees is provided for. 
     
     
         39 . A system according to  claim 36 , wherein pan of the viewing angle through at least 180 degrees is provided for. 
     
     
         40 . A system according to  claim 39 , wherein pan of the viewing angle through 360 degrees is provided for. 
     
     
         41 . A system according to  claim 32 , wherein the input means is a user-operated manipulator switch means. 
     
     
         42 . A system according to  claim 32 , wherein the input means is a signal from a computer input means. 
     
     
         43 . A system according to  claim 32 , wherein the image transform processing means is programmed to implement the following equations: 
       
         
           
             
               
                 
                   
                     x 
                     = 
                     
                       
                         R 
                          
                         
                           [ 
                           
                             uA 
                             - 
                             vB 
                             + 
                             
                               mR 
                                
                               
                                   
                               
                                
                               sin 
                                
                               
                                   
                               
                                
                               β 
                                
                               
                                   
                               
                                
                               sin 
                               ∂ 
                             
                           
                           ] 
                         
                       
                       
                         
                           
                             u 
                             2 
                           
                           + 
                           
                             v 
                             2 
                           
                           + 
                           
                             
                               m 
                               2 
                             
                              
                             
                               R 
                               2 
                             
                           
                         
                       
                     
                   
                 
               
               
                 
                   
                     y 
                     = 
                     
                       
                         R 
                          
                         
                           [ 
                           
                             uC 
                             - 
                             vD 
                             - 
                             
                               mR 
                                
                               
                                   
                               
                                
                               sin 
                                
                               
                                   
                               
                                
                               β 
                                
                               
                                   
                               
                                
                               cos 
                               ∂ 
                             
                           
                           ] 
                         
                       
                       
                         
                           
                             u 
                             2 
                           
                           + 
                           
                             v 
                             2 
                           
                           + 
                           
                             
                               m 
                               2 
                             
                              
                             
                               R 
                               2 
                             
                           
                         
                       
                     
                   
                 
               
             
           
         
         where:
     A =(cos θ cos ∂−sin θ sin ∂ cos β)
 
     B =(sin θ cos ∂+cos θ sin ∂ cos β)
 
     C =(cos θ sin ∂+sin θ cos ∂ cos β)
 
     D =(sin θ sin ∂−cos θ cos ∂ cos β)
 
 
         and where: 
         R=radius of the image circle 
         β=zenith angle 
         ∂=Azimuth angle in image plane 
         θ=object plane rotation angle 
         m=Magnification 
         u, v=object plane coordinates 
         x, y=image plane coordinates. 
       
     
     
         44 . A method for providing perspective corrected views of a selected portion of an optical image captured with a wide angle lens, the received optical image being distorted, the method comprising:
 providing a digitized signal corresponding to the optical image;   selecting a portion of the optical image;   transforming the digitized signal to produce an output signal corresponding to a perspective corrected image of the selected portion of the received image; and   displaying or recording the perspective corrected image of the selected portion;   wherein the step of transforming the digitized signal comprises calculating transform parameters for the selected portion of the image, the calculated transform parameters being used to control the transformation of the digitized signal to generate the output signal.   
     
     
         45 . A method according to  claim 44 , further comprising first receiving the optical image, producing signals corresponding to the received optical image, and digitizing the signals. 
     
     
         46 . A method according to  claim 44 , further comprising capturing the optical image with one or more fish-eye lenses. 
     
     
         47 . A method according to  claim 44 , wherein the step of selecting the portion of the image to view comprises selecting one or more of: a direction of view; tilting of a viewing angle; rotation of a viewing angle; pan of the viewing angle; focus of the image and magnification of the selected portion of the image. 
     
     
         48 . A method according to  claim 47 , wherein tilting of the viewing angle through at least 180 degrees is provided for. 
     
     
         49 . A method according to  claim 47 , wherein rotation of the viewing angle through 360 degrees is provided for. 
     
     
         50 . A method according to  claim 47 , wherein pan of the viewing angle through at least 180 degrees is provided for. 
     
     
         51 . A method according to  claim 50 , wherein pan of the viewing angle through 360 degrees is provided for. 
     
     
         52 . A method according to  claim 44 , wherein selection of the portion of the image to view is achieved using a user-operated manipulator switch means. 
     
     
         53 . A method according to  claim 44 , wherein selection of the portion of the image to view is controlled by a signal from a computer input means. 
     
     
         54 . A method according to  claim 44 , wherein the image transformation implements the following two equations: 
       
         
           
             
               
                 
                   
                     x 
                     = 
                     
                       
                         R 
                          
                         
                           [ 
                           
                             uA 
                             - 
                             vB 
                             + 
                             
                               mR 
                                
                               
                                   
                               
                                
                               sin 
                                
                               
                                   
                               
                                
                               β 
                                
                               
                                   
                               
                                
                               sin 
                               ∂ 
                             
                           
                           ] 
                         
                       
                       
                         
                           
                             u 
                             2 
                           
                           + 
                           
                             v 
                             2 
                           
                           + 
                           
                             
                               m 
                               2 
                             
                              
                             
                               R 
                               2 
                             
                           
                         
                       
                     
                   
                 
               
               
                 
                   
                     y 
                     = 
                     
                       
                         R 
                          
                         
                           [ 
                           
                             uC 
                             - 
                             vD 
                             - 
                             
                               mR 
                                
                               
                                   
                               
                                
                               sin 
                                
                               
                                   
                               
                                
                               β 
                                
                               
                                   
                               
                                
                               cos 
                               ∂ 
                             
                           
                           ] 
                         
                       
                       
                         
                           
                             u 
                             2 
                           
                           + 
                           
                             v 
                             2 
                           
                           + 
                           
                             
                               m 
                               2 
                             
                              
                             
                               R 
                               2 
                             
                           
                         
                       
                     
                   
                 
               
             
           
         
         where:
     A =(cos θ cos ∂−sin θ sin ∂ cos β)
 
     B =(sin θ cos ∂+cos θ sin ∂ cos β)
 
     C =(cos θ sin ∂+sin θ cos ∂ cos β)
 
     D =(sin θ sin ∂−cos θ cos ∂ cos β)
 
 
         and where: 
         R=radius of the image circle 
         β=zenith angle 
         ∂=Azimuth angle in image plane 
         θ=object plane rotation angle 
         m=Magnification 
         u, v=object plane coordinates 
         x, y=image plane coordinates. 
       
     
     
         55 . A method according to  claim 44 , wherein a plurality of portions of the image are selected for viewing and are displayed either simultaneously or consecutively. 
     
     
         56 . A method according to  claim 44 , wherein the image is viewed interactively by repeating the steps of selecting, transforming and displaying the portion of the image. 
     
     
         57 . A method according to  claim 44 , wherein the step of transforming the image is based on lens characteristics of the wide angle lens. 
     
     
         58 . A method according to  claim 57 , wherein the step of transforming the image is based on azimuth angle invariability and equidistant projection. 
     
     
         59 . A method according to  claim 44 , wherein the step of transforming the image is performed at real time video rates.

Join the waitlist — get patent alerts

Track US2011007129A1 — get alerts on status changes and closely related new filings.

We store only your email — no account needed. See our privacy policy.