Adjusting dimensioning results using augmented reality

Abstract

A system and method for using an augmented reality interface to adjust the results from a dimensioning system are disclosed. The augmented reality interface allows users to easily correct dimensioning errors, improve dimensioning results, and guide dimensioning analysis. In one embodiment, the user may adjust/select the results via hand gesturing/positioning within the system's field of view. In another embodiment, the user may use virtual tools, enabled by hand gesturing/positioning, to adjust the results. In still another embodiment, the user may shine a light into the system's field of view to adjust the results. The augmented reality interface embraced by the present invention provides the user with an easier, more-intuitive means for interacting with dimensioning system results.

1 . A dimensioning system, comprising:
 a three-dimensional (3D) sensor for dimensioning objects in a field of view;   a camera for capturing real-time images of the objects in the field of view;   a processor communicatively coupled to the 3D sensor and the camera, the processor configured to create augmented-reality feedback comprising (i) the real-time images captured by the camera and (ii) graphic elements overlaid on the real-time images, wherein the processor is further configured to (i) recognize gestures in the real-time images captured by the camera and (ii) adjust the graphic elements in response to the gestures; and   a display communicatively coupled to the processor for displaying the augmented-reality feedback to a user in real time.   
     
     
         2 . The dimensioning system according to  claim 1 , wherein the gestures comprise a hand gesture. 
     
     
         3 . The dimensioning system according to  claim 1 , wherein the gestures comprise the position and/or motion of a point of light projected into the field of view and reflected from the objects in the field of view. 
     
     
         4 . The dimensioning system according to  claim 1 , wherein the graphic elements comprise wireframes that correspond to edges of the objects in the field of view. 
     
     
         5 . The dimensioning system according to  claim 4 , wherein the graphic elements further comprise virtual tools for adjusting and/or selecting the wireframes. 
     
     
         6 . The dimensioning system according to  claim 5 , wherein the virtual tools comprise (i) a tweezer for grabbing an edge of the wireframes, (ii) a pointer for selecting a face of the wireframes, and/or (iii) a virtual hand for grabbing the wireframes. 
     
     
         7 . The dimensioning system according to  claim 4 , wherein the adjustment of the graphic elements comprises changing the size and/or shape of the wireframes. 
     
     
         8 . The dimensioning system according to  claim 4 , wherein the adjustment of the graphic elements comprises selecting a portion of the wireframes for dimensioning. 
     
     
         9 . The dimensioning system according to  claim 4 , wherein the adjustment of the graphic elements comprises rotating, and/or translating the wireframes. 
     
     
         10 . An augmented reality interface for a dimensioning system, comprising:
 a camera for capturing images of a field of view that is aligned with the dimensioning system's field of view;   a display for displaying images and graphical information to a user; and   a processor communicatively coupled to the camera, the display, and the dimensioning system, wherein the processor is configured by software to:
 (i) receive the images from the camera, 
 (ii) receive dimensioning information from the dimensioning system, the dimensioning information corresponding to an object in the dimensioning system's field of view, 
 (iii) create, using the dimensioning information, wireframe graphics that correspond to the edges of the object, 
 (iv) present the images and the wireframe graphics on the display, the wireframe graphics overlaid and aligned with the object in the images, 
 (v) recognize adjustment cues in the images, and 
 (vi) adjust the wireframe graphics in response to the adjustment cues. 
   
     
     
         11 . The augmented reality interface for a dimensioning system according to  claim 10 , wherein the processor is further configured to:
 (i) update the dimensioning information in response to the adjustment to the wireframe graphics, and   (ii) communicate the updated wireframe information to the dimensioning system.   
     
     
         12 . The augmented reality interface for a dimensioning system according to  claim 10 , wherein the adjustment cues comprise a user's hand reaching into the field of view and virtually manipulating the wireframe graphics presented on the display. 
     
     
         13 . The augmented reality interface for a dimensioning system according to  claim 10 , wherein the adjustment cues comprise a light spot projected into the field of view to select a surface indicated by the wireframe graphics presented on the display. 
     
     
         14 . The augmented reality interface for a dimensioning system according to  claim 10 , wherein the adjustment to the wireframe graphics comprises resizing the wireframe graphics. 
     
     
         15 . The augmented reality interface for a dimensioning system according to  claim 10 , wherein the adjustment to the wireframe graphics comprises rotating and/or translating the wireframe graphics. 
     
     
         16 . The augmented reality interface for a dimensioning system according to  claim 10 , wherein the adjustment to the wireframe graphics comprises deleting a portion of the wireframe graphics. 
     
     
         17 . The augmented reality interface for a dimensioning system according to  claim 10 , wherein the adjustment to the wireframe graphics comprises combining wireframe graphics. 
     
     
         18 . A method for correcting dimensioning errors using an augmented reality interface, the method comprising:
 observing results from a dimensioning system displayed as virtual wireframes overlaid on real-time images of objects in a field of view, the virtual wireframes corresponding to edges of one or more surfaces of one or more objects in the dimensioning system's field of view;   identifying errors in the virtual wireframes;   reaching a hand into the dimensioning system's field of view so that it is displayed with the objects and the virtual wireframes;   selecting one of the virtual wireframes using the hand or a virtual tool enabled by the hand;   adjusting the selected virtual wireframe by moving the hand or the virtual tool; and   repeating the steps identifying, reaching, virtually selecting, and virtually adjusting until all of the errors in the virtual wireframes have been corrected.   
     
     
         19 . The method for correcting dimensioning errors using an augmented reality interface according to  claim 18 , wherein the errors in the virtual wireframes comprise (i) virtual wireframes that overlap, (ii) virtual wireframes that cover more than one object, and/or (iii) virtual wireframes that do not cover an object completely. 
     
     
         20 . The method for correcting dimensioning errors using an augmented reality interface according to  claim 18 , wherein the augmented reality interface is an optical head-mounted display worn by a user.