Robotic system with automated package registration mechanism and minimum viable region detection

Abstract

The present disclosure relates to methods and systems for generating a verified minimum viable range (MVR) of an object. An exposed outer corner and exposed edges of an object may be identified by processing one or more image data. An initial MVR may be generated by identifying opposing parallel edges opposing the exposed edges. The initial MVR may be adjusted, and the adjusted result may be tested to generate a verified MVR.

What is claimed is: 
     
         1 . A method comprising:
 receiving one or more image data representative of one or more unregistered objects;   identifying an exposed corner associated thereto based on the one or more image data, wherein the exposed corner corresponds with exposed edges of an unregistered object;   identifying complementing edges associated with the exposed edges based on identifying one or more other edges that intersect the exposed edges;   generating an initial minimum viable region (MVR) based on the exposed corner, the exposed edges, and the complementing edges.   
     
     
         2 . The method of  claim 1 , wherein:
 the exposed edges include a first exposed edge and a second exposed edge that define the exposed corner;   the complementing edges include a first initial complementing edge and a second initial complementing edge, wherein the first initial complementing edge and the second initial complementing edge are determined to be parallel to the first exposed edge and the second exposed edge, respectively; and   the method further comprises generating a verified MVR by:
 identifying a further complementing edge that intersects the first exposed edge at a location past the second initial complementing edge relative to the exposed corner, wherein the further complementing edge is determined to be parallel to the second initial complementing edge and the second exposed edge; 
 identifying an additional plausible MVR region including an area between the complementing edges and the further complementing edge; and 
 testing a candidate MVR that combines the additional plausible MVR region and the initial MVR. 
   
     
     
         3 . The method of  claim 2 , wherein testing includes verifying whether one or more dimensions of the candidate MVR satisfy a maximum and/or a minimum dimension threshold for MVRs. 
     
     
         4 . The method of  claim 2 , wherein testing includes verifying whether depth measurements, colors, brightness, or a combination thereof for portions of the one or more imaging data corresponding to the additional plausible MVR region and the initial MVR are within a threshold continuity range from each other. 
     
     
         5 . The method of  claim 2 , wherein the verified MVR includes the initial MVR without the additional plausible MVR region when the candidate MVR fails to satisfy one or more predetermined thresholds. 
     
     
         6 . The method of  claim 1 , wherein:
 the exposed edges include a first exposed edge and a second exposed edge that define the exposed corner;   the complementing edges include a first initial complementing edge and a second initial complementing edge, wherein the first initial complementing edge and the second initial complementing edge are determined to be parallel to the first exposed edge and the second exposed edge, respectively; and   the method further comprises generating a verified MVR by:
 identifying a further complementing edge between the second initial complementing edge and the exposed corner, wherein the further complementing edge is determined to be parallel to the second initial complementing edge and the second exposed edge; 
 identifying a reduced candidate MVR as an area within the initial MVR that is bounded by the further complementing edge; and 
 testing the reduced candidate MVR. 
   
     
     
         7 . The method of  claim 6 , wherein generating the verified MVR includes setting the reduced candidate MVR as the verified MVR when one or more dimensions of the candidate MVR satisfy a maximum and/or a minimum dimension threshold for MVRs. 
     
     
         8 . The method of  claim 6 , wherein identifying the further complementing edge includes:
 identifying a second corner associated with the complementing edges;   searching for an intersection with the further complementing edge while moving away from the second corner along the first initial complementing edge; and   testing an orientation of the further complementing edge based on verifying (1) that an angle between the further complementing edge and the first initial complementing edge is within a threshold range representative of a right angle and/or (2) that a set of distances between multiple sets of corresponding points along the further complementing edge and the second exposed edge are within a threshold range from each other.   
     
     
         9 . The method of  claim 6 , wherein:
 the one or more image data include (1) a 3D imaging output including depth measures for locations along a horizontal plane and (2) a 2D imaging output visually representing one or more of the unregistered objects along the horizontal plane; and   identifying the exposed edges includes:
 identifying each of the separated layers as a set of adjacent locations along the horizontal plane of the 3D imaging output that have the depth measures within a threshold range from each other, and 
 identifying peripheral boundaries of the separated layers as 3D edges; 
   identifying the exposed corner includes selecting an intersection formed by a set of the 3D edges, wherein the set of 3D edges are the exposed edges; and   identifying the further complementing edge includes identifying an incomplete edge and/or a detected line based on analyzing the 3D imaging output, the 2D imaging output, or a combination thereof.   
     
     
         10 . The method of  claim 9  wherein generating the verified MVR includes:
 identifying a 3D edge based on analyzing the 3D imaging output, wherein the 3D edge (1) is closer towards the exposed corner along the first exposed edge than the second initial complementing edge and (2) is parallel to the second initial complementing edge and the second exposed edge; 
 adjusting the initial MVR to additionally include an area between the second initial complementing edge and the 3D edge; 
 wherein:
 the further complementing edge is a result of analyzing portions of the 2D imaging output corresponding to the adjusted initial MVR; and 
 the reduced candidate MVR includes the area within the adjusted initial MVR. 
 
 
     
     
         11 . A robotic system, comprising:
 at least one processor; and   at least one memory device connected to the at least one processor and having stored thereon instructions, executable by the processor, for:
 receiving one or more image data representative of one or more unregistered objects; 
 identifying an exposed corner based on the one or more image data, wherein the exposed corner represents an unregistered object; 
 generating an initial minimum viable region (MVR) based on the exposed corner. 
   
     
     
         12 . The robotic system of  claim 11 , wherein the at least one memory device includes instructions for:
 receiving the one or more image data including 3D depth measures;   identifying the exposed corner based on:
 identifying one or more surfaces based on the 3D depth measures, wherein each of the surfaces include a set of adjacent locations having the 3D depth measures within a threshold continuity range, 
 identifying 3D edges based on the identified surfaces, wherein the 3D edges correspond to lateral boundaries of the surfaces, 
 identifying the exposed corner as a junction between a first 3D edge and a second 3D edge bounding one of the surfaces, wherein the first 3D edge and the second 3D edge correspond to the exposed edges; and 
   generating the initial MVR based on:
 identifying a first complement edge geometrically associated with the first 3D edge; and 
 identifying a second complement edge geometrically associated with the second 3D edge, 
 wherein the initial MVR includes an area bounded by the exposed edges and the first and second complement edges. 
   
     
     
         13 . The robotic system of  claim 12 , wherein the at least one memory device includes instructions for generating a verified MVR based on:
 identifying a further complement edge while moving from the second complement edge along the first 3D edge and away from the exposed corner, wherein the further complement edge, the second 3D edge, and the second complement edges are determined to be parallel to each other; and   testing a candidate MVR that combines the initial MVR and an area between further complement edge and the second complement edge according to a maximum and/or a minimum dimension threshold.   
     
     
         14 . The robotic system of  claim 13 , wherein the at least one memory device includes instructions for generating the verified MVR including the initial MVR, without the area between further complement edge and the second complement edge, when the candidate MVR fails to satisfy the maximum and/or the minimum dimension threshold. 
     
     
         15 . The robotic system of  claim 13 , wherein the at least one memory device includes instructions for generating the verified MVR including the candidate MVR when the candidate MVR satisfies the maximum and/or the minimum dimension threshold. 
     
     
         16 . A tangible, non-transitory computer-readable medium having processor instructions stored thereon that, when executed by a processor, cause the processor to:
 receive one or more image data representative of one or more unregistered objects;   identify an exposed corner based on the one or more image data, wherein the exposed corner represents an unregistered object;   generate an initial minimum viable region (MVR) based on the exposed corner.   
     
     
         17 . The non-transitory computer-readable medium of  claim 16 , further causing the processor to:
 receive the one or more image data including 3D depth measures;   identify the exposed corner based on analyzing the one or more image data according to 3D depth measures;   generate the initial MVR based on identifying a first complement edge and a second complement edge, wherein the first complement edge is an edge geometrically associated with a first exposed edge and the second complement edge is an edge geometrically associated with a second exposed edge, wherein the first and second exposed edges define the exposed corner; and   wherein:   the initial MVR includes an area bounded by the first and second exposed edges and the first and second complement edges.   
     
     
         18 . The non-transitory computer-readable medium of  claim 17 , further causing the processor to generate a verified MVR based on:
 identifying a further complement edge between the second complement edge and the exposed corner, wherein the further complement edge, the second exposed edge, and the second complement edge are determined to be parallel to each other; and   identifying a reduced candidate MVR as an area within the initial MVR that is bounded by the further complement edge instead of the second complement edge.   
     
     
         19 . The non-transitory computer-readable medium of  claim 18 , further causing the processor to identify the further complement edge based on:
 identifying a second corner diagonally opposite the exposed corner;   searching for the further complement edge while moving away from the second corner along the first complement edge; and   determining whether the further complement edge is parallel to the second exposed edge based on an angle between the further complement edge and the first complement edge and/or a set of distances between multiple sets of corresponding points along the further complement edge and the second exposed edge.   
     
     
         20 . The non-transitory computer-readable medium of  claim 17 , further causing the processor to generate a verified MVR based on:
 enlarging the initial MVR according to a first additional edge beyond one of the first exposed edge and the second exposed edge from the exposed corner, wherein the first additional edge includes a second corner opposite the exposed corner;   identifying a further complement edge based on evaluating one or more portions within the image data from the second corner to the exposed corner; and   generating the verified MVR as an area within the initial MVR that is bounded by the further complement edge instead of the second complement edge.