Vision inspection system and method for vehicle manufacturing

Abstract

A vision inspection system for vehicle manufacturing includes an appearance defect vision inspection apparatus configured to inspect appearance defects based on product image data captured by a camera, a data storage configured to store inspection data comprising the product image data and determination result data of an appearance defect inspection, and an AI retraining support inspection apparatus configured to identify incorrect determination data among the determination result data using teaching AI models based on the inspection data and the determination result data input from the data storage, and update the appearance defect vision inspection AI model of the appearance defect vision inspection apparatus through a model retraining process performed based on the identified incorrect determination data.

What is claimed is: 
     
         1 . A vision inspection system for vehicle manufacturing, the visual inspection system comprising:
 an appearance defect vision inspection apparatus configured to inspect appearance defects using an appearance defect vision inspection artificial intelligence (AI) model based on product image data captured by a camera;   a data storage configured to store inspection data comprising the product image data and determination result data of an appearance defect inspection; and   an AI retraining support inspection apparatus configured to identify incorrect determination data among the determination result data based on the inspection data and the determination result data input from the data storage, and update the appearance defect vision inspection AI model of the appearance defect vision inspection apparatus through a model retraining process performed based on the identified incorrect determination data.   
     
     
         2 . The vision inspection system of  claim 1 , wherein the camera is a vision camera. 
     
     
         3 . The vision inspection system of  claim 1 , wherein the appearance defect inspection is carried out by the appearance defect inspection AI model. 
     
     
         4 . The vision inspection system of  claim 1 , wherein the incorrect determination data is identified using teaching AI models. 
     
     
         5 . The vision inspection system of  claim 1 , wherein the AI retraining support inspection apparatus comprises:
 a teaching AI model unit configured to determine whether there are appearance defects of a product and defective states thereof based on the inspection data, acquire and identify the incorrect determination data based on determination results as to whether there are the appearance defects of the product and the defective states thereof and the determination result data by the appearance defect vision inspection apparatus input from the data storage, and correct the identified incorrect determination data.   
     
     
         6 . The vision inspection system of  claim 5 , further comprising:
 binary classification teaching AI models provided to acquire the incorrect determination data by determining whether determination results by the appearance defect vision inspection apparatus are incorrectly determined based on the determination results as to whether there are the appearance defects of the product and the defective states thereof by the teaching AI model unit and the determination result data by the appearance defect vision inspection apparatus, and identify the acquired incorrect determination data; and   a multiclass classification teaching AI model configured to correct the identified incorrect determination data and assign a label for each defect type to actually defective data among the corrected data.   
     
     
         7 . The vision inspection system of  claim 5 , wherein the AI retraining support inspection apparatus further comprises:
 a data filtering unit configured to filter the identified incorrect determination data and actually defective data among the corrected data to construct a data set to be used for model retraining; and   a model retraining unit configured to retrain and modify the appearance defect vision inspection AI model based on the data set constructed by the data filtering unit.   
     
     
         8 . The vision inspection system of  claim 5 , wherein the AI retraining support inspection apparatus further comprises:
 a data preprocessing unit configured to receive the inspection data and the determination result data from the data storage and convert the inspection data and the determination result data into a form processible by the teaching AI models.   
     
     
         9 . The vision inspection system of  claim 1 , wherein the AI retraining support inspection apparatus is provided to transmit the appearance defect vision inspection AI model modified through the model retraining process to the appearance defect vision inspection apparatus to update the appearance defect vision inspection AI model of the appearance defect vision inspection apparatus. 
     
     
         10 . A vehicle manufacturing assembly comprising the vision inspection system of  claim 1 . 
     
     
         11 . A vision inspection method for vehicle manufacturing, the visual inspection method comprising:
 inspecting, by an appearance defect vision inspection apparatus, appearance defects using an appearance defect vision inspection artificial intelligence (AI) model based on product image data captured by a camera;   transmitting inspection data comprising the product image data and determination result data of an appearance defect inspection to a data storage so that the data storage stores the inspection data and the determination result data; and   identifying, by an AI retraining support inspection apparatus, incorrect determination data among the determination result data using teaching AI models based on the inspection data and the determination result data input from the data storage, and updating the appearance defect vision inspection AI model of the appearance defect vision inspection apparatus through a model retraining process performed based on the identified incorrect determination data.   
     
     
         12 . The vision inspection system of  claim 11 , wherein the camera is a vision camera. 
     
     
         13 . The vision inspection system of  claim 11 , wherein the appearance defect inspection is carried out by the appearance defect inspection AI model. 
     
     
         14 . The vision inspection system of  claim 11 , wherein the incorrect determination data is identified using teaching AI models. 
     
     
         15 . The vision inspection method of  claim 11 , wherein the AI retraining support inspection apparatus determines whether there are appearance defects of a product and defective states thereof based on the inspection data, acquires and identifies the incorrect determination data based on determination results as to whether there are the appearance defects of the product and the defective states thereof and the determination result data by the appearance defect vision inspection apparatus input from the data storage, corrects the identified incorrect determination data, and then performs the model retraining process using the identified incorrect determination data and the corrected data. 
     
     
         16 . The vision inspection method of  claim 15 , wherein the teaching AI models comprise:
 binary classification teaching AI models provided to acquire the incorrect determination data by determining whether determination results by the appearance defect vision inspection apparatus are incorrectly determined based on the determination results as to whether there are the appearance defects of the product and the defective states thereof by the teaching AI retraining support inspection apparatus and the determination result data by the appearance defect vision inspection apparatus, and identify the acquired incorrect determination data; and   a multiclass classification teaching AI model configured to correct the identified incorrect determination data and assign a label for each defect type to actually defective data among the corrected data.   
     
     
         17 . The vision inspection method of  claim 15 , wherein the AI retraining support inspection apparatus:
 filters the identified incorrect determination data and actually defective data among the corrected data to construct a data set to be used for model retraining; and   retrains and modifies the appearance defect vision inspection AI model based on the data set.   
     
     
         18 . The vision inspection method of  claim 15 , wherein the AI retraining support inspection apparatus receives the inspection data and the determination result data from the data storage, converts the inspection data and the determination result data into a form processible by the teaching AI models, and then uses the converted data in the teaching AI models. 
     
     
         19 . The vision inspection method of  claim 11 , wherein the AI retraining support inspection apparatus transmits the appearance defect vision inspection AI model modified through the model retraining process to the appearance defect vision inspection apparatus to update the appearance defect vision inspection AI model of the appearance defect vision inspection apparatus. 
     
     
         20 . A vehicle manufacturing method comprising the vehicle inspection method of  claim 11 .