System and method for improving assembly line processes

Abstract

Aspects of the disclosed technology provide an Artificial Intelligence Process Control (AIPC) for automatically detecting errors in a manufacturing workflow of an assembly line process, and performing error mitigation through the update of instructions or guidance given to assembly operators at various stations. In some implementations, the disclosed technology utilizes one or more machine-learning models to perform error detection and/or propagate instructions/assembly modifications necessary to rectify detected errors or to improve the product of manufacture.

What is claimed is: 
     
         1 . A method, comprising:
 receiving, by a computing system, video data of an operator interacting with a component at an operator station;   analyzing, by the computing system, the video data to isolate the component and movements of the operator while interacting with the component;   evaluating, by the computing system, properties of the component based on the video data;   evaluating, by the computing system, the movements of the operator based on the video data; and   generating, by the computing system, a quality score for the component based on the properties of the component and the movements of the operator.   
     
     
         2 . The method of  claim 1 , wherein evaluating, by the computing system, the movements of the operator based on the video data comprises:
 comparing the movements of the operator to an idealized motion profile of the operator to identify a deviation from manufacturing instructions.   
     
     
         3 . The method of  claim 1 , wherein evaluating, by the computing system, the properties of the component based on the video data comprises:
 detecting one or more anomalies present in the component.   
     
     
         4 . The method of  claim 1 , wherein evaluating, by the computing system, the properties of the component based on the video data comprises:
 detecting one or more changes in a surface of the component.   
     
     
         5 . The method of  claim 1 , further comprising:
 based on the quality score, generating, by the computing system, updated manufacturing instructions.   
     
     
         6 . The method of  claim 5 , wherein the updated manufacturing instructions are provided to the operator at the operator station to cause the operator to implement the updated manufacturing instructions. 
     
     
         7 . The method of  claim 5 , wherein the updated manufacturing instructions are provided to an operator at a second operator station downstream of the operator station. 
     
     
         8 . A non-transitory computer readable medium comprising one or more sequences of instructions, which, when executed by a processor, causes a computing system to perform operations comprising:
 receiving, by the computing system, video data of an operator interacting with a component at an operator station;   analyzing, by the computing system, the video data to isolate the component and movements of the operator while interacting with the component;   evaluating, by the computing system, properties of the component based on the video data;   evaluating, by the computing system, the movements of the operator based on the video data; and   generating, by the computing system, a quality score for the component based on the properties of the component and the movements of the operator.   
     
     
         9 . The non-transitory computer readable medium of  claim 8 , wherein evaluating, by the computing system, the movements of the operator based on the video data comprises:
 comparing the movements of the operator to an idealized motion profile of the operator to identify a deviation from manufacturing instructions.   
     
     
         10 . The non-transitory computer readable medium of  claim 8 , wherein evaluating, by the computing system, the properties of the component based on the video data comprises:
 detecting one or more anomalies present in the component.   
     
     
         11 . The non-transitory computer readable medium of  claim 8 , wherein evaluating, by the computing system, the properties of the component based on the video data comprises:
 detecting one or more changes in a surface of the component.   
     
     
         12 . The non-transitory computer readable medium of  claim 8 , further comprising:
 based on the quality score, generating, by the computing system, updated manufacturing instructions.   
     
     
         13 . The non-transitory computer readable medium of  claim 12 , wherein the updated manufacturing instructions are provided to the operator at the operator station to cause the operator to implement the updated manufacturing instructions. 
     
     
         14 . The non-transitory computer readable medium of  claim 12 , wherein the updated manufacturing instructions are provided to an operator at a second operator station downstream of the operator station. 
     
     
         15 . A system, comprising:
 a processor; and   a memory having programming instructions stored thereon, which, when executed by the processor, causes the system to perform operations comprising:   receiving video data of an operator interacting with a component at an operator station;   analyzing the video data to isolate the component and movements of the operator while interacting with the component;   evaluating properties of the component based on the video data;   evaluating the movements of the operator based on the video data; and   generating a quality score for the component based on the properties of the component and the movements of the operator.   
     
     
         16 . The system of  claim 15 , wherein evaluating the movements of the operator based on the video data comprises:
 comparing the movements of the operator to an idealized motion profile of the operator to identify a deviation from manufacturing instructions.   
     
     
         17 . The system of  claim 15 , wherein evaluating the properties of the component based on the video data comprises:
 detecting one or more anomalies present in the component.   
     
     
         18 . The system of  claim 15 , wherein evaluating the properties of the component based on the video data comprises:
 detecting one or more changes in a surface of the component.   
     
     
         19 . The system of  claim 15 , further comprising:
 based on the quality score, generating updated manufacturing instructions.   
     
     
         20 . The system of  claim 19 , wherein the updated manufacturing instructions are provided to one or more of:
 the operator at the operator station to cause the operator to implement the updated manufacturing instructions; or   a second operator at a second operator station downstream of the operator station.