Rating system

Abstract

The invention is an evaluation system for artificial intelligence (AI) software. The AI software receives a query, generates a response, and communicate the response back to the querying computer. Using a database of stock queries and accuracy responses, an evaluating computer presents these stock queries to the AI software and compares the AI response to the accuracy responses in determining how accurate/biased the AI software is.

What is claimed is: 
     
         1 . A system of computers comprising:
 a) a first computer configured to operate artificial intelligence software therein;   b) a second computer having a database of identities of computers having artificial intelligence software and associated accuracy data, said second computer communicating the associated accuracy data and inquiring query to a querying computer;   c) the querying computer, presenting the inquiring query to the artificial intelligence software of the first computer and receiving an AI response thereto; and,   d) whereas the second computer
 1) Withdraws a chosen query and associated accuracy data from a database, 
 2) Presents the chosen query to the artificial intelligence software of the first computer, 
 3) Receives a response to the chosen query from the artificial software of the first computer 
 4) With the response from the artificial intelligence software of the first computer, compares the response with the associated accuracy data; 
 5) Creates the accuracy evaluation for the artificial intelligence of the first computer; and, 
 6) Communicates the accuracy data of the artificial intelligence software of the first computer to the second computer. 
   
     
     
         2 . The system of computers according to  claim 1 , wherein the chosen query used by the querying computer is established by a user of a remote computer and communicated to the querying computer from the second computer. 
     
     
         3 . The system of computers according to  claim 1 , wherein,
 a) The inquiring query is communicated by the querying computer to the first computer; and,   b) the accuracy evaluation is determined in response to the inquiring query.