Method, system and computer readable medium for duplicate record detection

Abstract

A method of determining if a given record is a duplicate of one of a list of records is disclosed. A single piece of information, such as a product of prime numbers unique to each record in the list is obtained. Similarly, a unique piece of information, such as a unique prime number, is obtained for the given record. The product is divided by the unique prime number of the given record. A remainder in the division operation indicates that the given record is not a duplicate.

We claim:  
     
         1 . A method of determining if a given record is a duplicate of one of a plurality of records, the method comprising: 
 obtaining a unique piece of information for the given record; and    determining if the given record is a duplicate of one of the plurality of records by operating on the unique piece of information for the given record and a single piece of information that collectively represents the plurality of records.    
     
     
         2 . A method according to  claim 1 , further including: 
 integrating the unique piece of information for the given record into the single collective piece of information if it is determined that the given record is not a duplicate of any one of the plurality of records.    
     
     
         3 . A method according to  claim 1 , wherein obtaining a unique piece of information includes obtaining a unique piece of information defined by a unique prime number for the given record and wherein determining if the given record is a duplicate includes: 
 dividing the single collective piece of information defined by a product of similarly-obtained unique prime numbers for the plurality of records by the unique prime number associated with the given record; and    determining if the given record is a duplicate based on whether the product is divisible.    
     
     
         4 . A method according to  claim 3 , further including: 
 updating the product by multiplying it with the unique prime number associated with the given record to integrate the unique prime number into the product if it is determined that the given record is not a duplicate of any one of the plurality of records.    
     
     
         5 . A method according to  claim 3 , wherein obtaining a unique prime number for the given record and each of the plurality of record includes: 
 obtaining a unique number for a record; and    obtaining a unique prime number using the unique number obtained.    
     
     
         6 . A method according to  claim 4 , wherein obtaining a unique prime number using the unique number includes obtaining a prime number whose position in a series of ascending prime numbers is given by the unique number.  
     
     
         7 . A method according to  claim 5 , wherein obtaining a unique prime number using the unique number includes computing a prime number whose position in a series of ascending prime numbers is given by the unique number.  
     
     
         8 . A program storage device readable by a computing device, tangibly embodying a program of instructions, executable by the computing device to perform a method of determining if a given record is a duplicate of one of a plurality of records, the method comprising: 
 obtaining a unique piece of information for the given record; and    determining if the given record is a duplicate of one of the plurality of records by operating on the unique piece of information for the given record and a single piece of information that collectively represents the plurality of records.    
     
     
         9 . A program storage device according to  claim 8 , further including: 
 integrating the unique piece of information for the given record into the single piece of information if it is determined that the given record is not a duplicate of any one of the plurality of records.    
     
     
         10 . A program storage device according to  claim 8 , wherein obtaining a unique piece of information includes obtaining a unique piece of information defined by a unique prime number for the given record and wherein determining if the given record is a duplicate includes: 
 dividing the single collective piece of information defined by a product of similarly-obtained unique prime numbers for the plurality of records by the unique prime number associated with the given record; and    determining if the given record is a duplicate based on whether the product is divisible.    
     
     
         11 . A program storage device according to  claim 10 , further including: 
 updating the product by multiplying it with the unique prime number associated with the given record to integrate the unique prime number into the product if it is determined that the given record is not a duplicate of any one of the plurality of records.    
     
     
         12 . A program storage device according to  claim 10 , wherein obtaining a unique prime number for the given record and each of the plurality of record includes: 
 obtaining a unique number for a record; and    obtaining a unique prime number using the unique number obtained.    
     
     
         13 . A program storage device according to  claim 12 , wherein obtaining a unique prime number using the unique number includes obtaining a prime number whose position in a series of ascending prime numbers is given by the unique number.  
     
     
         14 . A program storage device according to  claim 13 , wherein obtaining a unique prime number using the unique number includes computing a prime number whose position in a series of ascending prime numbers is given by the unique number.  
     
     
         15 . A system for determining if a given record is a duplicate of one of a plurality of records, the system comprising: 
 means for obtaining a unique piece of information for the given record; and    means for determining if the given record is a duplicate of one of the plurality of records by operating on the unique piece of information for the given record and a single piece of information that collectively represents the plurality of records.    
     
     
         16 . A system according to  claim 15 , further including: 
 means for integrating the unique piece of information for the given record into the single piece of information if it is determined that the given record is not a duplicate of any one of the plurality of records.    
     
     
         17 . A system according to  claim 15 , wherein the means for obtaining a unique piece of information includes means for obtaining a unique piece of information defined by a unique prime number for the given record and wherein the means for determining if the given record is a duplicate includes: 
 means for dividing the single collective piece of information defined by a product of similarly-obtained unique prime numbers for the plurality of records by the unique prime number associated with the given record; and    means for determining if the given record is a duplicate based on whether the product is divisible.    
     
     
         18 . A system according to  claim 17 , further including: 
 means for updating the product by multiplying it with the unique prime number associated with the given record to integrate the unique prime number into the product if it is determined that the given record is not a duplicate of any one of the plurality of records.