Real-time data storage and analytics system

Abstract

Systems and methods are provided for storing, sorting, and analyzing account transactions in a payment network, and for real-time data analytics. One embodiment of a real-time data storage and analytics system includes a payment network that collects and processes account transactions. The system also includes a first data cluster that includes a first data structure. The first data structure stores a set of the account transactions. Additionally, the system includes a second data cluster that in turn includes a second data structure. The second data structure stores account transactions for new account and account transactions for which there is insufficient space in the first data structure. Moreover, the system includes an application engine that generates a score for an account based on transaction data associated with the account transactions for the account.

What is claimed is: 
     
         1 . A real-time data storage and analytics system, comprising:
 a payment network that collects and processes account transactions;   a first data cluster comprising a first data structure that stores a set of the account transactions;   a second data cluster comprising a second data structure that stores account transactions for new accounts, and that stores the account transactions for which there is insufficient space in the first data structure; and   an application engine that generates a score for an account based on transaction data associated with the account transactions for the account.   
     
     
         2 . The real-time data storage and analytics system of  claim 1 , wherein the first and second data structures comprise a validation code for each of the accounts. 
     
     
         3 . The real-time data storage and analytics system of  claim 1 , wherein the account transactions originate with point-of-service terminals. 
     
     
         4 . The real-time data storage and analytics system of  claim 1 , wherein the payment network reconstructs the first data structure according to a first periodicity, and wherein the payment network reconstructs the second data structure according to a second periodicity. 
     
     
         5 . The real-time data storage and analytics system of  claim 4 , wherein the payment network determines numbers of reserved spaces to include in the first data structure based on the second periodicity. 
     
     
         6 . The real-time data storage and analytics system of  claim 1 , wherein the transaction data is drawn from one or more of the first and second data clusters. 
     
     
         7 . The real-time data storage and analytics system of  claim 1 , wherein the first and second data clusters are Hadoop clusters. 
     
     
         8 . The real-time data storage and analytics system of  claim 1 , wherein the application engine transmits the score to a purchaser terminal associated with the account. 
     
     
         9 . A non-transitory computer-readable medium having computer-executable program code embodied thereon, the computer-executable program code configured to cause a payment network to:
 receive and process account transactions associated with one or more accounts;   construct first and second data structures, the first data structure comprising a set of first reserved spaces for each of the accounts, the second data structure comprising a set of second reserved spaces for each of the accounts;   store a first set of the account transactions in the set of reserved spaces for each of the accounts and a second set of the account transactions in the second set of reserved spaces for each of the accounts; and   determine respective sizes of the sets of first and second sets of reserved spaces for each of the accounts, based on historical data related to the account transactions associated with the accounts.   
     
     
         10 . The non-transitory computer-readable medium of  claim 9 , wherein the computer-executable program code is further configured to cause the payment network to store the second set of the account transactions in the second set of reserved spaces only if the payment network is unable to store the second set of account transactions in the set of first reserved spaces, or only if no account associated with an account transaction of the second set of account transactions is associated with an account transaction of the first set of account transactions. 
     
     
         11 . The non-transitory computer-readable medium of  claim 9 , wherein the historical data comprises the number of account transactions that occurred over a time period. 
     
     
         11 . The non-transitory computer-readable medium of  claim 9 , wherein the computer-executable program code is further configured to cause the payment network to determine the size of the first set of reserved spaces for each of the accounts further based on a frequency with which the first data structure is reconstructed. 
     
     
         12 . The non-transitory computer-readable medium of  claim 9 , wherein the computer-executable program code is further configured to cause the payment network to create and update a third data structure, comprising pointers to transaction files associated with the accounts in the first and second data structures. 
     
     
         13 . The non-transitory computer-readable medium of  claim 9 , wherein the first and second data structures comprise a validation code for each of the accounts. 
     
     
         14 . The non-transitory computer-readable medium of  claim 9 , wherein the account transactions originate with point-of-service terminals. 
     
     
         15 . The non-transitory computer-readable medium of  claim 9 , wherein the payment network reconstructs the first data structure according to a first periodicity, and wherein the payment network reconstructs the second data structure according to a second periodicity. 
     
     
         16 . The non-transitory computer-readable medium of  claim 15 , wherein the payment network determines numbers of reserved spaces to include in the first data structure based on the second periodicity. 
     
     
         17 . The non-transitory computer-readable medium of  claim 9 , wherein the transaction data is drawn from one or more of the first and second data clusters. 
     
     
         18 . The non-transitory computer-readable medium of  claim 9 , wherein the first and second data clusters are Hadoop clusters.