Monitoring a stale data queue for deletion events

Abstract

A computer-implemented method, system, and computer-readable media are disclosed herein. In embodiments, the computer-implemented method may entail receiving, by a data service, live data associated with an entity. The entity may be, for example, a customer of the data service. The method may then route the live data to a dual-queue system of the data service. The live data may be loaded into a live data queue of the dual queue system for processing. Processing may entail generating summary statistics from the live data. An alert may then be transmitted to the customer in response to detecting the occurrence of one or more alert events. In embodiments, the alert events may include events identified in the summary statistics. Additional embodiments are described and/or claimed.

The invention claimed is: 
     
         1 . A computer-implemented method comprising:
 loading live data, associated with an entity, into a live data queue of a dual-queue system for processing of the live data;   storing a persistent backup of the live data in a stale data queue of the dual-queue system as stale data;   monitoring the stale data queue to determine an occurrence of a deletion event; and   based on the occurrence of the deletion event, deleting at least a portion of the stale data in the stale data queue of the dual-queue system.   
     
     
         2 . The computer-implemented method of  claim 1 , wherein determining the occurrence of the deletion event comprises determining the stale data exceeds a threshold of age. 
     
     
         3 . The computer-implemented method of  claim 1 , wherein determining the occurrence of the deletion event comprises determining a cumulative size of the stale data exceeds a threshold. 
     
     
         4 . The computer-implemented method of  claim 1 , wherein determining the occurrence of the deletion event comprises determining an amount of available space in the stale data queue is at or below a predefined threshold. 
     
     
         5 . The computer-implemented method of  claim 1 , wherein determining the occurrence of the deletion event comprises determining an amount of available space in the stale data queue is at or below a predefined threshold that is dynamically adjusted based on resource availability of a multi-tenant system. 
     
     
         6 . The computer-implemented method of  claim 1 , further comprising determining the at least the portion of the stale data in the stale data queue to delete. 
     
     
         7 . The computer-implemented method of  claim 1 , further comprising determining the at least the portion of the stale data in the stale data queue to delete based on age of the stale data. 
     
     
         8 . The computer-implemented method of  claim 1 , further comprising determining the at least the portion of the stale data in the stale data queue to delete based on priorities assigned to the stale data. 
     
     
         9 . The computer-implemented method of  claim 1 , further comprising determining the at least the portion of the stale data in the stale data queue to delete based on priorities assigned to the stale data. 
     
     
         10 . The computer-implemented method of  claim 1 , further comprising providing an indication of the occurrence of the deletion event. 
     
     
         11 . The computer-implemented method of  claim 1 , further comprising providing a warning that includes one or more of an indication of the occurrence of the deletion event, an indication to download the stale data from the stale data queue, an amount of the stale data deleted or to be deleted from the stale data queue, and a statistic related to the stale data deleted or to be deleted. 
     
     
         12 . The computer-implemented method of  claim 1 , further comprising initializing a new stale data queue. 
     
     
         13 . The computer-implemented method of  claim 1 , further comprising initializing a new stale data queue by allocating the new stale data queue in a new partition of a persistent data store. 
     
     
         14 . The computer-implemented method of  claim 1 , further comprising:
 initializing a new stale data queue;   receiving new live data; and   backing up the new live data in the new stale data queue.   
     
     
         15 . A computing system comprising:
 one or more processors; and   one or more computer-readable storage media containing instructions which, in response to execution by the one or more processors, cause the one or more processors to perform actions including:
 loading live data, associated with an entity, into a live data queue of a dual-queue system for processing of the live data; 
 storing a persistent backup of the live data in a stale data queue of the dual-queue system as stale data; 
 monitoring the stale data queue to determine an occurrence of a deletion event; and 
 based on the occurrence of the deletion event, deleting at least a portion of the stale data in the stale data queue of the dual-queue system. 
   
     
     
         16 . One or more non-transitory computer-storage media having executable instructions, which, when executed by a computing device, cause the computing device to performs actions comprising:
 loading live data, associated with an entity, into a live data queue of a dual-queue system for processing of the live data;   storing a persistent backup of the live data in a stale data queue of the dual-queue system as stale data;   monitoring the stale data queue to determine an occurrence of a deletion event; and   based on the occurrence of the deletion event, deleting at least a portion of the stale data in the stale data queue of the dual-queue system.   
     
     
         17 . The one or more computer-storage media of  claim 16 , wherein determining the occurrence of the deletion event comprises determining the stale data exceeds a threshold of age. 
     
     
         18 . The one or more computer-storage media of  claim 16 , wherein determining the occurrence of the deletion event comprises determining a cumulative size of the stale data exceeds a threshold. 
     
     
         19 . The one or more computer-storage media of  claim 16 , wherein determining the occurrence of the deletion event comprises determining an amount of available space in the stale data queue is at or below a predefined threshold. 
     
     
         20 . The one or more computer-storage media of  claim 16 , wherein determining the occurrence of the deletion event comprises determining an amount of available space in the stale data queue is at or below a predefined threshold that is dynamically adjusted based on resource availability of a multi-tenant system.