Quota management in a dataset management system

Abstract

Systems and methods for controlling access to a dataset management system using quotas are provided. For example, a request to perform an action in a dataset management system may be obtained from an entity, and a quota record associated with the entity may be selected. Further, it may be determined if the entity has sufficient quota to perform the action. In some examples, when the entity has sufficient quota to perform the action, the request may be allowed. In some examples, when the entity has insufficient quota to perform the action, the request may be denied.

1 - 20 . (canceled) 
     
     
         21 . A system for controlling access to a dataset management system using quotas, the system comprising:
 at least one processor configured to:
 receive from an external entity a request to perform an action involving accessing information stored in a dataset management system, the information including a record of annotations; 
 based on an identity of the external entity, select a quota record associated with the external entity of a plurality of quota records; 
 based on the selected quota record, determine whether the external entity has sufficient quota to perform the action; 
 select at least one substitute record of annotations of a plurality of alternative records of annotations based on a similarity between the record of annotations and the at least one substitute record of annotations; and 
 based on determining that the external entity has an insufficient quota, provide an indication to the external entity, the indication including a suggestion of the at least one substitute record of annotations. 
   
     
     
         22 . The system of  claim 21 , wherein performing the action comprises training a machine learning algorithm using the information from the dataset management system. 
     
     
         23 . The system of  claim 21 , determining whether the external entity has sufficient quota to perform the action comprises:
 estimating at least one resource requirement associated with performing the action using the information from the dataset management system; and   determining whether the external entity has sufficient quota to perform the action using the information from the dataset management system based on the estimation of the at least one resource requirement.   
     
     
         24 . The system of  claim 23 , wherein determining whether the external entity has sufficient quota to perform the action comprises:
 estimating a distribution of resource requirements associated with performing the action using the information from the dataset management system;   estimating a probability that the external entity has sufficient quota to perform the action using the information based on the estimated distribution of resource requirements and the selected quota record associated with the external entity and the machine learning algorithm; and   determining whether the external entity has sufficient quota to perform the action using the information from the dataset management system based on the estimated probability.   
     
     
         25 . The system of  claim 24 , wherein estimating the distribution of resource requirements comprises:
 receiving at least one characteristic of one or more processing devices; and   estimating the distribution of resource requirements based on the at least one characteristic of the one or more processing devices.   
     
     
         26 . The system of  claim 25 , wherein the at least one processor is further configured to:
 select at least one processing device of the one or more processing devices based on the estimation of the distribution of resource requirements; and   cause the selected at least one processing device to perform the action using the information from the dataset management system.   
     
     
         27 . The system of  claim 23 , wherein estimating the at least one resource requirement associated with training the machine learning algorithm using the information from the dataset management system comprises:
 receiving at least one characteristic of one or more processing devices; and   estimating the at least one resource requirement associated with performing the action using the information from the dataset management system based on the at least one characteristic of the one or more processing devices.   
     
     
         28 . The system of  claim 27 , wherein the at least one processor is further configured to:
 select at least one processing device of the one or more processing devices based on the estimated at least one resource requirement associated with performing the action using the information from the dataset management system; and   cause the selected at least one processing device to perform the action using the information from the dataset management system.   
     
     
         29 . The system of  claim 27 , wherein the at least one processor is further configured to perform the action using the information from the dataset management system, based on determining that the external entity has sufficient quota. 
     
     
         30 . The system of  claim 21 , wherein the at least one processor is further configured to update the quota record based on determining that the external entity has sufficient quota. 
     
     
         31 . A method controlling access through a computer network to a dataset management system using quotas, the method comprising:
 receiving from an external entity a request to perform an action involving accessing information stored in a dataset management system, the information including a record of annotations;   based on an identity of the external entity, selecting a quota record associated with the external entity of a plurality of quota records;   based on the selected quota record, determining whether the external entity has sufficient quota to perform the action;   selecting at least one substitute record of annotations of a plurality of alternative records of annotations based on a similarity between the record of annotations and the at least one substitute record of annotations; and   based on determining that the external entity has an insufficient quota, providing an indication to the external entity, the indication including a suggestion of the at least one substitute record of annotations.   
     
     
         32 . The method of  claim 31 , wherein performing the action comprises training a machine learning algorithm using the information from the dataset management system. 
     
     
         33 . The method of  claim 31 , determining whether the external entity has sufficient quota to perform the action comprises:
 estimating at least one resource requirement associated with performing the action using the information from the dataset management system; and   determining whether the external entity has sufficient quota to perform the action using the information from the dataset management system based on the estimation of the at least one resource requirement.   
     
     
         34 . The method of  claim 31 , wherein determining whether the external entity has sufficient quota to perform the action comprises:
 estimating a distribution of resource requirements associated with performing the action using the information from the dataset management system;   estimating a probability that the external entity has sufficient quota to perform the action using the information based on the estimated distribution of resource requirements and the selected quota record associated with the external entity and the machine learning algorithm; and   determining whether the external entity has sufficient quota to perform the action using the information from the dataset management system based on the estimated probability.   
     
     
         35 . The method of  claim 34 , wherein estimating the distribution of resource requirements comprises:
 receiving at least one characteristic of one or more processing devices; and   estimating the distribution of resource requirements based on the at least one characteristic of the one or more processing devices.   
     
     
         36 . The method of  claim 35 , further comprising:
 selecting at least one processing device of the one or more processing devices based on the estimation of the distribution of resource requirements; and   causing the selected at least one processing device to perform the action using the information from the dataset management system.   
     
     
         37 . The method of  claim 33 , wherein estimating the at least one resource requirement associated with training the machine learning algorithm using the information from the dataset management system comprises:
 receiving at least one characteristic of one or more processing devices; and   estimating the at least one resource requirement associated with performing the action using the information from the dataset management system based on the at least one characteristic of the one or more processing devices.   
     
     
         38 . The method of  claim 37 , further comprising:
 selecting at least one processing device of the one or more processing devices based on the estimated at least one resource requirement associated with performing the action using the information from the dataset management system; and   causing the selected at least one processing device to perform the action using the information from the dataset management system.   
     
     
         39 . The method of  claim 37 , further comprising perform the action using the information from the dataset management system, based on determining that the external entity has sufficient quota. 
     
     
         40 . A non-transitory computer-readable medium storing instructions that, when executed by at least one processor, are configured to cause a system to perform a process for controlling access through a computer network to a dataset management system using quotas, the process comprising:
 receiving from an external entity a request to perform an action involving accessing information stored in a dataset management system, the information including a record of annotations;   based on an identity of the external entity, selecting a quota record associated with the external entity of a plurality of quota records;   based on the selected quota record, determining whether the external entity has sufficient quota to perform the action;   selecting at least one substitute record of annotations of a plurality of alternative records of annotations based on a similarity between the record of annotations and the at least one substitute record of annotations; and   
       based on determining that the external entity has an insufficient quota, providing an indication to the external entity, the indication including a suggestion of the at least one substitute record of annotations.