Data privacy pipeline providing collaborative intelligence and constraint computing

Abstract

Embodiments of the present disclosure are directed to techniques for deriving collaborative intelligence based on constraint computing or constraint querying. At a high level, a data trustee can operate a trustee environment that derives collaborative intelligence subject to configurable constraints, without sharing raw data. The trustee environment can include a data privacy pipeline through which data can be ingested, fused, derived, and sanitized to generate collaborative data without compromising data privacy. The collaborative data can be stored and queried to provide collaborative intelligence subject to the configurable constraints. In some embodiments, the data privacy pipeline is provided as a cloud service implemented in the trustee environment and can be spun up and spun down as needed.

What is claimed is: 
     
         1 . A computer system comprising one or more processors and memory configured to provide computer program instructions to the one or more processors, the computer program instructions including:
 a cloud service application configured to spin up a data pipeline of computations that ingest input datasets into a data trustee environment and derive collaborative data from the input datasets, the data pipeline of computations and constraints on the computations specified by a tenant agreement among collaborating tenants; and   a constraint manager configured to orchestrate permission to execute the computations based at least on tracking application of the constraints as data flows through the computations of the data pipeline.   
     
     
         2 . The computer system  claim 1 , wherein the constraints specified by the tenant agreement include an aggregation constraint, and the constraint manager is configured to orchestrate applying the aggregation constraint on a first computation of the computations and not applying the aggregation constraint on subsequent computations of the computations. 
     
     
         3 . The computer system  claim 1 , wherein the constraints specified by the tenant agreement include different constraints applicable to different input datasets, one of the computations specified by the tenant agreement is a merging operation that merges the different input datasets, and the constraint manager is configured to instruct application of a stricter constraint of the different constraints during the merging operation. 
     
     
         4 . The computer system  claim 1 , wherein the data pipeline is configured to associate attribution metadata indicating ownership or providence of the data generated by the computations of the data pipeline as the data flows through the computations of the data pipeline. 
     
     
         5 . The computer system  claim 1 , wherein the data pipeline is configured to delete intermediate data generated by the computations of the data pipeline upon generating the collaborative data. 
     
     
         6 . The computer system  claim 1 , wherein the data pipeline is configured to determine whether to store the collaborative data in the data trustee environment or output the collaborate data from the data trustee environment based on a corresponding one of the constraints specified by the tenant agreement. 
     
     
         7 . The computer system  claim 1 , wherein the computations of the data pipeline are configured to output a corresponding schema specified by the tenant agreement. 
     
     
         8 . The computer system  claim 1 , wherein the constraint manager is configured to orchestrate enforcement of a sanitation constraint, specified by the tenant agreement and requiring sanitation of values coming from one or more fields of the input datasets, based at least on tracking transformation applied to the values by the computations of the data pipeline as the data flows through the computations of the data pipeline. 
     
     
         9 . One or more computer storage media storing computer-useable instructions that, when used by one or more computing devices, cause the one or more computing devices to perform operations comprising:
 spinning up a data pipeline of computations that ingest input datasets into a data trustee environment and derives collaborative data from the input datasets, the data pipeline of computations and constraints on the computations specified by a tenant agreement among tenants; and   orchestrating permission to execute the computations based at least on tracking whether or not each of the constraints has been satisfied as data flows through the computations of the data pipeline.   
     
     
         10 . The one or more computer storage media of  claim 9 , wherein the constraints specified by the tenant agreement include an aggregation constraint, the operations further comprising orchestrating applying the aggregation constraint on a first computation of the computations and not applying the aggregation constraint on subsequent computations of the computations. 
     
     
         11 . The one or more computer storage media of  claim 9 , wherein the constraints specified by the tenant agreement include different constraints applicable to different input datasets, one of the computations specified by the tenant agreement is a merging operation that merges the different input datasets, and the operations further comprise instructing application of a stricter constraint of the different constraints during the merging operation. 
     
     
         12 . The one or more computer storage media of  claim 9 , wherein the data pipeline is configured to associate attribution metadata indicating ownership or providence of the data generated by the computations of the data pipeline as the data flows through the computations of the data pipeline. 
     
     
         13 . The one or more computer storage media of  claim 9 , wherein the data pipeline is configured to delete intermediate data generated by the computations of the data pipeline upon generating the collaborative data. 
     
     
         14 . The one or more computer storage media of  claim 9 , wherein the data pipeline is configured to determine whether to store the collaborative data in the data trustee environment or output the collaborate data from the data trustee environment based on a corresponding one of the constraints specified by the tenant agreement. 
     
     
         15 . The one or more computer storage media of  claim 9 , wherein the computations of the data pipeline are configured to output a corresponding schema specified by the tenant agreement. 
     
     
         16 . The one or more computer storage media of  claim 9 , the operations further comprising orchestrating enforcement of a sanitation constraint, specified by the tenant agreement and requiring sanitation of values coming from one or more fields of the input datasets, based at least on tracking transformation applied to the values by the computations of the data pipeline as the data flows through the computations of the data pipeline. 
     
     
         17 . A method comprising:
 executing a data pipeline of computations that ingest input datasets into a data trustee environment and derives collaborative data from the input datasets, the data pipeline of computations and constraints on the computations specified by a tenant agreement among tenants; and   orchestrating permission to execute the computations based at least on tracking whether or not each of the constraints has been satisfied as data flows through the computations of the data pipeline.   
     
     
         18 . The method of  claim 17 , wherein the constraints specified by the tenant agreement include an aggregation constraint, the method further comprising orchestrating applying the aggregation constraint on a first computation of the computations and not applying the aggregation constraint on subsequent computations of the computations. 
     
     
         19 . The method of  claim 17 , wherein the constraints specified by the tenant agreement include different constraints applicable to different input datasets, one of the computations specified by the tenant agreement is a merging operation that merges the different input datasets, and the method further comprises instructing application of a stricter constraint of the different constraints during the merging operation. 
     
     
         20 . The method of  claim 17 , wherein the data pipeline is configured to associate attribution metadata indicating ownership or providence of the data generated by the computations of the data pipeline as the data flows through the computations of the data pipeline.