Formatting and storage of genetic markers

Abstract

The disclosed embodiments concern methods, apparatus, systems, and computer program products for storing and retrieving genetic data for individuals. In some implementations, a storage format is provided that allows genetic data to be defined by metadata for reproduce-ability.

What is claimed is: 
     
         1 . A method of providing information from one or more files to a database having a table, the method comprising:
 receiving, by a processor from a storage device, one or more files comprising imputed genetic data for one or more individuals, wherein the imputed genetic data is in a columnar format, and wherein the imputed genetic data includes markers for each of the one or more individuals;   transposing, by the processor, the imputed genetic data from the one or more files for each of the one or more individuals from columnar format to a plurality of rows; and   sending, by the processor, the transposed imputed genetic data to the storage device to be stored in the database with a column corresponding to each of the markers for each of the one or more individuals and a row for each of the one or more individuals.   
     
     
         2 . The method of  claim 1 , wherein the imputed genetic data includes greater than about 50 million markers for each of the one or more individuals. 
     
     
         3 . The method of  claim 1 , wherein the storage device comprises a magnetic tape, a flash memory, a PC-CARD, a portable mass storage device, a holographic storage device, a hard disk drive, a hard disk, a floppy disk, a magnetic tape, an optical media, a magneto-optical media, an application-specific integrated circuit (ASIC), a programmable logic device (PLD), a read-only memory (ROM), or a random-access memory (RAM). 
     
     
         4 . The method of  claim 1 , wherein the storage device comprises a cloud server. 
     
     
         5 . The method of  claim 4 , wherein sending the transposed imputed genetic data to the storage device comprises outputting information to the storage device via a network interface. 
     
     
         6 . The method of  claim 1 , wherein the database includes greater than about 10 million individuals and greater than about 10 million rows. 
     
     
         7 . The method of  claim 1 , further comprising:
 accessing, by the processor, a row of user data for an individual; and   generating, by the processor, user facing content for the individual based on the accessed user data.   
     
     
         8 . The method of  claim 1 , further comprising:
 accessing, by the processor, the database to identify genetic data for a plurality of the one or more individuals having one or more preselected phenotypes;   assembling, by the processor, a cases cohort comprising a first plurality of individuals having the one or more preselected phenotypes;   assembling, by the processor, a control cohort comprising a second plurality of individuals not in the cases cohort; and   performing, by the processor, a genome wide association study (GWAS) based on the genetic data from the database for individuals in the cases cohort and control cohort.   
     
     
         9 . The method of  claim 1 , further comprising, prior to receiving one or more files:
 imputing, by the processor, the genetic data of the one or more individuals; and   sending, by the processor, the imputed genetic data to the storage device to be stored in the one or more files.   
     
     
         10 . The method of  claim 9 , wherein sending the imputed genetic data in the one or more files is done in one or more batches. 
     
     
         11 . The method of  claim 1 , wherein sending the transposed imputed genetic data to the storage device to be stored in the database is done in one or more batches. 
     
     
         12 . The method of  claim 1 , further comprising:
 generating, by the processor, metadata based on an imputation process used to generate the imputed genetic data, including an imputation panel version used for the imputation process; and   storing, by the processor, the metadata.   
     
     
         13 . The method of  claim 1 , further comprising:
 storing, by the processor, metadata based on the receiving, transposing, and sending steps; and   sending, by the processor, the metadata to the storage device to be stored in the database.   
     
     
         14 . The method of  claim 1 , wherein the database includes a plurality of tables having dimensions of at least about 1 million×1 million. 
     
     
         15 . The method of  claim 1 , further comprising:
 receiving, by the processor, a request from a user to delete the user's genetic data; and   responsive to the request from the user, updating, by the processor, metadata for the corresponding user's genetic data so that the user's genetic data is not used in future data processing activities.   
     
     
         16 . The method of  claim 1 , further comprising:
 receiving, by the processor, a request from a user to delete the user's genetic data; and   responsive to the request from the user, deleting or nulling, by the processor, the imputed genetic data for the corresponding user's data.   
     
     
         17 . A system configured to provide information from one or more files to a database having a table, the system comprising:
 a processor; and   a storage device,   wherein the system is configured to:
 receive, by the processor from the storage device, one or more files comprising imputed genetic data for one or more individuals, wherein the imputed genetic data is in a columnar format, and wherein the imputed genetic data includes markers for each of the one or more individuals; 
 transpose, by the processor, the imputed genetic data from the one or more files for each of the one or more individuals from columnar format to a plurality of rows; and 
 send, by the processor, the transposed imputed genetic data to the storage device to be stored in the database with a column corresponding to each of the markers for each of the one or more individuals and a unique row for each of the one or more individuals. 
   
     
     
         18 . The system of  claim 17 , wherein the storage device comprises a magnetic tape, a flash memory, a PC-CARD, a portable mass storage device, a holographic storage device, a hard disk drive, a hard disk, a floppy disk, a magnetic tape, an optical media, a magneto-optical media, an application-specific integrated circuit (ASIC), a programmable logic device (PLD), a read-only memory (ROM), or a random-access memory (RAM). 
     
     
         19 . The system of  claim 17 , wherein the storage device comprises a cloud server. 
     
     
         20 . The system of  claim 17 , wherein the system further comprises a network interface, and wherein sending the transposed imputed genetic data to the storage device comprises outputting information to the storage device via the network interface.