Data management method, apparatus, and system, and storage medium

Abstract

This application discloses a data management method, apparatus, and system, and a storage medium, and belongs to the communication field. The method includes: obtaining first description information, where the first description information is used to describe a first row group, the first row group is a row group stored by a first storage system within a specified time period, and the first row group includes at least one row of data; and storing the first row group in a second storage system based on the first description information. This application can reduce operation costs and maintenance difficulty.

What is claimed is: 
     
         1 . A data management method, wherein the method comprises:
 obtaining first description information, wherein the first description information is used to describe a first row group, the first row group is a row group stored by a first storage system within a specified time period, and the first row group comprises at least one row of data; and   storing the first row group in a second storage system based on the first description information.   
     
     
         2 . The method according to  claim 1 , wherein the first description information comprises transaction information of a first transaction, and the first transaction is a transaction whose execution has been completed by the first storage system within the specified time period; and
 the obtaining first description information comprises:   determining the first transaction; and   selecting, from description information that has been generated by the first storage system, the first description information comprising the transaction information of the first transaction.   
     
     
         3 . The method according to  claim 2 , wherein the determining the first transaction comprises:
 obtaining a first transaction set, wherein the first transaction set comprises a transaction that is executed by the first storage system at an end moment of the specified time period, and the first transaction set is used to reflect a transaction whose execution has been completed by the first storage system before the end moment; and   determining the first transaction based on the first transaction set.   
     
     
         4 . The method according to  claim 3 , wherein the determining the first transaction based on the first transaction set comprises:
 obtaining a second transaction set, wherein the second transaction set comprises a transaction that is executed by the first storage system at a start moment of the specified time period, and the second transaction set is used to reflect a transaction whose execution has been completed by the first storage system before the start moment; and   determining the first transaction based on the first transaction set and the second transaction set.   
     
     
         5 . The method according to  claim 2 , wherein the selecting, from description information that has been generated by the first storage system, the first description information comprising the transaction information of the first transaction comprises:
 selecting, based on a row group range, at least one piece of description information from the description information that has been generated by the first storage system, wherein the row group range comprises a row group operated by the first storage system within the specified time period, and a row group corresponding to a group identifier comprised in each piece of description information in the at least one piece of description information belongs to the row group range; and   selecting, from the at least one piece of description information, the first description information comprising the transaction information of the first transaction.   
     
     
         6 . The method according to  claim 1 , wherein the first description information comprises a storage location of a data segment corresponding to the first row group, the data segment comprises data in the first row group, and the first storage system and the second storage system are storage systems of a same type; and
 the storing the first row group in a second storage system based on the first description information comprises:   obtaining the data segment based on the storage location; and   sending a file to the second storage system, wherein the file comprises the data segment, and the file is used to trigger the second storage system to store the data segment.   
     
     
         7 . The method according to  claim 6 , wherein the file further comprises first row status information, the first row status information indicates undeleted data in the first row group, and the file is further used to trigger the second storage system to store the first row status information or delete deleted data in the first row group from the data segment based on the first row status information. 
     
     
         8 . The method according to  claim 6 , wherein the file further comprises a group identifier of the first row group and/or a column identifier corresponding to each column of data in the first row group, the file is further used to trigger the second storage system to obtain second description information based on the group identifier of the first row group and the column identifier corresponding to each column of data, and the second description information is used to describe the first row group. 
     
     
         9 . The method according to  claim 8 , wherein the file further comprises statistics information corresponding to each column of data, and the second description information further comprises the statistics information corresponding to each column of data. 
     
     
         10 . The method according to  claim 1 , wherein the first description information comprises a group identifier of the first row group and a storage location of a data segment corresponding to the first row group, and the data segment comprises data in the first row group; and the storing the first row group in a second storage system based on the first description information comprises:
 obtaining the first row group based on the group identifier and the storage location; and   sending an insert statement to the second storage system, wherein the insert statement comprises each row of data in the first row group, and the insert statement is used to trigger the second storage system to store each row of data in the first row group.   
     
     
         11 . A computing device, comprising a processor and a memory, wherein the memory is configured to store code, and the processor is configured to invoke the instruction in the memory to:
 obtain first description information, wherein the first description information is used to describe a first row group, the first row group is a row group stored by a first storage system within a specified time period, and the first row group comprises at least one row of data; and   store the first row group in a second storage system based on the first description information.   
     
     
         12 . The computing device according to  claim 11 , wherein the first description information comprises transaction information of a first transaction, and the first transaction is a transaction whose execution has been completed by the first storage system within the specified time period; wherein the processor is configured to invoke the instruction in the memory to:
 determine the first transaction; and   select, from description information that has been generated by the first storage system, the first description information comprising the transaction information of the first transaction.   
     
     
         13 . The computing device according to  claim 12 , wherein the processor is configured to invoke the instruction in the memory to:
 obtain a first transaction set, wherein the first transaction set comprises a transaction that is executed by the first storage system at an end moment of the specified time period, and the first transaction set is used to reflect a transaction whose execution has been completed by the first storage system before the end moment; and   determine the first transaction based on the first transaction set.   
     
     
         14 . The computing device according to  claim 13 , wherein the processor is configured to invoke the instruction in the memory to:
 obtain a second transaction set, wherein the second transaction set comprises a transaction that is executed by the first storage system at a start moment of the specified time period, and the second transaction set is used to reflect a transaction whose execution has been completed by the first storage system before the start moment; and   determine the first transaction based on the first transaction set and the second transaction set.   
     
     
         15 . The computing device according to  claim 12 , wherein the processor is configured to invoke the instruction in the memory to:
 select, based on a row group range, at least one piece of description information from the description information that has been generated by the first storage system, wherein the row group range comprises a row group operated by the first storage system within the specified time period, and a row group corresponding to a group identifier comprised in each piece of description information in the at least one piece of description information belongs to the row group range; and   select, from the at least one piece of description information, the first description information comprising the transaction information of the first transaction.   
     
     
         16 . The computing device according to  claim 11 , wherein the first description information comprises a storage location of a data segment corresponding to the first row group, the data segment comprises data in the first row group, and the first storage system and the second storage system are storage systems of a same type; wherein the processor is configured to invoke the instruction in the memory to:
 obtain the data segment based on the storage location; and   send a file to the second storage system, wherein the file comprises the data segment, and the file is used to trigger the second storage system to store the data segment.   
     
     
         17 . The computing device according to  claim 16 , wherein the file further comprises first row status information, the first row status information indicates undeleted data in the first row group, and the file is further used to trigger the second storage system to store the first row status information or delete deleted data in the first row group from the data segment based on the first row status information. 
     
     
         18 . The computing device according to  claim 16 , wherein the file further comprises a group identifier of the first row group and/or a column identifier corresponding to each column of data in the first row group, the file is further used to trigger the second storage system to obtain second description information based on the group identifier of the first row group and the column identifier corresponding to each column of data, and the second description information is used to describe the first row group. 
     
     
         19 . The computing device according to  claim 18 , wherein the file further comprises statistics information corresponding to each column of data, and the second description information further comprises the statistics information corresponding to each column of data. 
     
     
         20 . The computing device according to  claim 10 , wherein the first description information comprises a group identifier of the first row group and a storage location of a data segment corresponding to the first row group, and the data segment comprises data in the first row group; wherein the processor is configured to invoke the instruction in the memory to:
 obtain the first row group based on the group identifier and the storage location; and   send an insert statement to the second storage system, wherein the insert statement comprises each row of data in the first row group, and the insert statement is used to trigger the second storage system to store each row of data in the first row group.