Visual distributed data framework for analysis and visualization of datasets

Abstract

A system represents data as visual distributed data frames (VDDFs) that comprise a dataset, metadata describing the data, and metadata describing visualization of the dataset. A VDDF may be extracted from charts displayed in markup language documents. A VDDF may be generated from different data sources including big data analysis systems. A VDDF workspace allows interaction with multiple VDDF objects extracted from multiple data sources and stored locally within the storage of the device. The VDDF workspace allows the user to interact with the VDDF objects, for example, by inspecting the metadata, modifying the data, adding new columns, changing the visualization, joining data from multiple charts, and sharing the VDDF objects with other documents. The processing of data of a VDDF is performed locally within a computing device, for example, in a client device.

What is claimed is: 
     
         1 . A computer-implemented method, comprising:
 receiving, at a visual distributed data frame (VDDF) hub, a plurality of datasets from a plurality of computing devices, at least a first dataset transmitted from a first application and a second dataset transmitted from a second application different from the first application;   storing the plurality of datasets in the VDDF hub;   receiving, from a client device via a web browser application in communication with the VDDF hub, a query;   executing the query on the datasets stored in the VDDF hub to extract, from the datasets, relevant data as a VDDF   transmit the VDDF to the web browser application; and   causing the web browser application to visualize the VDDF as a chart that is displayed in the web browser application.   
     
     
         2 . The computer-implemented method of  claim 1 , wherein the VDDF is stored in a local storage of the web browser application, the VDDF accessible by a plurality of web servers in communication with the client device via different tabs of the web browser application. 
     
     
         3 . The computer-implemented method of  claim 1 , wherein the query comprises one or more of: a filter clause, a group by clause, or an aggregation expression. 
     
     
         4 . The computer-implemented method of  claim 1 , wherein the query joins data associated with two or more charts. 
     
     
         5 . The computer-implemented method of  claim 1 , wherein the query identifies a source dataset by specifying a URL identifying a chart. 
     
     
         6 . The computer-implemented method of  claim 1 , wherein the query joins data of a chart with data generated by a machine learning model. 
     
     
         7 . The computer-implemented method of  claim 1 , wherein the query joins data of a chart with a distributed data frame representing data generated by an in-memory cluster computing engine. 
     
     
         8 . The computer-implemented method of  claim 1 , further comprising:
 storing the VDDF and an association between the VDDF and the query;   generating a uniform resource locator (URL) for identifying the stored VDDF;   including the URL in a new markup language document; and   sending the new markup language document for display.   
     
     
         9 . A non-transitory computer readable medium for storing computer code comprising instructions, the instructions, when executed by one or more processors, cause the one or more processors to perform steps comprising:
 receiving, at a visual distributed data frame (VDDF) hub, a plurality of datasets from a plurality of computing devices, at least a first dataset transmitted from a first application and a second dataset transmitted from a second application different from the first application;   storing the plurality of datasets in the VDDF hub;   receiving, from a client device via a web browser application in communication with the VDDF hub, a query;   executing the query on the datasets stored in the VDDF hub to extract, from the datasets, relevant data as a VDDF   transmit the VDDF to the web browser application; and   causing the web browser application to visualize the VDDF as a chart that is displayed in the web browser application.   
     
     
         10 . The non-transitory computer readable medium of  claim 9 , wherein the VDDF is stored in a local storage of the web browser application, the VDDF accessible by a plurality of web servers in communication with the client device via different tabs of the web browser application. 
     
     
         11 . The non-transitory computer readable medium of  claim 9 , wherein the query comprises one or more of: a filter clause, a group by clause, or an aggregation expression. 
     
     
         12 . The non-transitory computer readable medium of  claim 9 , wherein the query joins data associated with two or more charts. 
     
     
         13 . The non-transitory computer readable medium of  claim 9 , wherein the query identifies a source dataset by specifying a URL identifying a chart. 
     
     
         14 . The non-transitory computer readable medium of  claim 9 , wherein the query joins data of a chart with data generated by a machine learning model. 
     
     
         15 . The non-transitory computer readable medium of  claim 9 , wherein the query joins data of a chart with a distributed data frame representing data generated by an in-memory cluster computing engine. 
     
     
         16 . The non-transitory computer readable medium of  claim 9 , wherein the steps further comprise:
 storing the VDDF and an association between the VDDF and the query;   generating a uniform resource locator (URL) for identifying the stored VDDF;   including the URL in a new markup language document; and   sending the new markup language document for display.   
     
     
         17 . A system comprising:
 one or more processors; and   memory for storing computer code comprising instructions, the instructions, when executed by the one or more processors, cause the one or more processors to perform steps comprising:
 receiving, at a visual distributed data frame (VDDF) hub, a plurality of datasets from a plurality of computing devices, at least a first dataset transmitted from a first application and a second dataset transmitted from a second application different from the first application; 
 storing the plurality of datasets in the VDDF hub; 
 receiving, from a client device via a web browser application in communication with the VDDF hub, a query; 
 executing the query on the datasets stored in the VDDF hub to extract, from the datasets, relevant data as a VDDF 
 transmit the VDDF to the web browser application; and 
 causing the web browser application to visualize the VDDF as a chart that is displayed in the web browser application. 
   
     
     
         18 . The system of  claim 17 , wherein the VDDF is stored in a local storage of the web browser application, the VDDF accessible by a plurality of web servers in communication with the client device via different tabs of the web browser application. 
     
     
         19 . The system of  claim 17 , wherein the query joins data of a chart with data generated by a machine learning model. 
     
     
         20 . The system of  claim 17 , wherein the steps further comprise:
 storing the VDDF and an association between the VDDF and the query;   generating a uniform resource locator (URL) for identifying the stored VDDF;   including the URL in a new markup language document; and   sending the new markup language document for display.