SYSTEM AND METHOD FOR PROVIDING CLIMATE DATA ANALYTICS AS A SERVICE

摘要

A system, method and computer-readable storage devices for providing climate data analytics as a service. An example system can include a high-performance data analytics platform that provides a compute-storage fabric, a high-performance file system, and a virtualizer. The system can include an analytic service that transforms multidimensional binary climate data to yield analysis files formatted for high-performance analytic software input and output, that transforms analysis files to yield multidimensional binary files encoded in a commonly used climate data file format, and that performs high-performance analytic operations over analysis files stored in the high-performance files system and collects results into dynamically created data objects.. The system can also provide a persistence service and a system interface. The persistence service can store and manage the data objects, and can deploy climate data server instances as virtual climate data servers in a federated data grid.

主权项

1. A system for providing climate data analytics as a service, the system comprising:
a high-performance data analytics platform comprising:
an assemblage of compute and storage nodes that provide a compute-storage fabric upon which high-performance analytic operations are performed over distributed collections of climate data;a high-performance file system; anda virtualizer that virtualizes the high-performance data analytics platform for customized deployment of the high-performance data analytics platform; an analytic service comprising:
a first module that transforms multidimensional binary climate data encoded in a commonly used climate data file format to yield analysis files suitably formatted for high-performance analytic software input and output and loads the transformed files into the high-performance file system of the high-performance data analytics platform;a second module that transforms analysis files stored in the high-performance data analytics platform to yield multidimensional binary files encoded in a commonly used climate data file format and moves the transformed files out of the high-performance file system of the high-performance data analytics platform; anda third module comprising a plurality of software applications that implement the functions of the service by performing high-performance analytic operations over analysis files stored in the high-performance files system and collecting results into dynamically created data objects; a persistence service comprising:
a climate data server that stores and manages the data objects dynamically created by the analytic service;virtualization and provisioning software that allows climate data server instances to be deployed as virtual climate data servers; andsoftware that implements a data grid, wherein a plurality of climate data servers can be communicatively linked to form a federated data grid; a system interface comprising:
an adapter module that invokes climate data analytics system services by mapping service requests to specific operations in the system services suite; anda communications module that links the adapter module to external applications through a service request protocol based on the data flow categories of a long-term preservation digital archive reference model.