山东省地理信息时空大数据中心基础设施设计与实现

Design and Implementation on the Infrastructure of Geographic Information Spatiotemporal Big Data Center in Shandong Province

摘要:

针对大数据背景下地理信息基础设施面临的各种问题和挑战，本文提出一种基于私有云的基础设施建设方法。首先通过云管理平台，将各种物理资源虚拟化，形成跨虚拟化技术的统一资源池；然后在其上建设时空大数据基础框架，采用分布式技术架构，通过集群并行的工作模式去解决存储和计算两个最为核心的技术需求；最后以山东省地理信息时空大数据中心基础设施建设为例，进行数据入库和图斑计算。通过对比验证，本文的方法能够切实提高数据存储和计算效率，满足数据资源的有效组织管理和应用服务要求，实现对地理信息时空大数据中心的有效支撑。

Abstract:

In view of the problems and challenges faced by geographic information infrastructure under the background of big data, an infrastructure construction method has been put forward based on private cloud. Firstly, through the cloud management platform, all kinds of physical resources are virtualized to form a unified resource pool across virtualization technology.Then, basic framework of spatiotemporal big data can be constructed. By using distributed technology architecture, through the cluster parallel working mode, two most core technical requirements of storage and computing have been solved. Finally, taking the infrastructure construction of Shandong geographic information spatiotemporal big data center as an example, data warehousing and pattern computing are carried out. Through comparison and verification, it is regarded that the method in this paper can effectively improve the efficiency of data storage and calculation, meet the requirements of effective organization and management of data resources and application services, and realize the effective support of geographic information spatiotemporal big data center.