Conference abstract
Conference abstractPublished 26 Sep 2016
A spatial overlay method for massive vector data based on Spark
Chinese Academy of Surveying and Mapping, China
Abstract
Select any words in the title or abstract, or press this and choose a sentence.
With the growing geographical data, typical spatial overlay methods for vector data in current GIS platform were unable to adapt to voluminous vector data. Thus, this paper presents a novel spatial overlay method for vector data based on the distributed memory computing framework. Firstly, according to the principle of distributed computing, i.e., map and reduce the vector data were divided into several grids. In this way, several partitions were made for the vector data with the aim of parallel computing. Moreover, with this method, unnecessary calculations between the apart spatial objects can be avoided. Secondly, STRtree data structure was constructed in each grid to solve the problem of the uneven distribution in each grid. Meanwhile, with the STR-tree data structure, the efficiency of overlay operation in the same grid can be improved, and the data unevenly distributed problem can be solved by this way. The final comparison between this method and other typical methods shows that this method can significantly improve the overlay operation’s performance for the large-scale vector data.
Ask about this article
Answers come only from this article's title, abstract and keywords, each sentence pointing to where it comes from. Your question is sent to OpenAI to write the answer. Scholars Central does not store it.
Similar by topic
Research article · 2013
A normalization method based on variance and median adjustment for massive mRNA polyadenylation data
Research article · 2014
Gross error detection method based on wavelet theory of mining spatial data
Conference abstract · 26 Sep 2018
Big data management using apache spark: Analysis of bank customer s who are interested to maintain an account based on their age group
Research article · 2011
A physical-spatial analysis of the existing slaughterhouse of Sanandaj, Iran, and site selection for a new one by using fuzzy logic and index overlay model
Follow
New articles from what you follow go into your email digest, once you agree to alert emails.
- BylineArticles whose byline prints “Wangjun He”
