Web technologies for environmental big data

Vitolo, Claudia and Elkhatib, Yehia and Reusser, Dominik and Macleod, Christopher J.A. and Buytaert, Wouter (2015) Web technologies for environmental big data. Environmental Modelling and Software, 63. pp. 185-198. ISSN 1873-6726

[thumbnail of 1-s2.0-S1364815214002965-main]
Preview
PDF (1-s2.0-S1364815214002965-main)
1_s2.0_S1364815214002965_main.pdf - Published Version
Available under License Creative Commons Attribution.

Download (2MB)

Abstract

Recent evolutions in computing science and web technology provide the environmental community with continuously expanding resources for data collection and analysis that pose unprecedented challenges to the design of analysis methods, workflows, and interaction with data sets. In the light of the recent UK Research Council funded Environmental Virtual Observatory pilot project, this paper gives an overview of currently available implementations related to web-based technologies for processing large and heterogeneous datasets and discuss their relevance within the context of environmental data processing, simulation and prediction. We found that, the processing of the simple datasets used in the pilot proved to be relatively straightforward using a combination of R, RPy2, PyWPS and PostgreSQL. However, the use of NoSQL databases and more versatile frameworks such as OGC standard based implementations may provide a wider and more flexible set of features that particularly facilitate working with larger volumes and more heterogeneous data sources.

Item Type:
Journal Article
Journal or Publication Title:
Environmental Modelling and Software
Additional Information:
Under a Creative Commons license
Uncontrolled Keywords:
/dk/atira/pure/subjectarea/asjc/2300
Subjects:
?? web-based modellingbig dataweb servicesogc standardsenvironmental science(all)ecological modelling ??
ID Code:
72201
Deposited By:
Deposited On:
17 Dec 2014 16:29
Refereed?:
Yes
Published?:
Published
Last Modified:
23 Mar 2024 00:42