GSTDTAP  > 资源环境科学
DOI10.1029/2020WR029121
Automatic Quality Control of Crowdsourced Rainfall Data with Multiple Noises: A Machine Learning Approach
Geng Niu; Pan Yang; Yi Zheng; Ximing Cai; Huapeng Qin
2021-10-20
发表期刊Water Resources Research
出版年2021
英文摘要

In geophysics, crowdsourcing is an emerging nontraditional environmental monitoring approach that support data acquisition from individual citizens. However, because of the involvement of undertrained citizens and imprecise low-cost sensors, crowdsourced data applications suffer from different types of noises that can deteriorate the overall monitoring accuracy. In this study, we propose a machine learning approach for automatic crowdsourced data quality control (CSQC) that detects and removes noisy data inputs in spatially and temporally discrete crowdsourced observations coming from both fixed-point sensors (e.g., surveillance cameras) and moving sensors (e.g., moving cars/pedestrians). We design a set of features from original and interpolated rainfall data and use them to train and test the CSQC models using both supervised and unsupervised machine learning algorithms. The performances of the CSQC models under various scenarios assuming no retraining are also tested (hereafter referred to as transferability). The results based on synthetic but realistic data show that the CSQC models can significantly reduce the overall rainfall estimate errors. Under the stationary assumption, the CSQC models based on both supervised and unsupervised algorithms perform well in noisy data identification and overall rainfall estimation error reduction; however, if the model is transferred to other cities with different rainfall patterns or noise compositions (without retraining), supervised multilayer perceptrons (MLPs) show the best performance.

This article is protected by copyright. All rights reserved.

领域资源环境
URL查看原文
引用统计
文献类型期刊论文
条目标识符http://119.78.100.173/C666/handle/2XK7JSWQ/340912
专题资源环境科学
推荐引用方式
GB/T 7714
Geng Niu,Pan Yang,Yi Zheng,et al. Automatic Quality Control of Crowdsourced Rainfall Data with Multiple Noises: A Machine Learning Approach[J]. Water Resources Research,2021.
APA Geng Niu,Pan Yang,Yi Zheng,Ximing Cai,&Huapeng Qin.(2021).Automatic Quality Control of Crowdsourced Rainfall Data with Multiple Noises: A Machine Learning Approach.Water Resources Research.
MLA Geng Niu,et al."Automatic Quality Control of Crowdsourced Rainfall Data with Multiple Noises: A Machine Learning Approach".Water Resources Research (2021).
条目包含的文件
条目无相关文件。
个性服务
推荐该条目
保存到收藏夹
查看访问统计
导出为Endnote文件
谷歌学术
谷歌学术中相似的文章
[Geng Niu]的文章
[Pan Yang]的文章
[Yi Zheng]的文章
百度学术
百度学术中相似的文章
[Geng Niu]的文章
[Pan Yang]的文章
[Yi Zheng]的文章
必应学术
必应学术中相似的文章
[Geng Niu]的文章
[Pan Yang]的文章
[Yi Zheng]的文章
相关权益政策
暂无数据
收藏/分享
所有评论 (0)
暂无评论
 

除非特别说明,本系统中所有内容都受版权保护,并保留所有权利。