Trust as a proxy indicator for intrinsic quality of Volunteered Geographic Information in biodiversity monitoring programs

Hossein Vahidi, Brian Klinkenberg, Wanglin Yan

Research output: Contribution to journalArticle

2 Citations (Scopus)

Abstract

In this article, we present a fuzzy model for intrinsic quality assessment of Volunteered Geographic Information (VGI) on species occurrences obtained by Citizen Science (CS) biodiversity monitoring programs. The proposed VGI quality assurance approach evaluates the thematic and positional quality of the crowdsourced biodiversity observation in terms of the trustworthiness of the observation by combining three indicators of consistency with habitat, consistency with surroundings, and reputation of contributor, that characterize the geographical and social aspects of trust in VGI. To evaluate the performance and usability of the proposed approach for evaluating the trustworthiness of crowdsourced observations and detecting thematic and positional errors in crowdsourced observations, the developed approach was applied to the crowdsourced observations on Acer macrophyllum collected through the CS biodiversity monitoring projects of E-Flora BC and iNaturalist. The result of a conformity test at the optimal acceptance threshold (sensitivity = 0.99, specificity = 0.8, and Cohen’s kappa = 0.79), the achieved area under the curve (AUC) value (AUC = 0.98), and the results of the complementary investigation on the predictions of the proposed model indicated that the proposed fuzzy trust model exhibited promising predictive performance and was able to flag the majority of attribute and positional errors in the crowdsourced biodiversity observations.

Original languageEnglish
Pages (from-to)1-37
Number of pages37
JournalGIScience and Remote Sensing
DOIs
Publication statusAccepted/In press - 2017 Dec 16

Fingerprint

biodiversity
monitoring
species occurrence
flora
indicator
programme
habitat
prediction
citizen
science
attribute
test
project
quality assurance

Keywords

  • biodiversity monitoring
  • citizen science
  • crowdsourcing
  • intrinsic data quality indicator
  • trust
  • Volunteered Geographic Information

ASJC Scopus subject areas

  • Earth and Planetary Sciences(all)

Cite this

Trust as a proxy indicator for intrinsic quality of Volunteered Geographic Information in biodiversity monitoring programs. / Vahidi, Hossein; Klinkenberg, Brian; Yan, Wanglin.

In: GIScience and Remote Sensing, 16.12.2017, p. 1-37.

Research output: Contribution to journalArticle

@article{fd61fed3883f4705aa77dedf504cbf17,
title = "Trust as a proxy indicator for intrinsic quality of Volunteered Geographic Information in biodiversity monitoring programs",
abstract = "In this article, we present a fuzzy model for intrinsic quality assessment of Volunteered Geographic Information (VGI) on species occurrences obtained by Citizen Science (CS) biodiversity monitoring programs. The proposed VGI quality assurance approach evaluates the thematic and positional quality of the crowdsourced biodiversity observation in terms of the trustworthiness of the observation by combining three indicators of consistency with habitat, consistency with surroundings, and reputation of contributor, that characterize the geographical and social aspects of trust in VGI. To evaluate the performance and usability of the proposed approach for evaluating the trustworthiness of crowdsourced observations and detecting thematic and positional errors in crowdsourced observations, the developed approach was applied to the crowdsourced observations on Acer macrophyllum collected through the CS biodiversity monitoring projects of E-Flora BC and iNaturalist. The result of a conformity test at the optimal acceptance threshold (sensitivity = 0.99, specificity = 0.8, and Cohen’s kappa = 0.79), the achieved area under the curve (AUC) value (AUC = 0.98), and the results of the complementary investigation on the predictions of the proposed model indicated that the proposed fuzzy trust model exhibited promising predictive performance and was able to flag the majority of attribute and positional errors in the crowdsourced biodiversity observations.",
keywords = "biodiversity monitoring, citizen science, crowdsourcing, intrinsic data quality indicator, trust, Volunteered Geographic Information",
author = "Hossein Vahidi and Brian Klinkenberg and Wanglin Yan",
year = "2017",
month = "12",
day = "16",
doi = "10.1080/15481603.2017.1413794",
language = "English",
pages = "1--37",
journal = "GIScience and Remote Sensing",
issn = "1548-1603",
publisher = "Bellwether Publishing, Ltd.",

}

TY - JOUR

T1 - Trust as a proxy indicator for intrinsic quality of Volunteered Geographic Information in biodiversity monitoring programs

AU - Vahidi, Hossein

AU - Klinkenberg, Brian

AU - Yan, Wanglin

PY - 2017/12/16

Y1 - 2017/12/16

N2 - In this article, we present a fuzzy model for intrinsic quality assessment of Volunteered Geographic Information (VGI) on species occurrences obtained by Citizen Science (CS) biodiversity monitoring programs. The proposed VGI quality assurance approach evaluates the thematic and positional quality of the crowdsourced biodiversity observation in terms of the trustworthiness of the observation by combining three indicators of consistency with habitat, consistency with surroundings, and reputation of contributor, that characterize the geographical and social aspects of trust in VGI. To evaluate the performance and usability of the proposed approach for evaluating the trustworthiness of crowdsourced observations and detecting thematic and positional errors in crowdsourced observations, the developed approach was applied to the crowdsourced observations on Acer macrophyllum collected through the CS biodiversity monitoring projects of E-Flora BC and iNaturalist. The result of a conformity test at the optimal acceptance threshold (sensitivity = 0.99, specificity = 0.8, and Cohen’s kappa = 0.79), the achieved area under the curve (AUC) value (AUC = 0.98), and the results of the complementary investigation on the predictions of the proposed model indicated that the proposed fuzzy trust model exhibited promising predictive performance and was able to flag the majority of attribute and positional errors in the crowdsourced biodiversity observations.

AB - In this article, we present a fuzzy model for intrinsic quality assessment of Volunteered Geographic Information (VGI) on species occurrences obtained by Citizen Science (CS) biodiversity monitoring programs. The proposed VGI quality assurance approach evaluates the thematic and positional quality of the crowdsourced biodiversity observation in terms of the trustworthiness of the observation by combining three indicators of consistency with habitat, consistency with surroundings, and reputation of contributor, that characterize the geographical and social aspects of trust in VGI. To evaluate the performance and usability of the proposed approach for evaluating the trustworthiness of crowdsourced observations and detecting thematic and positional errors in crowdsourced observations, the developed approach was applied to the crowdsourced observations on Acer macrophyllum collected through the CS biodiversity monitoring projects of E-Flora BC and iNaturalist. The result of a conformity test at the optimal acceptance threshold (sensitivity = 0.99, specificity = 0.8, and Cohen’s kappa = 0.79), the achieved area under the curve (AUC) value (AUC = 0.98), and the results of the complementary investigation on the predictions of the proposed model indicated that the proposed fuzzy trust model exhibited promising predictive performance and was able to flag the majority of attribute and positional errors in the crowdsourced biodiversity observations.

KW - biodiversity monitoring

KW - citizen science

KW - crowdsourcing

KW - intrinsic data quality indicator

KW - trust

KW - Volunteered Geographic Information

UR - http://www.scopus.com/inward/record.url?scp=85038104251&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85038104251&partnerID=8YFLogxK

U2 - 10.1080/15481603.2017.1413794

DO - 10.1080/15481603.2017.1413794

M3 - Article

SP - 1

EP - 37

JO - GIScience and Remote Sensing

JF - GIScience and Remote Sensing

SN - 1548-1603

ER -