A small note on variation in segmentation annotations
Research output: Contribution to journal › Journal article › Research
Standard
A small note on variation in segmentation annotations. / Ørting, Silas Nyboe.
In: arXiv, 03.12.2020.Research output: Contribution to journal › Journal article › Research
Harvard
APA
Vancouver
Author
Bibtex
}
RIS
TY - JOUR
T1 - A small note on variation in segmentation annotations
AU - Ørting, Silas Nyboe
PY - 2020/12/3
Y1 - 2020/12/3
N2 - We report on the results of a small crowdsourcing experiment conducted at a workshop on machine learning for segmentation held at the Danish Bio Imaging network meeting 2020. During the workshop we asked participants to manually segment mitochondria in three 2D patches. The aim of the experiment was to illustrate that manual annotations should not be seen as the ground truth, but as a reference standard that is subject to substantial variation. In this note we show how the large variation we observed in the segmentations can be reduced by removing the annotators with worst pair-wise agreement. Having removed the annotators with worst performance, we illustrate that the remaining variance is semantically meaningful and can be exploited to obtain segmentations of cell boundary and cell interior.
AB - We report on the results of a small crowdsourcing experiment conducted at a workshop on machine learning for segmentation held at the Danish Bio Imaging network meeting 2020. During the workshop we asked participants to manually segment mitochondria in three 2D patches. The aim of the experiment was to illustrate that manual annotations should not be seen as the ground truth, but as a reference standard that is subject to substantial variation. In this note we show how the large variation we observed in the segmentations can be reduced by removing the annotators with worst pair-wise agreement. Having removed the annotators with worst performance, we illustrate that the remaining variance is semantically meaningful and can be exploited to obtain segmentations of cell boundary and cell interior.
KW - cs.CV
KW - cs.HC
M3 - Journal article
JO - arXiv
JF - arXiv
ER -
ID: 253071786