Validation of mitotic cell quantification via microscopy and multiple whole-slide scanners

Kazuhiro Tabata, Naohiro Uraoka, Jamal Benhamida, Matthew G. Hanna, Sahussapont Joseph Sirintrapun, Brandon D. Gallas, Qi Gong, Rania G. Aly, Katsura Emoto, Kant M. Matsuda, Meera R. Hameed, David S. Klimstra, Yukako Yagi

Research output: Contribution to journalArticle

Abstract

Background: The establishment of whole-slide imaging (WSI) as a medical diagnostic device allows that pathologists may evaluate mitotic activity with this new technology. Furthermore, the image digitalization provides an opportunity to develop algorithms for automatic quantifications, ideally leading to improved reproducibility as compared to the naked eye examination by pathologists. In order to implement them effectively, accuracy of mitotic figure detection using WSI should be investigated. In this study, we aimed to measure pathologist performance in detecting mitotic figures (MFs) using multiple platforms (multiple scanners) and compare the results with those obtained using a brightfield microscope. Methods: Four slides of canine oral melanoma were prepared and digitized using 4 WSI scanners. In these slides, 40 regions of interest (ROIs) were demarcated, and five observers identified the MFs using different viewing modes: microscopy and WSI. We evaluated the inter- and intra-observer agreements between modes with Cohen's Kappa and determined "true" MFs with a consensus panel. We then assessed the accuracy (agreement with truth) using the average of sensitivity and specificity. Results: In the 40 ROIs, 155 candidate MFs were detected by five pathologists; 74 of them were determined to be true MFs. Inter- and intra-observer agreement was mostly "substantial" or greater (Kappa = 0.594-0.939). Accuracy was between 0.632 and 0.843 across all readers and modes. After averaging over readers for each modality, we found that mitosis detection accuracy for 3 of the 4 WSI scanners was significantly less than that of the microscope (p = 0.002, 0.012, and 0.001). Conclusions: This study is the first to compare WSIs and microscopy in detecting MFs at the level of individual cells. Our results suggest that WSI can be used for mitotic cell detection and offers similar reproducibility to the microscope, with slightly less accuracy.

Original languageEnglish
Article number65
JournalDiagnostic Pathology
Volume14
Issue number1
DOIs
Publication statusPublished - 2019 Jun 26
Externally publishedYes

Fingerprint

Microscopy
Mitosis
Canidae
Melanoma
Technology
Sensitivity and Specificity
Equipment and Supplies
Pathologists

Keywords

  • eeDAP
  • Microscopy
  • Mitotic cell quantification
  • Multiple whole slide scanner
  • Validation study
  • Whole slide imaging

ASJC Scopus subject areas

  • Pathology and Forensic Medicine
  • Histology

Cite this

Tabata, K., Uraoka, N., Benhamida, J., Hanna, M. G., Sirintrapun, S. J., Gallas, B. D., ... Yagi, Y. (2019). Validation of mitotic cell quantification via microscopy and multiple whole-slide scanners. Diagnostic Pathology, 14(1), [65]. https://doi.org/10.1186/s13000-019-0839-8

Validation of mitotic cell quantification via microscopy and multiple whole-slide scanners. / Tabata, Kazuhiro; Uraoka, Naohiro; Benhamida, Jamal; Hanna, Matthew G.; Sirintrapun, Sahussapont Joseph; Gallas, Brandon D.; Gong, Qi; Aly, Rania G.; Emoto, Katsura; Matsuda, Kant M.; Hameed, Meera R.; Klimstra, David S.; Yagi, Yukako.

In: Diagnostic Pathology, Vol. 14, No. 1, 65, 26.06.2019.

Research output: Contribution to journalArticle

Tabata, K, Uraoka, N, Benhamida, J, Hanna, MG, Sirintrapun, SJ, Gallas, BD, Gong, Q, Aly, RG, Emoto, K, Matsuda, KM, Hameed, MR, Klimstra, DS & Yagi, Y 2019, 'Validation of mitotic cell quantification via microscopy and multiple whole-slide scanners', Diagnostic Pathology, vol. 14, no. 1, 65. https://doi.org/10.1186/s13000-019-0839-8
Tabata K, Uraoka N, Benhamida J, Hanna MG, Sirintrapun SJ, Gallas BD et al. Validation of mitotic cell quantification via microscopy and multiple whole-slide scanners. Diagnostic Pathology. 2019 Jun 26;14(1). 65. https://doi.org/10.1186/s13000-019-0839-8
Tabata, Kazuhiro ; Uraoka, Naohiro ; Benhamida, Jamal ; Hanna, Matthew G. ; Sirintrapun, Sahussapont Joseph ; Gallas, Brandon D. ; Gong, Qi ; Aly, Rania G. ; Emoto, Katsura ; Matsuda, Kant M. ; Hameed, Meera R. ; Klimstra, David S. ; Yagi, Yukako. / Validation of mitotic cell quantification via microscopy and multiple whole-slide scanners. In: Diagnostic Pathology. 2019 ; Vol. 14, No. 1.
@article{768f8962b48f4246bc84e475555a7078,
title = "Validation of mitotic cell quantification via microscopy and multiple whole-slide scanners",
abstract = "Background: The establishment of whole-slide imaging (WSI) as a medical diagnostic device allows that pathologists may evaluate mitotic activity with this new technology. Furthermore, the image digitalization provides an opportunity to develop algorithms for automatic quantifications, ideally leading to improved reproducibility as compared to the naked eye examination by pathologists. In order to implement them effectively, accuracy of mitotic figure detection using WSI should be investigated. In this study, we aimed to measure pathologist performance in detecting mitotic figures (MFs) using multiple platforms (multiple scanners) and compare the results with those obtained using a brightfield microscope. Methods: Four slides of canine oral melanoma were prepared and digitized using 4 WSI scanners. In these slides, 40 regions of interest (ROIs) were demarcated, and five observers identified the MFs using different viewing modes: microscopy and WSI. We evaluated the inter- and intra-observer agreements between modes with Cohen's Kappa and determined {"}true{"} MFs with a consensus panel. We then assessed the accuracy (agreement with truth) using the average of sensitivity and specificity. Results: In the 40 ROIs, 155 candidate MFs were detected by five pathologists; 74 of them were determined to be true MFs. Inter- and intra-observer agreement was mostly {"}substantial{"} or greater (Kappa = 0.594-0.939). Accuracy was between 0.632 and 0.843 across all readers and modes. After averaging over readers for each modality, we found that mitosis detection accuracy for 3 of the 4 WSI scanners was significantly less than that of the microscope (p = 0.002, 0.012, and 0.001). Conclusions: This study is the first to compare WSIs and microscopy in detecting MFs at the level of individual cells. Our results suggest that WSI can be used for mitotic cell detection and offers similar reproducibility to the microscope, with slightly less accuracy.",
keywords = "eeDAP, Microscopy, Mitotic cell quantification, Multiple whole slide scanner, Validation study, Whole slide imaging",
author = "Kazuhiro Tabata and Naohiro Uraoka and Jamal Benhamida and Hanna, {Matthew G.} and Sirintrapun, {Sahussapont Joseph} and Gallas, {Brandon D.} and Qi Gong and Aly, {Rania G.} and Katsura Emoto and Matsuda, {Kant M.} and Hameed, {Meera R.} and Klimstra, {David S.} and Yukako Yagi",
year = "2019",
month = "6",
day = "26",
doi = "10.1186/s13000-019-0839-8",
language = "English",
volume = "14",
journal = "Diagnostic Pathology",
issn = "1746-1596",
publisher = "BioMed Central",
number = "1",

}

TY - JOUR

T1 - Validation of mitotic cell quantification via microscopy and multiple whole-slide scanners

AU - Tabata, Kazuhiro

AU - Uraoka, Naohiro

AU - Benhamida, Jamal

AU - Hanna, Matthew G.

AU - Sirintrapun, Sahussapont Joseph

AU - Gallas, Brandon D.

AU - Gong, Qi

AU - Aly, Rania G.

AU - Emoto, Katsura

AU - Matsuda, Kant M.

AU - Hameed, Meera R.

AU - Klimstra, David S.

AU - Yagi, Yukako

PY - 2019/6/26

Y1 - 2019/6/26

N2 - Background: The establishment of whole-slide imaging (WSI) as a medical diagnostic device allows that pathologists may evaluate mitotic activity with this new technology. Furthermore, the image digitalization provides an opportunity to develop algorithms for automatic quantifications, ideally leading to improved reproducibility as compared to the naked eye examination by pathologists. In order to implement them effectively, accuracy of mitotic figure detection using WSI should be investigated. In this study, we aimed to measure pathologist performance in detecting mitotic figures (MFs) using multiple platforms (multiple scanners) and compare the results with those obtained using a brightfield microscope. Methods: Four slides of canine oral melanoma were prepared and digitized using 4 WSI scanners. In these slides, 40 regions of interest (ROIs) were demarcated, and five observers identified the MFs using different viewing modes: microscopy and WSI. We evaluated the inter- and intra-observer agreements between modes with Cohen's Kappa and determined "true" MFs with a consensus panel. We then assessed the accuracy (agreement with truth) using the average of sensitivity and specificity. Results: In the 40 ROIs, 155 candidate MFs were detected by five pathologists; 74 of them were determined to be true MFs. Inter- and intra-observer agreement was mostly "substantial" or greater (Kappa = 0.594-0.939). Accuracy was between 0.632 and 0.843 across all readers and modes. After averaging over readers for each modality, we found that mitosis detection accuracy for 3 of the 4 WSI scanners was significantly less than that of the microscope (p = 0.002, 0.012, and 0.001). Conclusions: This study is the first to compare WSIs and microscopy in detecting MFs at the level of individual cells. Our results suggest that WSI can be used for mitotic cell detection and offers similar reproducibility to the microscope, with slightly less accuracy.

AB - Background: The establishment of whole-slide imaging (WSI) as a medical diagnostic device allows that pathologists may evaluate mitotic activity with this new technology. Furthermore, the image digitalization provides an opportunity to develop algorithms for automatic quantifications, ideally leading to improved reproducibility as compared to the naked eye examination by pathologists. In order to implement them effectively, accuracy of mitotic figure detection using WSI should be investigated. In this study, we aimed to measure pathologist performance in detecting mitotic figures (MFs) using multiple platforms (multiple scanners) and compare the results with those obtained using a brightfield microscope. Methods: Four slides of canine oral melanoma were prepared and digitized using 4 WSI scanners. In these slides, 40 regions of interest (ROIs) were demarcated, and five observers identified the MFs using different viewing modes: microscopy and WSI. We evaluated the inter- and intra-observer agreements between modes with Cohen's Kappa and determined "true" MFs with a consensus panel. We then assessed the accuracy (agreement with truth) using the average of sensitivity and specificity. Results: In the 40 ROIs, 155 candidate MFs were detected by five pathologists; 74 of them were determined to be true MFs. Inter- and intra-observer agreement was mostly "substantial" or greater (Kappa = 0.594-0.939). Accuracy was between 0.632 and 0.843 across all readers and modes. After averaging over readers for each modality, we found that mitosis detection accuracy for 3 of the 4 WSI scanners was significantly less than that of the microscope (p = 0.002, 0.012, and 0.001). Conclusions: This study is the first to compare WSIs and microscopy in detecting MFs at the level of individual cells. Our results suggest that WSI can be used for mitotic cell detection and offers similar reproducibility to the microscope, with slightly less accuracy.

KW - eeDAP

KW - Microscopy

KW - Mitotic cell quantification

KW - Multiple whole slide scanner

KW - Validation study

KW - Whole slide imaging

UR - http://www.scopus.com/inward/record.url?scp=85068115678&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85068115678&partnerID=8YFLogxK

U2 - 10.1186/s13000-019-0839-8

DO - 10.1186/s13000-019-0839-8

M3 - Article

C2 - 31238983

AN - SCOPUS:85068115678

VL - 14

JO - Diagnostic Pathology

JF - Diagnostic Pathology

SN - 1746-1596

IS - 1

M1 - 65

ER -