Methods for estimating causal relationships of adverse events with dietary supplements

Kazuki Ide, Hiroshi Yamada, Mamoru Kitagawa, Yohei Kawasaki, Yuma Buno, Kumi Matsushita, Masayuki Kaji, Kazuko Fujimoto, Masako Waki, Mitsuyoshi Nakashima, Keizo Umegaki

Research output: Contribution to journalArticle

10 Citations (Scopus)

Abstract

Objective: Dietary supplement use has increased over past decades, resulting in reports of potentially serious adverse events. The aim of this study was to develop optimised methods to evaluate the causal relationships between adverse events and dietary supplements, and to test these methods using case reports. Design: Causal relationship assessment using prospectively collected data. Setting and participants: 4 dietary supplement experts, 4 pharmacists and 11 registered dietitians (5 men and 14 women) examined 200 case reports of suspected adverse events using the modified Naranjo scale and the modified Food and Drug Administration (FDA) algorithm. Primary outcome measures: The distribution of evaluation results was analysed and inter-rater reliability was evaluated for the two modified methods employed using intraclass correlation coefficients (ICC) and Fleiss' κ. Results: Using these two methods, most of the 200 case reports were categorised as 'lack of information' or 'possible' adverse events. Inter-rater reliability among entire assessors ratings for the two modified methods, based on ICC and Fleiss' κ, were classified as more than substantial (modified Naranjo scale: ICC (95% CI) 0.873 (0.850 to 0.895); Fleiss' κ (95% CI) 0.615 (0.615 to 0.615). Modified FDA algorithm: Fleiss' κ (95% CI) 0.622 (0.622 to 0.622). Conclusions: These methods may help to assess the causal relationships between adverse events and dietary supplements. By conducting additional studies of these methods in different populations, researchers can expand the possibilities for the application of our methods.

Original languageEnglish
Article numbere009038
JournalBMJ Open
Volume5
Issue number11
DOIs
Publication statusPublished - 2015

Fingerprint

Dietary Supplements
United States Food and Drug Administration
Nutritionists
Pharmacists
Research Personnel
Outcome Assessment (Health Care)
Population

ASJC Scopus subject areas

  • Medicine(all)

Cite this

Ide, K., Yamada, H., Kitagawa, M., Kawasaki, Y., Buno, Y., Matsushita, K., ... Umegaki, K. (2015). Methods for estimating causal relationships of adverse events with dietary supplements. BMJ Open, 5(11), [e009038]. https://doi.org/10.1136/bmjopen-2015-009038

Methods for estimating causal relationships of adverse events with dietary supplements. / Ide, Kazuki; Yamada, Hiroshi; Kitagawa, Mamoru; Kawasaki, Yohei; Buno, Yuma; Matsushita, Kumi; Kaji, Masayuki; Fujimoto, Kazuko; Waki, Masako; Nakashima, Mitsuyoshi; Umegaki, Keizo.

In: BMJ Open, Vol. 5, No. 11, e009038, 2015.

Research output: Contribution to journalArticle

Ide, K, Yamada, H, Kitagawa, M, Kawasaki, Y, Buno, Y, Matsushita, K, Kaji, M, Fujimoto, K, Waki, M, Nakashima, M & Umegaki, K 2015, 'Methods for estimating causal relationships of adverse events with dietary supplements', BMJ Open, vol. 5, no. 11, e009038. https://doi.org/10.1136/bmjopen-2015-009038
Ide K, Yamada H, Kitagawa M, Kawasaki Y, Buno Y, Matsushita K et al. Methods for estimating causal relationships of adverse events with dietary supplements. BMJ Open. 2015;5(11). e009038. https://doi.org/10.1136/bmjopen-2015-009038
Ide, Kazuki ; Yamada, Hiroshi ; Kitagawa, Mamoru ; Kawasaki, Yohei ; Buno, Yuma ; Matsushita, Kumi ; Kaji, Masayuki ; Fujimoto, Kazuko ; Waki, Masako ; Nakashima, Mitsuyoshi ; Umegaki, Keizo. / Methods for estimating causal relationships of adverse events with dietary supplements. In: BMJ Open. 2015 ; Vol. 5, No. 11.
@article{ca45e1fe6ca84b73b2e0a2b92840fc90,
title = "Methods for estimating causal relationships of adverse events with dietary supplements",
abstract = "Objective: Dietary supplement use has increased over past decades, resulting in reports of potentially serious adverse events. The aim of this study was to develop optimised methods to evaluate the causal relationships between adverse events and dietary supplements, and to test these methods using case reports. Design: Causal relationship assessment using prospectively collected data. Setting and participants: 4 dietary supplement experts, 4 pharmacists and 11 registered dietitians (5 men and 14 women) examined 200 case reports of suspected adverse events using the modified Naranjo scale and the modified Food and Drug Administration (FDA) algorithm. Primary outcome measures: The distribution of evaluation results was analysed and inter-rater reliability was evaluated for the two modified methods employed using intraclass correlation coefficients (ICC) and Fleiss' κ. Results: Using these two methods, most of the 200 case reports were categorised as 'lack of information' or 'possible' adverse events. Inter-rater reliability among entire assessors ratings for the two modified methods, based on ICC and Fleiss' κ, were classified as more than substantial (modified Naranjo scale: ICC (95{\%} CI) 0.873 (0.850 to 0.895); Fleiss' κ (95{\%} CI) 0.615 (0.615 to 0.615). Modified FDA algorithm: Fleiss' κ (95{\%} CI) 0.622 (0.622 to 0.622). Conclusions: These methods may help to assess the causal relationships between adverse events and dietary supplements. By conducting additional studies of these methods in different populations, researchers can expand the possibilities for the application of our methods.",
author = "Kazuki Ide and Hiroshi Yamada and Mamoru Kitagawa and Yohei Kawasaki and Yuma Buno and Kumi Matsushita and Masayuki Kaji and Kazuko Fujimoto and Masako Waki and Mitsuyoshi Nakashima and Keizo Umegaki",
year = "2015",
doi = "10.1136/bmjopen-2015-009038",
language = "English",
volume = "5",
journal = "BMJ Open",
issn = "2044-6055",
publisher = "BMJ Publishing Group",
number = "11",

}

TY - JOUR

T1 - Methods for estimating causal relationships of adverse events with dietary supplements

AU - Ide, Kazuki

AU - Yamada, Hiroshi

AU - Kitagawa, Mamoru

AU - Kawasaki, Yohei

AU - Buno, Yuma

AU - Matsushita, Kumi

AU - Kaji, Masayuki

AU - Fujimoto, Kazuko

AU - Waki, Masako

AU - Nakashima, Mitsuyoshi

AU - Umegaki, Keizo

PY - 2015

Y1 - 2015

N2 - Objective: Dietary supplement use has increased over past decades, resulting in reports of potentially serious adverse events. The aim of this study was to develop optimised methods to evaluate the causal relationships between adverse events and dietary supplements, and to test these methods using case reports. Design: Causal relationship assessment using prospectively collected data. Setting and participants: 4 dietary supplement experts, 4 pharmacists and 11 registered dietitians (5 men and 14 women) examined 200 case reports of suspected adverse events using the modified Naranjo scale and the modified Food and Drug Administration (FDA) algorithm. Primary outcome measures: The distribution of evaluation results was analysed and inter-rater reliability was evaluated for the two modified methods employed using intraclass correlation coefficients (ICC) and Fleiss' κ. Results: Using these two methods, most of the 200 case reports were categorised as 'lack of information' or 'possible' adverse events. Inter-rater reliability among entire assessors ratings for the two modified methods, based on ICC and Fleiss' κ, were classified as more than substantial (modified Naranjo scale: ICC (95% CI) 0.873 (0.850 to 0.895); Fleiss' κ (95% CI) 0.615 (0.615 to 0.615). Modified FDA algorithm: Fleiss' κ (95% CI) 0.622 (0.622 to 0.622). Conclusions: These methods may help to assess the causal relationships between adverse events and dietary supplements. By conducting additional studies of these methods in different populations, researchers can expand the possibilities for the application of our methods.

AB - Objective: Dietary supplement use has increased over past decades, resulting in reports of potentially serious adverse events. The aim of this study was to develop optimised methods to evaluate the causal relationships between adverse events and dietary supplements, and to test these methods using case reports. Design: Causal relationship assessment using prospectively collected data. Setting and participants: 4 dietary supplement experts, 4 pharmacists and 11 registered dietitians (5 men and 14 women) examined 200 case reports of suspected adverse events using the modified Naranjo scale and the modified Food and Drug Administration (FDA) algorithm. Primary outcome measures: The distribution of evaluation results was analysed and inter-rater reliability was evaluated for the two modified methods employed using intraclass correlation coefficients (ICC) and Fleiss' κ. Results: Using these two methods, most of the 200 case reports were categorised as 'lack of information' or 'possible' adverse events. Inter-rater reliability among entire assessors ratings for the two modified methods, based on ICC and Fleiss' κ, were classified as more than substantial (modified Naranjo scale: ICC (95% CI) 0.873 (0.850 to 0.895); Fleiss' κ (95% CI) 0.615 (0.615 to 0.615). Modified FDA algorithm: Fleiss' κ (95% CI) 0.622 (0.622 to 0.622). Conclusions: These methods may help to assess the causal relationships between adverse events and dietary supplements. By conducting additional studies of these methods in different populations, researchers can expand the possibilities for the application of our methods.

UR - http://www.scopus.com/inward/record.url?scp=84956904487&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84956904487&partnerID=8YFLogxK

U2 - 10.1136/bmjopen-2015-009038

DO - 10.1136/bmjopen-2015-009038

M3 - Article

C2 - 26526808

AN - SCOPUS:84956904487

VL - 5

JO - BMJ Open

JF - BMJ Open

SN - 2044-6055

IS - 11

M1 - e009038

ER -