دورية أكاديمية
أعرض في EDS

Investigation of bias due to selective inclusion of study effect estimates in meta-analyses of nutrition research.

التفاصيل البيبلوغرافية
العنوان: Investigation of bias due to selective inclusion of study effect estimates in meta-analyses of nutrition research.
المؤلفون: Kanukula R; Methods in Evidence Synthesis Unit, School of Public Health and Preventative Medicine, Monash University, Melbourne, Victoria, Australia., McKenzie JE; Methods in Evidence Synthesis Unit, School of Public Health and Preventative Medicine, Monash University, Melbourne, Victoria, Australia., Bero L; Center for Bioethics and Humanities, University of Colorado Anschutz Medical Campus, Aurora, CO, United States., Dai Z; Charles Perkins Centre, School of Pharmacy, Faculty of Medicine and Health, The University of Sydney, Camperdown, New South Wales, Australia., McDonald S; Charles Perkins Centre, School of Pharmacy, Faculty of Medicine and Health, The University of Sydney, Camperdown, New South Wales, Australia., Kroeger CM; Charles Perkins Centre, Central Clinical School, Faculty of Medicine and Health, The University of Sydney, Camperdown, New South Wales, Australia., Korevaar E; Methods in Evidence Synthesis Unit, School of Public Health and Preventative Medicine, Monash University, Melbourne, Victoria, Australia., Forbes A; Methods in Evidence Synthesis Unit, School of Public Health and Preventative Medicine, Monash University, Melbourne, Victoria, Australia., Page MJ; Methods in Evidence Synthesis Unit, School of Public Health and Preventative Medicine, Monash University, Melbourne, Victoria, Australia.
المصدر: Research synthesis methods [Res Synth Methods] 2024 Jul; Vol. 15 (4), pp. 524-542. Date of Electronic Publication: 2024 Feb 05.
نوع المنشور: Journal Article
اللغة: English
بيانات الدورية: Publisher: Wiley Blackwell Country of Publication: England NLM ID: 101543738 Publication Model: Print-Electronic Cited Medium: Internet ISSN: 1759-2887 (Electronic) Linking ISSN: 17592879 NLM ISO Abbreviation: Res Synth Methods Subsets: MEDLINE
أسماء مطبوعة: Publication: : Chichester : Wiley Blackwell
Original Publication: Malden, MA : John Wiley & Sons, 2010-
مواضيع طبية MeSH: Meta-Analysis as Topic* , Systematic Reviews as Topic* , Bias* , Research Design* , Diet*, Humans ; Nutritional Sciences ; Selection Bias ; Reproducibility of Results ; Publication Bias ; Food
مستخلص: We aimed to explore, in a sample of systematic reviews (SRs) with meta-analyses of the association between food/diet and health-related outcomes, whether systematic reviewers selectively included study effect estimates in meta-analyses when multiple effect estimates were available. We randomly selected SRs of food/diet and health-related outcomes published between January 2018 and June 2019. We selected the first presented meta-analysis in each review (index meta-analysis), and extracted from study reports all study effect estimates that were eligible for inclusion in the meta-analysis. We calculated the Potential Bias Index (PBI) to quantify and test for evidence of selective inclusion. The PBI ranges from 0 to 1; values above or below 0.5 suggest selective inclusion of effect estimates more or less favourable to the intervention, respectively. We also compared the index meta-analytic estimate to the median of a randomly constructed distribution of meta-analytic estimates (i.e., the estimate expected when there is no selective inclusion). Thirty-nine SRs with 312 studies were included. The estimated PBI was 0.49 (95% CI 0.42-0.55), suggesting that the selection of study effect estimates from those reported was consistent with a process of random selection. In addition, the index meta-analytic effect estimates were similar, on average, to what we would expect to see in meta-analyses generated when there was no selective inclusion. Despite this, we recommend that systematic reviewers report the methods used to select effect estimates to include in meta-analyses, which can help readers understand the risk of selective inclusion bias in the SRs.
(© 2024 The Authors. Research Synthesis Methods published by John Wiley & Sons Ltd.)
References: Kurien VTV, Shamsuddeen S, Mahitha M, Rasheed DS. Evidence‐based decision‐making. J Head Neck Phys Surg. 2022;10(1):48.
Schünemann HJ, Wiercioch W, Etxeandia I, et al. Guidelines 2.0: systematic development of a comprehensive checklist for a successful guideline enterprise. CMAJ. 2014;186(3):E123‐E142.
Mayo‐Wilson E, Fusco N, Li T, Hong H, Canner JK, Dickersin K. Multiple outcomes and analyses in clinical trials create challenges for interpretation and research synthesis. J Clin Epidemiol. 2017;86:39‐50.
Page MJ, McKenzie JE, Forbes A. Many scenarios exist for selective inclusion and reporting of results in randomized trials and systematic reviews. J Clin Epidemiol. 2013;66(5):524‐537.
Kanukula R, McKenzie JE, Bero L, et al. Methods used to select results to include in meta‐analyses of nutrition research: a meta‐research study. J Clin Epidemiol. 2022;142:171‐183.
López‐López JA, Page MJ, Lipsey MW, Higgins JPT. Dealing with effect size multiplicity in systematic reviews and meta‐analyses. Res Synth Methods. 2018;9(3):336‐351.
Konstantopoulos S. Fixed effects and variance components estimation in three‐level meta‐analysis. Res Synth Methods. 2011;2(1):61‐76.
Hedges LV, Tipton E, Johnson MC. Robust variance estimation in meta‐regression with dependent effect size estimates. Res Synth Methods. 2010;1(1):39‐65.
Page MJ, McKenzie JE, Chau M, Green SE, Forbes A. Methods to select results to include in meta‐analyses deserve more consideration in systematic reviews. J Clin Epidemiol. 2015;68(11):1282‐1291.
Page MJ, Forbes A, Chau M, Green SE, McKenzie JE. Investigation of bias in meta‐analyses due to selective inclusion of trial effect estimates: empirical study. BMJ Open. 2016;6(4):e011863.
Page MJ, Bero L, Kroeger CM, et al. Investigation of risk of bias due to unreported and selectively included results in meta‐analyses of nutrition research: the ROBUST study protocol. F1000Research. 2019;8:1760.
Higgins JP, Thomas J, Chandler J, et al. Cochrane Handbook for Systematic Reviews of Interventions. John Wiley & Sons; 2019.
Harris PA, Taylor R, Minor BL, et al. The REDCap consortium: building an international community of software platform partners. J Biomed Inform. 2019;95:103208.
Page MJ, McKenzie JE, Green SE, Forbes AB. An empirical investigation of the potential impact of selective inclusion of results in systematic reviews of interventions: study protocol. Syst Rev. 2013;2:21.
Efron B, Tibshirani R. An Introduction to the Bootstrap. Chapman & Hall; 1993.
Hartung J, Knapp G. A refined method for the meta‐analysis of controlled clinical trials with binary outcome. Stat Med. 2001;20(24):3875‐3889.
Sidik K, Jonkman JN. A simple confidence interval for meta‐analysis. Stat Med. 2002;21(21):3153‐3159.
Higgins JP, Thompson SG, Deeks JJ, Altman DG. Measuring inconsistency in meta‐analyses. BMJ. 2003;327(7414):557‐560.
Deeks JJ, Higgins JP, Altman D. Chapter 10: Analysing data and undertaking meta‐analyses. In: Higgins JP, Thomas J, Chandler J, et al., eds. Cochrane Handbook for Systematic Reviews of Interventions. John Wiley & Sons; 2019.
Herbison P, Robertson MC, McKenzie JE. Do alternative methods for analysing count data produce similar estimates? Implications for meta‐analyses. Syst Rev. 2015;4(1):163.
Chinn S. A simple method for converting an odds ratio to effect size for use in meta‐analysis. Stat Med. 2000;19(22):3127‐3131.
StataCorp LLC. Stata Statistical Software: Release 16. StataCorp; 2019.
Ayoub‐Charette S, Liu Q, Khan TA, et al. Important food sources of fructose‐containing sugars and incident gout: a systematic review and meta‐analysis of prospective cohort studies. BMJ Open. 2019;9(5):e024171.
Cheng S, Zheng Q, Ding G, Li G. Mediterranean dietary pattern and the risk of prostate cancer: a meta‐analysis. Medicine. 2019;98(27):e16341.
Choo VL, Viguiliouk E, Mejia SB, et al. Food sources of fructose‐containing sugars and glycaemic control: systematic review and meta‐analysis of controlled intervention studies. BMJ. 2018;363:k4644.
de Magalhães CC, Costa PR, de Oliveira LP, Valterlinda AO, Pitangueira JC, Oliveira AM. Dietary patterns and cardiometabolic risk factors among adolescents: systematic review and meta‐analysis. Br J Nutr. 2018;119(8):859‐879.
Eaton JC, Rothpletz‐Puglia P, Dreker MR, et al. Effectiveness of provision of animal‐source foods for supporting optimal growth and development in children 6 to 59 months of age. Cochrane Database Syst Rev. 2019;2(2):CD012818.
George ES, Marshall S, Mayr HL, et al. The effect of high‐polyphenol extra virgin olive oil on cardiovascular risk factors: a systematic review and meta‐analysis. Crit Rev Food Sci Nutr. 2019;59(17):2772‐2795.
Ghaedi E, Mohammadi M, Mohammadi H, et al. Effects of a Paleolithic diet on cardiovascular disease risk factors: a systematic review and meta‐analysis of randomized controlled trials. Adv Nutr. 2019;10(4):634‐646.
Haider LM, Schwingshackl L, Hoffmann G, Ekmekcioglu C. The effect of vegetarian diets on iron status in adults: a systematic review and meta‐analysis. Crit Rev Food Sci Nutr. 2018;58(8):1359‐1374.
Hou R, Wei J, Hu Y, et al. Healthy dietary patterns and risk and survival of breast cancer: a meta‐analysis of cohort studies. Cancer Causes Control. 2019;30(8):835‐846.
Huang Y, Zheng S, Wang T, Yang X, Luo Q, Li H. Effect of oral nut supplementation on endothelium‐dependent vasodilation–a meta‐analysis. Vasa. 2018;47(3):203‐207.
Iguacel I, Miguel‐Berges ML, Gómez‐Bruton A, Moreno LA, Julián C. Veganism, vegetarianism, bone mineral density, and fracture risk: a systematic review and meta‐analysis. Nutr Rev. 2019;77(1):1‐18.
Kang K, Sotunde OF, Weiler HA. Effects of milk and milk‐product consumption on growth among children and adolescents aged 6–18 years: a meta‐analysis of randomized controlled trials. Adv Nutr. 2019;10(2):250‐261.
Kibret KT, Chojenta C, Gresham E, Tegegne TK, Loxton D. Maternal dietary patterns and risk of adverse pregnancy (hypertensive disorders of pregnancy and gestational diabetes mellitus) and birth (preterm birth and low birth weight) outcomes: a systematic review and meta‐analysis. Public Health Nutr. 2019;22(3):506‐520.
Kodama S, Horikawa C, Fujihara K, et al. Relationship between intake of fruit separately from vegetables and triglycerides‐a meta‐analysis. Clin Nutr ESPEN. 2018;27:53‐58.
Kojima G, Avgerinou C, Iliffe S, Walters K. Adherence to Mediterranean diet reduces incident frailty risk: systematic review and meta‐analysis. J Am Geriatr Soc. 2018;66(4):783‐788.
Larsson SC, Drca N, Jensen‐Urstad M, Wolk A. Chocolate consumption and risk of atrial fibrillation: two cohort studies and a meta‐analysis. Am Heart J. 2018;195:86‐90.
Li R, Yu K, Li C. Dietary factors and risk of gout and hyperuricemia: a meta‐analysis and systematic review. Asia Pac J Clin Nutr. 2018;27(6):1344‐1356.
Li W, Ruan W, Peng Y, Wang D. Soy and the risk of type 2 diabetes mellitus: a systematic review and meta‐analysis of observational studies. Diabetes Res Clin Pract. 2018;137:190‐199.
Li L, Lietz G, Seal C. Buckwheat and CVD risk markers: a systematic review and meta‐analysis. Nutrients. 2018;10(5):619.
Lopez PD, Cativo EH, Atlas SA, Rosendorff C. The effect of vegan diets on blood pressure in adults: a meta‐analysis of randomized controlled trials. Am J Med. 2019;132(7):875‐883.
Maki KC, Palacios OM, Koecher K, et al. The relationship between whole grain intake and body weight: results of meta‐analyses of observational studies and randomized controlled trials. Nutrients. 2019;11(6):1245.
Matía‐Martín P, Torrego‐Ellacuría M, Larrad‐Sainz A, Fernández‐Pérez C, Cuesta‐Triana F, Rubio‐Herrera MÁ. Effects of milk and dairy products on the prevention of osteoporosis and osteoporotic fractures in Europeans and non‐Hispanic whites from North America: a systematic review and updated meta‐analysis. Adv Nutr. 2019;10(suppl 2):S120‐S143.
Mena‐Sánchez G, Becerra‐Tomás N, Babio N, Salas‐Salvadó J. Dairy product consumption in the prevention of metabolic syndrome: a systematic review and meta‐analysis of prospective cohort studies. Adv Nutr. 2019;10(suppl 2):S144‐S153.
Milajerdi A, Namazi N, Larijani B, Azadbakht L. The association of dietary quality indices and cancer mortality: a systematic review and meta‐analysis of cohort studies. Nutr Cancer. 2018;70(7):1091‐1105.
Mishali M, Prizant‐Passal S, Avrech T, Shoenfeld Y. Association between dairy intake and the risk of contracting type 2 diabetes and cardiovascular diseases: a systematic review and meta‐analysis with subgroup analysis of men versus women. Nutr Rev. 2019;77(6):417‐429.
Mohseni R, Abbasi S, Mohseni F, Rahimi F, Alizadeh S. Association between dietary inflammatory index and the risk of prostate cancer: a meta‐analysis. Nutr Cancer. 2019;71(3):359‐366.
Namazi N, Larijani B, Azadbakht L. Dietary inflammatory index and its association with the risk of cardiovascular diseases, metabolic syndrome, and mortality: a systematic review and meta‐analysis. Horm Metab Res. 2018;50(5):345‐358.
Picasso MC, Lo‐Tayraco JA, Ramos‐Villanueva JM, Pasupuleti V, Hernandez AV. Effect of vegetarian diets on the presentation of metabolic syndrome or its components: a systematic review and meta‐analysis. Clin Nutr. 2019;38(3):1117‐1132.
Qin Z‐Z, Xu J‐Y, Chen G‐C, Ma Y‐X, Qin L‐Q. Effects of fatty and lean fish intake on stroke risk: a meta‐analysis of prospective cohort studies. Lipids Health Dis. 2018;17(1):1‐7.
Rees K, Takeda A, Martin N, et al. Mediterranean‐style diet for the primary and secondary prevention of cardiovascular disease. Cochrane Database Syst Rev. 2019;3(3):CD009825.
Ren Y, Liu Y, Sun X‐Z, et al. Chocolate consumption and risk of cardiovascular diseases: a meta‐analysis of prospective studies. Heart. 2019;105(1):49‐55.
Shab‐Bidar S, Golzarand M, Hajimohammadi M, Mansouri S. A posteriori dietary patterns and metabolic syndrome in adults: a systematic review and meta‐analysis of observational studies. Public Health Nutr. 2018;21(9):1681‐1692.
Shafiei F, Salari‐Moghaddam A, Larijani B, Esmaillzadeh A. Adherence to the Mediterranean diet and risk of depression: a systematic review and updated meta‐analysis of observational studies. Nutr Rev. 2019;77(4):230‐239.
Teoh SL, Lai NM, Vanichkulpitak P, Vuksan V, Ho H, Chaiyakunapruk N. Clinical evidence on dietary supplementation with chia seed (Salvia hispanica L.): a systematic review and meta‐analysis. Nutr Rev. 2018;76(4):219‐242.
Voon PT, Lee ST, Ng TKW, et al. Intake of palm olein and lipid status in healthy adults: a meta‐analysis. Adv Nutr. 2019;10(4):647‐659.
Wang L, Liu C, Zhou C, et al. Meta‐analysis of the association between the dietary inflammatory index (DII) and breast cancer risk. Eur J Clin Nutr. 2019;73(4):509‐517.
Xiao Y, Ke Y, Wu S, et al. Association between whole grain intake and breast cancer risk: a systematic review and meta‐analysis of observational studies. Nutr J. 2018;17(1):1‐12.
Xu Y, Yang J, Du L, Li K, Zhou Y. Association of whole grain, refined grain, and cereal consumption with gastric cancer risk: a meta‐analysis of observational studies. Food Sci Nutr. 2019;7(1):256‐265.
Zhang Z, Chen G‐C, Qin Z‐Z, Tong X, Li D‐P, Qin L‐Q. Poultry and fish consumption in relation to total cancer mortality: a meta‐analysis of prospective studies. Nutr Cancer. 2018;70(2):204‐212.
Bermejo LM, López‐Plaza B, Santurino C, Cavero‐Redondo I, Gómez‐Candela C. Milk and dairy product consumption and bladder cancer risk: a systematic review and meta‐analysis of observational studies. Adv Nutr. 2019;10(suppl 2):S224‐S238.
Malmir H, Saneei P, Larijani B, Esmaillzadeh A. Adherence to Mediterranean diet in relation to bone mineral density and risk of fracture: a systematic review and meta‐analysis of observational studies. Eur J Nutr. 2018;57(6):2147‐2160.
Musa‐Veloso K, Poon T, Harkness LS, O'Shea M, Chu Y. The effects of whole‐grain compared with refined wheat, rice, and rye on the postprandial blood glucose response: a systematic review and meta‐analysis of randomized controlled trials. Am J Clin Nutr. 2018;108(4):759‐774.
Mayo‐Wilson E, Li T, Fusco N, et al. Cherry‐picking by trialists and meta‐analysts can drive conclusions about intervention efficacy. J Clin Epidemiol. 2017;91:95‐110.
Page MJ, McKenzie JE, Bossuyt PM, et al. The PRISMA 2020 statement: an updated guideline for reporting systematic reviews. BMJ. 2021;372:n71.
Ebrahim S, Bance S, Athale A, Malachowski C, Ioannidis JP. Meta‐analyses with industry involvement are massively published and report no caveats for antidepressants. J Clin Epidemiol. 2016;70:155‐163.
Mayo‐Wilson E, Fusco N, Li T, et al. Harms are assessed inconsistently and reported inadequately part 1: systematic adverse events. J Clin Epidemiol. 2019;113:20‐27.
Mayo‐Wilson E, Fusco N, Li T, et al. Harms are assessed inconsistently and reported inadequately part 2: nonsystematic adverse events. J Clin Epidemiol. 2019;113:11‐19.
معلومات مُعتمدة: APP1139997 Australian National Health and Medical Research Council (NHMRC); Monash Graduate Scholarship and a Monash International Tuition Scholarship; GNT2009612 Australian NHMRC Investigator Grant; Country Women's Association (NSW); Edna Winifred Blackman Postgraduate Research Scholarship; DE200101618 Australian Research Council Discovery Early Career Researcher Award; Research Support Package of JEM's NHMRC Investigator Grant; FLPF23-1069865460 Monash University Future Leader Postdoctoral Fellowship
فهرسة مساهمة: Keywords: bias; meta‐analysis; nutrition; selective inclusion; systematic review
تواريخ الأحداث: Date Created: 20240205 Date Completed: 20240711 Latest Revision: 20240715
رمز التحديث: 20240715
DOI: 10.1002/jrsm.1706
PMID: 38316613
قاعدة البيانات: MEDLINE
الوصف
تدمد:1759-2887
DOI:10.1002/jrsm.1706