The study design elements employed by researchers in preclinical animal experiments from two research domains and implications for automation of systematic reviews

Thumbnail Image
Date
2018-06-28
Authors
Totton, Sarah
Ramezani, Mahmood
Kalivarapu, Vijay
Yuan, Chaohui
Gilbert, Stephen
Major Professor
Advisor
Committee Member
Journal Title
Journal ISSN
Volume Title
Publisher
Authors
Person
O'Connor, Annette
Professor
Person
Kalivarapu, Vijay
Teaching Professor
Person
Gilbert, Stephen
Associate Professor
Research Projects
Organizational Units
Organizational Unit
Organizational Unit
Psychology
The Department of Psychology may prepare students with a liberal study, or for work in academia or professional education for law or health-services. Graduates will be able to apply the scientific method to human behavior and mental processes, as well as have ample knowledge of psychological theory and method.
Organizational Unit
Statistics
As leaders in statistical research, collaboration, and education, the Department of Statistics at Iowa State University offers students an education like no other. We are committed to our mission of developing and applying statistical methods, and proud of our award-winning students and faculty.
Organizational Unit
Veterinary Diagnostic and Production Animal Medicine
The mission of VDPAM is to educate current and future food animal veterinarians, population medicine scientists and stakeholders by increasing our understanding of issues that impact the health, productivity and well-being of food and fiber producing animals; developing innovative solutions for animal health and food safety; and providing the highest quality, most comprehensive clinical practice and diagnostic services. Our department is made up of highly trained specialists who span a wide range of veterinary disciplines and species interests. We have faculty of all ranks with expertise in diagnostics, medicine, surgery, pathology, microbiology, epidemiology, public health, and production medicine. Most have earned certification from specialty boards. Dozens of additional scientists and laboratory technicians support the research and service components of our department.
Organizational Unit
Industrial and Manufacturing Systems Engineering
The Department of Industrial and Manufacturing Systems Engineering teaches the design, analysis, and improvement of the systems and processes in manufacturing, consulting, and service industries by application of the principles of engineering. The Department of General Engineering was formed in 1929. In 1956 its name changed to Department of Industrial Engineering. In 1989 its name changed to the Department of Industrial and Manufacturing Systems Engineering.
Journal Issue
Is Version Of
Versions
Series
Department
Virtual Reality Applications CenterPsychologyStatisticsVeterinary Diagnostic and Production Animal MedicineIndustrial and Manufacturing Systems EngineeringHuman Computer InteractionVirtual Reality Applications Center
Abstract

Systematic reviews are increasingly using data from preclinical animal experiments in evidence networks. Further, there are ever-increasing efforts to automate aspects of the systematic review process. When assessing systematic bias and unit-of-analysis errors in preclinical experiments, it is critical to understand the study design elements employed by investigators. Such information can also inform prioritization of automation efforts that allow the identification of the most common issues. The aim of this study was to identify the design elements used by investigators in preclinical research in order to inform unique aspects of assessment of bias and error in preclinical research. Using 100 preclinical experiments each related to brain trauma and toxicology, we assessed design elements described by the investigators. We evaluated Methods and Materials sections of reports for descriptions of the following design elements: 1) use of comparison group, 2) unit of allocation of the interventions to study units, 3) arrangement of factors, 4) method of factor allocation to study units, 5) concealment of the factors during allocation and outcome assessment, 6) independence of study units, and 7) nature of factors. Many investigators reported using design elements that suggested the potential for unit-of-analysis errors, i.e., descriptions of repeated measurements of the outcome (94/200) and descriptions of potential for pseudo-replication (99/200). Use of complex factor arrangements was common, with 112 experiments using some form of factorial design (complete, incomplete or split-plot-like). In the toxicology dataset, 20 of the 100 experiments appeared to use a split-plot-like design, although no investigators used this term. The common use of repeated measures and factorial designs means understanding bias and error in preclinical experimental design might require greater expertise than simple parallel designs. Similarly, use of complex factor arrangements creates novel challenges for accurate automation of data extraction and bias and error assessment in preclinical experiments.

Comments

This article is published as O'Connor AM, Totton SC, Cullen JN, Ramezani M, Kalivarapu V, Yuan C, et al. (2018) The study design elements employed by researchers in preclinical animal experiments from two research domains and implications for automation of systematic reviews. PLoS ONE 13(6): e0199441. doi: 10.1371/journal.pone.0199441.

Description
Keywords
Citation
DOI
Copyright
Mon Jan 01 00:00:00 UTC 2018
Collections