Study Design 101
A document often written by a panel that provides a comprehensive review of all relevant studies on a particular clinical or health-related topic/question. The systematic review is created after reviewing and combining all the information from both published and unpublished studies (focusing on clinical trials of similar treatments) and then summarizing the findings.
- Exhaustive review of the current literature and other sources (unpublished studies, ongoing research)
- Less costly to review prior studies than to create a new study
- Less time required than conducting a new study
- Results can be generalized and extrapolated into the general population more broadly than individual studies
- More reliable and accurate than individual studies
- Considered an evidence-based resource
- Very time-consuming
- May not be easy to combine studies
Design pitfalls to look out for
Studies included in systematic reviews may be of varying study designs, but should collectively be studying the same outcome.
Is each study included in the review studying the same variables?
Some reviews may group and analyze studies by variables such as age and gender; factors that were not allocated to participants.
Do the analyses in the systematic review fit the variables being studied in the original studies?
Does the regular wearing of ultraviolet-blocking sunscreen prevent melanoma? An exhaustive literature search was conducted, resulting in 54 studies on sunscreen and melanoma. Each study was then evaluated to determine whether the study focused specifically on ultraviolet-blocking sunscreen and melanoma prevention; 30 of the 54 studies were retained. The thirty studies were reviewed and showed a strong positive relationship between daily wearing of sunscreen and a reduced diagnosis of melanoma.
Yang, J., Chen, J., Yang, M., Yu, S., Ying, L., Liu, G., ... Liang, F. (2018). Acupuncture for hypertension. The Cochrane Database of Systematic Reviews, 11(11), CD008821. https://doi.org/10.1002/14651858.CD008821.pub2
This systematic review analyzed twenty-two randomized controlled trials to determine whether acupuncture is a safe and effective way to lower blood pressure in adults with primary hypertension. Due to the low quality of evidence in these studies and lack of blinding, it is not possible to link any short-term decrease in blood pressure to the use of acupuncture. Additional research is needed to determine if there is an effect due to acupuncture that lasts at least seven days.
Parker, H.W. and Vadiveloo, M.K. (2019). Diet quality of vegetarian diets compared with nonvegetarian diets: a systematic review. Nutrition Reviews, https://doi.org/10.1093/nutrit/nuy067
This systematic review was interested in comparing the diet quality of vegetarian and non-vegetarian diets. Twelve studies were included. Vegetarians more closely met recommendations for total fruit, whole grains, seafood and plant protein, and sodium intake. In nine of the twelve studies, vegetarians had higher overall diet quality compared to non-vegetarians. These findings may explain better health outcomes in vegetarians, but additional research is needed to remove any possible confounding variables.
Now test yourself!
Study Design 101 by Himmelfarb Health Sciences Library is licensed under a Creative Commons Attribution-NonCommercial-NoDerivs 3.0 Unported License.