To compare a clinical guideline with the studies it cites, start by extracting the full reference list from the guideline document, then systematically retrieve and evaluate each cited study against the guideline's recommendations.
Step 1: Extract and Organize Citations
Download the guideline PDF and create a spreadsheet listing every citation with its recommendation context. Note which specific recommendation each study supports — guidelines often cite the same paper multiple times for different claims. This mapping reveals whether high-impact recommendations rest on strong evidence or weak studies.
Step 2: Retrieve the Full Texts
Use your institution's library access or open-access repositories to obtain PDFs of the cited studies. For large reference lists, WisPaper's My Library can automatically extract metadata and organize papers by topic, making it easier to manage dozens of citations while allowing you to chat with the full-text content to quickly verify specific claims.
Step 3: Assess Study Quality
For each citation, evaluate the study design (RCT, cohort, case series), sample size, risk of bias, and relevance to the guideline's population. Check if the guideline accurately represents the study's findings — misinterpretation or selective citation can occur. Create a simple quality matrix: high/moderate/low evidence for each recommendation.
Step 4: Identify Gaps and Conflicts
Look for recommendations based on expert opinion rather than empirical data, outdated studies (>10 years old in fast-moving fields), or conflicting results across cited papers. Note any recent meta-analyses or systematic reviews the guideline may have missed.
Step 5: Cross-Reference with Current Literature
Search for newer studies published after the guideline's release that might contradict or refine its recommendations. Clinical guidelines often lag 2-3 years behind emerging evidence due to lengthy development cycles.
This systematic comparison helps you understand the evidence base's strength, identify where clinical practice might diverge from the best available data, and recognize when guidelines need updating. It's especially valuable for controversial recommendations or when deciding whether to adopt new guidelines in your practice setting.

