Structure the check as a dated rerun of every documented search string in each named source, followed by a count comparison and a written record of any platform or syntax drift. The Cochrane Handbook treats documenting searches and managing records as part of the review's search process, and PRISMA 2020 asks reviewers to report transparently what methods were used and what studies were found, so the check produces two deliverables: a reproducibility statement and a deviation list to disclose.
Step-by-step structure
-
Assemble the documented search record. Collect the exact string, the source (database or platform), any filters or limits, and the date each search was originally run. The Cochrane Handbook describes documenting searches as part of planning and running them, so the record should match what the manuscript reports.
-
Fix a rerun date and rerun each string as written. Run the strings exactly as documented on the stated date, in the same named source, without silently correcting syntax. PubMed's field tags, phrase searching, and filters mean a string can behave differently across interfaces, so the rerun should reproduce the original environment as closely as the record allows.
-
Record the count for each string and compare with the original. Log original count, rerun count, and the difference per source. A changed count is a result to report, not a failure of the check.
-
Note platform or syntax drift. Where a string no longer runs as written, or where the interface has changed how a tag, phrase, or filter is interpreted, record the specific element that changed and how you handled it. PubMed's User Guide documents field tags, phrase searching, filters, and Advanced Search, which are the elements most likely to shift between runs.
-
Write the reproducibility statement. State the sources searched, the date of the rerun, the strings used, and the counts obtained. PRISMA 2020's checklist and flow diagrams give the reporting frame for methods and for the studies found and included.
-
List deviations to disclose. For each difference, record the source, the string element affected, the count change, and the action taken. Disclose these alongside the search methods so reviewers can see what changed between the original search and the rerun.
What the check produces
The reproducibility statement and the deviation list together give peer reviewers a dated, source-by-source account of the search. Keep the raw rerun output with the manuscript files so the counts and any syntax changes can be traced to the exact strings and dates reported.
