A federal health advisory committee's recent report on COVID-19 vaccine safety relied on unvalidated diagnostic tests, a Japanese opinion piece instead of rigorous data, and prevalence estimates that varied by 300-fold, prompting a federal judge to rule the committee's process likely violated the law. What Happened to Evidence-Based Vaccine Decision-Making? The Advisory Committee on Immunization Practices (ACIP), reconstituted under Health and Human Services Secretary Robert F. Kennedy Jr., prepared a report on what it calls "post-acute COVID-19 vaccination syndrome," or PACVS. The condition describes prolonged symptoms affecting multiple organ systems that persist at least 12 weeks after vaccination and cannot be explained by another condition. However, the scientific foundation supporting this new clinical entity is remarkably weak. The report's own summary acknowledges that "existing prevalence estimates range from 0.003% of the general population to 0.9% of young and middle-aged persons." That is a 300-fold difference in a single sentence, drawn from a single cited paper. A clinical entity whose prevalence cannot be estimated within three orders of magnitude is not ready for official diagnostic coding. It is ready for more research. U.S. District Court Judge Brian Murphy arrived at a similar conclusion through a legal route. In a preliminary ruling, he found that the reconstitution of ACIP and the changes made to the childhood vaccine schedule in January were likely illegal, violating the Administrative Procedure Act. "There is a method to how these decisions historically have been made," Murphy wrote in his 45-page opinion, "a method scientific in nature and codified into law through procedural requirements. Unfortunately, the Government has disregarded those methods and thereby undermined the integrity of its actions". Why Are the Report's Diagnostic Tests Problematic? The ACIP report recommends a battery of tests for evaluating suspected PACVS patients, then states in its appendix that some of those tests "did not go through comprehensive clinical validation and cost-effectiveness evaluation." This creates a fundamental logical problem. The report argues that normal routine laboratory results "do not rule out immune, microvascular, autonomic, or mitochondrial pathology." A diagnostic system built on unvalidated tests where normal results cannot exclude disease is not a clinical pathway. It is a framework that cannot be falsified, one designed so that a clinician can never tell patients they do not have the condition being evaluated. The report's most consequential claim appears on page 39, stating that "an analysis of a Japanese database of 18 million people showed that people who received COVID-19 vaccines had a significantly higher risk of death in the first year after vaccination compared to the unvaccinated, and the risk increased with each additional dose." However, the citation behind this claim does not support it. The cited publication is a three-page opinion piece in a Japanese journal that presents no original data, no database analysis, and no study of 18 million people. It is a narrative argument that juxtaposes vaccination rates and mortality trends without any statistical analysis, what epidemiologists call an ecological fallacy. How Should Health Officials Evaluate Vaccine Safety Evidence? - Active Surveillance Systems: The Vaccine Safety Datalink (VSD) is an active surveillance system embedded in major U.S. health systems covering millions of patients with verified clinical diagnoses in both vaccinated and unvaccinated populations. VSD data show post-vaccination mortality consistently below background rates across every age-group analyzed, with an observed-to-expected ratio of less than one in every cohort from six months through age 65 and older. - Peer-Reviewed Literature: Separate VSD analyses confirm no increased risk of all-cause mortality, cardiac mortality, or non-COVID mortality following vaccination across both Pfizer and Moderna products. These findings represent years of domestic active surveillance data, not opinion pieces. - Methodological Rigor: A formal critique published in the same Japanese journal three months before the ACIP report was finalized identified the cited paper as committing textbook ecological fallacy, misusing government data that Japan's own Ministry of Health had explicitly warned must not be used to evaluate vaccine effectiveness, and citing a study on cancer mortality that had already been formally retracted due to serious methodological flaws. The report's evidentiary baseline is worth noting. Before citing any peer-reviewed literature, the document invokes a Rasmussen Reports survey, conducted by a political polling firm, finding that 24% of survey participants reported knowing someone who died from a COVID vaccine. Rasmussen polls are not tools to detect adverse vaccine outcomes. They do not establish causation, biological plausibility, or accurate recall. Using such a survey to anchor a federal policy document's case for widespread vaccine mortality tells you something about the standards at work throughout the work group report. What Did the Committee's Own Members Say About the Report? Notably, three members of the work group itself expressed reservations about the report's conclusions in writing. Henry Bernstein, DO, MHCM, wrote that "it is challenging to make specific recommendations based upon the imbalanced presentation and discussion of the data." Mitchell Miglis, MD, wrote that he "does not agree with the utilization of some of the assays mentioned in the Appendices IA and IB that are currently not validated for clinical use." These dissents appear in the report's own appendix, suggesting internal disagreement about the document's scientific foundation. The ACIP meeting scheduled to vote on the report was postponed after Judge Murphy's preliminary ruling. The committee, as currently constituted, cannot vote. Meanwhile, the leaked work group report has circulated widely, revealing what critics argue is a departure from the evidence-based process that has historically guided vaccine safety decisions in America. This situation highlights a broader tension in public health decision-making. While the original 2021 COVID-19 vaccines did trigger a rare myocarditis signal in young people, that signal was detected, acted upon, and has since returned to background levels with every formulation on the market today. Relitigating historical concerns in 2026 while ignoring current surveillance data represents, according to experts, a fixation on historical grievance at the expense of present-day public health priorities.