Comparing and FDA review for accuracy and completeness

By Melissa Fassbender contact

- Last updated on GMT

The researchers tried to validate posted results against “an arguably better gold standard.” (Image: iStock)
The researchers tried to validate posted results against “an arguably better gold standard.” (Image: iStock)

Related tags: Scientific method, Clinical trial

Clinical trial sponsors are required by law to report results to; however it’s not clear if these posts are complete and accurate.

In order to compare the validity of sponsor-submitted results posted on with corresponding information on Drugs@FDA, researchers Lisa Schwartz and Steven Woloshin from The Dartmouth Institute for Health Policy and Clinical Practice, collaborated with researchers from the U.S. National Library of Medicine (NLM).

Woloshin, MD, Professor, Medicine and Community & Family Medicine, Dartmouth Institute, told us that “Recent studies attempting to validate posted results by comparing them to corresponding peer reviewed medical journal publications suggest that discrepancies are relatively common​.”

However, in their research, Woloshin explained they tried to validate posted results against “an arguably better gold standard​.”

According to Woloshin, this standard, the drug approval packages from the FDA, which includes the medical and statistical reviews posted on the qehtf@sqn.tbi​ website, has several advantages over peer reviewed publications.

Mainly, unlike medical journal editors and peer reviewers, the FDA has access to the individual participant data from the trials.

This means FDA can see all the trials and all the outcomes (avoiding selective publication) and it means FDA can independently reanalyze according to what they believe to be the best statistical practices (data can be analyzed in many ways - and different decisions, for example, how to account for missing data, can yield very different results)​,” said Woloshin.


The researchers were “pleasantly surprised​” at how close primary outcome information in posts were to the FDA review materials. Yet, Woloshin noted that it’s important to be clear that "primary outcomes​" mean those outcomes that are the main focus of the trial, “but these are not necessarily the most important outcomes,” ​he added.

For example, companies may designate number of pounds lost in a weight loss trial as primary, but the percent of people who lose a meaningful amount of weight, which might be a secondary outcome, “is arguably much more important​,” explained Woloshin.

Ultimately, according to the researchers, the takeaway is that and FDA reviews serve different purposes.

Specifically, Woloshin explained that is meant to provide a complete reporting of all summary data as planned in the study protocols, while FDA reviews provide FDA's take: “independent, expert assessment of the evidence as analyzed for the purposes of regulatory decision making​,” added Woloshin.

The researchers concluded that even if the numbers reported on were accurate, there would still be question surrounding trial design, conduct, or analysis – which could affected trial result conclusions assessed in Drugs@FDA.

For example, reviewers may have raised questions about the appropriateness of an active comparator used (or its dose) or about unvalidated outcome measures​,” the researchers said.

These sources are complementary​,” added Woloshin. “ClinicalTrials gives ‘all the data,’ FDA gives context for interpreting the evidence​.”

Moving forward, the researchers believe that all sponsors can be much clearer about which secondary outcomes are pre-specified and which were exploratory. “Data discrepancies varied some across companies​,” said Woloshin, but “all companies can work hard to make sure their information is accurate and complete​.”

Related news

Show more

Related products

show more

How clinical trial software can optimize trials

How clinical trial software can optimize trials

Formedix | 20-Jun-2022 | Technical / White Paper

This article explains the different types of clinical trial software available, and how it can be used to optimize the end to end clinical trials design...

Multiple Sclerosis Analytical Report

Multiple Sclerosis Analytical Report

PatSnap | 15-Jun-2022 | Technical / White Paper

More than 2.3 million people are living with MS worldwide. Although there is no cure, new research and innovative treatments are continuously emerging....

Strategic Approach to Immunogenicity Assessment

Strategic Approach to Immunogenicity Assessment

Altasciences | 17-May-2022 | Technical / White Paper

In this issue of The Altascientist we provide a detailed overview on the different goals and challenges that are presented by the validation of immunogenicity...

Governing and Maintaining Clinical Data Standards

Governing and Maintaining Clinical Data Standards

Veeva | 10-May-2022 | Technical / White Paper

Investing in data standards plays a huge role in improving the quality of clinical studies. But often, people don’t use the standards correctly, there...

Related suppliers

Follow us


View more