The way we test new drugs in clinical trials has a peculiar aspect to it. Every trial must pretend that no similar drug has ever been tested before, regardless of the results of previous studies or research on similar compounds. This means that even if clinicians have extensive experience with similar drugs, or if decades of research suggest that a particular direction is correct, each trial must prove the effectiveness of the new drug all over again, from scratch.
This strict approach has its roots in the Food and Drug Administration's (FDA) gold standard for clinical trials. For more than 60 years, it has been the norm to pretend that no prior research counts towards proving a drug's efficacy. This policy was put in place to prevent companies from cherry-picking studies that flatter their results.
However, this approach has a significant drawback - it can be expensive and time-consuming for patients with rare diseases or children waiting on treatments that already work in adults. In fact, running traditional trials can be nearly impossible for people with rare conditions due to the limited number of patients available.
Fortunately, the FDA is now telling drug companies and researchers that they don't have to start from scratch anymore. A new guidance encourages companies to use a statistical approach called Bayesian methods, which allows them to formally incorporate prior knowledge and information from related studies into their trials. This means that, for the first time, companies can consider what they already know about a particular drug when evaluating its effectiveness.
Bayesian statistics asks different questions than traditional frequentist statistics. Instead of asking if the results are likely due to chance (a question often answered with a "p-value"), Bayesian methods ask how likely it is that the new drug works based on all available information, including prior research and real-world evidence. This approach provides more flexibility and allows researchers to formally "borrow" information from other studies.
However, there's also a potential pitfall - the risk of cherry-picking data to make a drug look good. Traditional trials have a hard threshold for statistical significance that removes human judgment from the equation. Bayesian methods require researchers to choose prior assumptions about what they expect to find, which can lead to bias if not done properly.
Despite these concerns, proponents argue that Bayesian methods force subjective judgments into the open. Researchers must state their priors upfront and justify them, allowing everyone involved - including FDA reviewers - to see exactly what was assumed and evaluate its reasonableness.
For patients with rare diseases or children waiting on treatments, the stakes of this statistical change are potentially life or death. The HEALEY trial has already shown what's possible, and the FDA has opened the door for other companies to follow suit. However, whether individual companies will adopt these new methods remains to be seen, as the guidance is still a draft and open for public comment until March 13, with a final version expected in about 18 months.
This strict approach has its roots in the Food and Drug Administration's (FDA) gold standard for clinical trials. For more than 60 years, it has been the norm to pretend that no prior research counts towards proving a drug's efficacy. This policy was put in place to prevent companies from cherry-picking studies that flatter their results.
However, this approach has a significant drawback - it can be expensive and time-consuming for patients with rare diseases or children waiting on treatments that already work in adults. In fact, running traditional trials can be nearly impossible for people with rare conditions due to the limited number of patients available.
Fortunately, the FDA is now telling drug companies and researchers that they don't have to start from scratch anymore. A new guidance encourages companies to use a statistical approach called Bayesian methods, which allows them to formally incorporate prior knowledge and information from related studies into their trials. This means that, for the first time, companies can consider what they already know about a particular drug when evaluating its effectiveness.
Bayesian statistics asks different questions than traditional frequentist statistics. Instead of asking if the results are likely due to chance (a question often answered with a "p-value"), Bayesian methods ask how likely it is that the new drug works based on all available information, including prior research and real-world evidence. This approach provides more flexibility and allows researchers to formally "borrow" information from other studies.
However, there's also a potential pitfall - the risk of cherry-picking data to make a drug look good. Traditional trials have a hard threshold for statistical significance that removes human judgment from the equation. Bayesian methods require researchers to choose prior assumptions about what they expect to find, which can lead to bias if not done properly.
Despite these concerns, proponents argue that Bayesian methods force subjective judgments into the open. Researchers must state their priors upfront and justify them, allowing everyone involved - including FDA reviewers - to see exactly what was assumed and evaluate its reasonableness.
For patients with rare diseases or children waiting on treatments, the stakes of this statistical change are potentially life or death. The HEALEY trial has already shown what's possible, and the FDA has opened the door for other companies to follow suit. However, whether individual companies will adopt these new methods remains to be seen, as the guidance is still a draft and open for public comment until March 13, with a final version expected in about 18 months.