“Failure is instructive. The person who really thinks, learns quite as much from his failures as from his successes.” John Dewey, American philosopher.
A University of Nebraska Medical Center research study has determined that using a statistical method that was published nearly 250 years ago could save lives, decrease the time and cost of moving a drug to market and help physicians predict a patient’s response to medication for severe sepsis.
The results of the study were published in the May issue of the journal PLoS One, a journal published by the Public Library of Science. The study was conducted by Andre Kalil, M.D., associate professor, infectious diseases, and associate director of the Immunocompromised Host Infectious Diseases Program, and Junfeng Sun, Ph.D., assistant professor, biostatistics, College of Public Health.
A practical result of this study was the creation of a new bedside tool that Dr. Kalil believes will help physicians treat severe sepsis more effectively.
Dr. Kalil said that using the methodology created in 1763 by the Rev. Thomas Bayes, a Presbyterian minister and mathematician, in clinical trials will improve how results are interpreted by combining new data with existing knowledge and expertise.
“The current way to evaluate clinical trials is based on traditional statistics, which does not include unfavorable or negative evidence into their interpretation. Dr. Kalil said. “The way clinical trials are now interpreted is like a judge who overlooks previous convictions of a regular criminal during sentencing.”
Two main reasons have slowed the acceptance of Bayesian methodology in medical sciences: the computational and mathematical difficulties and the meager publication of clinical trials with negative results by major medical journals, Dr. Kalil said.
However, the impressive progress in modern computer software have made the application of this method much easier, and the current mandatory registration of clinical trials before they are even started have made the publication of negative trials more acceptable and more transparent.
“The time to use Bayesian statistics has arrived for medical sciences, even though it has been successfully applied in the fields of archeology, astronomy, chemistry, engineering, genetics, and computational sciences,” he said.
Drs. Kalil and Sun reviewed five pivotal clinical trials on the treatment of severe sepsis using the Bayesian method. They wanted to know why clinicians were not rapidly adopting the therapies recommended as new standards of care.
The five published clinical trials reviewed were for therapies that addressed a variety of sepsis-related problems such as sugar levels, inflammation, low blood pressure, and lung failure.
“These were multicenter trials and the therapies have become standard of care now. But, when you look back, there’s a good amount of negative evidence for several therapies. Results from these new trials are not as favorable when put into context. Physicians should use a grain of salt when looking at the results of brand new trials,” Kalil said.
Severe sepsis occurs when an infection spreads throughout the body and begins to affect organ function. Every year, nearly 750,000 people develop severe sepsis in the United States, and up to 40 percent of them die as a consequence of the infection.
“Our results demonstrate that the strength of evidence (statistical and clinical) is weak for all trials, particularly for the blood pressure and one of the anti-inflammatory trials. It is essential to replicate the results of each of these five clinical trials in confirmatory studies if we want to provide patient care based on scientifically sound evidence,” Dr. Kalil said.
“The ramifications are wide ranging to clinical research. This method can be used in any field of medical research,” he said. Dr. Kalil proposes that future trials use a blend of traditional and Bayesian statistical methodologies.
From the results of his study, Drs. Kalil and Sun developed a pocket reference for physicians to use when treating patients with severe sepsis. “The clinical guide reflects a more accurate patient response to the five therapies, which will help clinicians determine the best course of action to take,” he said.
In a second study, published in the May issue of the journal Intensive Care Medicine, Drs. Kalil and Sun used the Bayesian method to closely evaluate the need for a confirmatory clinical trial on the controversial anti-inflammatory/anti-thrombotic therapy called recombinant human activated protein C, or Drotrecogin alfa activated.
The original Drotrecogin alfa activated study showed positive results, after which the Food and Drug Administration narrowly approved its use in a subset of patients with high risk of death, although it was associated with bleeding. The drug also was approved for use in Europe, but now officials there want a confirmatory trial conducted. Positive results have not been replicated in any subsequent trial, Dr. Kalil said.
“Another trial to positively confirm these findings would require 2,000 to 3,000 patients to participate, considering the traditional statistical methodology. We propose that if Bayesian methodology were applied, a trial would only need to enroll about 600 patients with severe sepsis” Dr. Kalil said.
“This would substantially decrease unnecessary patient exposure to an experimental drug or placebo, reduce the amount of time required to complete the study, speed up the approval rate of new drugs, and save up to two-thirds the cost of a clinical trial,” he said.
UNMC is the only public health science center in the state. Its educational programs are responsible for training more health professionals practicing in Nebraska than any other institution. Through their commitment to education, research, patient care and outreach, UNMC and its hospital partner, The Nebraska Medical Center, have established themselves as one of the country’s leading centers in cancer, transplantation biology, bioterrorism preparedness, neurodegenerative diseases, cardiovascular diseases, genetics, biomedical technology and ophthalmology. UNMC’s research funding from external sources now exceeds $80 million annually and has resulted in the creation of more than 2,400 highly skilled jobs in the state. UNMC’s physician practice group, UNMC Physicians, includes 513 physicians in 50 specialties and subspecialties who practice primarily in The Nebraska Medical Center. For more information, go to UNMC’s Web site at www.unmc.edu.