Everyday we are flooded with a tsunami of news about the race to test COVID-19 vaccines in thousands – tens of thousands – of people. When you hear about such large trials of 30,000 or more, you might be surprised by the following.
Today I pause to reflect on the very low level of evidence in very small numbers of people that might be used to try to advance coronavirus drugs or vaccines.
This week, former Harvard Medical School professor William Haseltine wrote, “Beware of COVID-19 vaccine trials designed to succeed from the start.” Excerpt:
Both Pfizer and Moderna have touted the large number of participants in their trials, at upwards of 30,000 participants slated for each. But while the full trial sizes might be large, the protocols suggest that efficacy can be proved in an initial test group of just 106 for the Moderna vaccine and in a group of 64 for Pfizer. But keep in mind only half of each group receives the vaccine; the other half receives a placebo.
The protocols suggest that successful initial interim trials for the Moderna and Pfizer vaccines would show efficacy among 74 percent and 76.9 percent of participants, respectively. This means if 39 of those who receive the vaccine do not get sick, Moderna will consider the vaccine a success. For Pfizer, the number is 25.
At this point, the Food and Drug Administration could grant emergency-use authorization. In other words, the two vaccines could hinge on the combined results of 64 people.
Haseltine concludes:
If — or perhaps when — positive early results from these trials are announced, keep my warnings in mind. These protocols seem designed to get a drug on the market sooner rather than later, on a timeline arguably based more on politics than public health. The lives of millions are at risk; we can and should demand better.
That was about vaccine trials. How about an attempt to rush into use a drug tested in just 21 people?
EndPoints News, founded by biotech journalist-analyst John Carroll, reports that a small biotech company is asking the FDA for emergency use authorization (EUA) for its drug, aviptadil, based on the results of just 21 people.
University of Minnesota virologist David Boulware emailed EndPoints News: “Their reported results are very good but not earth shattering. Without a randomized control group, what the true actual effect is unknown. If highly effective, then a small randomized clinical trial should be able to quickly confirm these initial results.”
The story notes, “The only other company to discuss their intention to file for an EUA, Eli Lilly, did so after results came back from a randomized control study testing their antibody in over 450 patients.”
I’ve been meaning to write about news coverage of that Lilly announcement from last week.
Carroll of Endpoints News wrote about that Lilly antibody drug, “Analysts are quick to pan Eli Lilly’s buzzing first cut of positive clinical data for its COVID-19 antibody.” He described the scope of one reported outcome as “tiny.”
But, you see, these Lilly results were not published in a journal. They were announced in a company PR news release. And many journalists reporting on such announcements do not have the specialization or experience of someone like Carroll or his website.
Predictably, there was a broad spectrum in the quality of news coverage of this PR announcement.
A good example of what to include
- The New York Times emphasized: “The announcement, by Eli Lilly, was not accompanied by detailed data; independent scientists have not yet reviewed the results, nor have they been published in a peer-reviewed journal. The findings are the interim results of an ongoing trial.” (However, other aspects of the story were not so strong.)
A bad example showing what was excluded
- CNBC allowed Lilly’s CEO to state that they had published the data. The phrase “published the data” is reserved for publication in journals, not in PR news releases. That statement went unchallenged by CNBC, which, instead, focused on “speed and industry cooperation aiding coronavirus treatment development.” I guess your view of this story depends on your view of the role of journalism.
Focusing on speed dumps us into the political arena, in which it was reported that:
President Trump said a plan by the Food and Drug Administration to issue tough new standards for emergency approval of a coronavirus vaccine “sounds like a political move” and warned that the White House might reject it.
History is being made. How will we look back on these days a year from now?
0 comments:
Post a Comment