Houzz Logo Print
elmerjfudd

How to read a science (research) paper

6 years ago
last modified: 6 years ago

I found an interesting article by a science writer in the NY Times that I recommend. He speaks about his career of more than 30 years of reading research papers. It helps put into context how to assess published findings some come upon when a Google search leads to a PubMed entry. It's often individual findings that are misunderstand by the non-technical reader. I'll share some abstracts and then put a link at the bottom.

+++++++++++++++++++

"When you read through a scientific paper, it’s important to maintain a healthy skepticism. The ongoing flood of papers that have yet to be peer-reviewed — known as preprints — includes a lot of weak research and misleading claims. Some are withdrawn by the authors. Many will never make it into a journal. But some of them are earning sensational headlines before burning out in obscurity.

In April, for example, a team of Stanford researchers published a preprint in which they asserted that the fatality rate of Covid-19 was far lower than other experts estimated. When Andrew Gelman, a Columbia University statistician, read their preprint, he was so angry he publicly demanded an apology.

“We wasted time and effort discussing this paper whose main selling point was some numbers that were essentially the product of a statistical error,” he wrote on his blog. "

and

" But just because a paper passes peer review doesn’t mean it’s above scrutiny. In April, when French researchers published a study suggesting that hydroxychloroquine might be effective against Covid-19, other scientists pointed out that it was small and not rigorously designed. In May, a much bigger paper was published in the Lancet suggesting that the drug could increase the risk of death. A hundred leading scientists published an open letter questioning the authenticity of the database on which the study relied.

When you read a scientific paper, try to think about it the way other scientists do. Ask some basic questions to judge its merit. Is it based on a few patients or thousands? Is it mixing up correlation and causation? Do the authors actually present the evidence required to come to their conclusions?""

I have a subscription, I hope it's visible to others. If not, the essence is above.

NY Times article

Comments (10)