New paper from Science Advances highlights the replication problem in science, “….We use publicly available data to show that published papers in top psychology, economics, and general interest journals that fail to replicate are cited more than those that replicate. This difference in citation does not change after the publication of the failure to replicate. Only 12% of post replication citations of nonreplicable findings acknowledge the replication failure. Existing evidence also shows that experts predict well which papers will be replicated. Given this prediction, why are nonreplicable papers accepted for publication in the first place? A possible answer is that the review team faces a trade-off. When the results are more “interesting,” they apply lower standards regarding their reproducibility….”

Core result, “…Our main finding is that papers that fail to replicate in (5-7) are cited more than those that are replicable. We find no significant change in citation trends, even after the publication of the failed replication. Notably, only a minority of publications after the failed replications were published acknowledge the failure. The “quality” of citations of papers that failed to replicate is similar to that of papers that were replicated: We do not find a difference in how often the citations of nonreplicable publications are cited by others or in the impact factor of the journals in which citations are published…”

The evidence, "...Figure 1 shows the distribution of total citation counts by the end of 2019 of the papers included in the replication projects, separately depending on replicability for Nature/Science, economics journals, and psychology journals. Replicability is measured according to the criterion that the replication project featured a P value of 0.05 or lower in a two-sided test, with an effect in the same direction as the original test….”

new advances in understanding Maxwell’s demon"...The team, led by Manzano, wondered if there was a way toimplement something like Maxwell’s demon but without the information requirements. They imagined a two-compartment system with a door, as before. But in this case, the door would open and close on its own. Sometimes particles would randomly separate themselves into hotter and colder compartments. The demon could only watch this process and decide when to turn the system off. In theory this process could create a small temperature imbalance, and therefore a useful heat engine, if the demon was smart about when to end the experiment and lock any temperature imbalance in place, much as a smart gambler on a hot streak knows when to leave the table. “You can either play all night on the roulette table, or you can stop if you win $100,” said Édgar Roldán, a physicist at the International Center for Theoretical Physics in Italy who was a co-author on the study. “We’re saying we don’t need such a complicated device as Maxwell’s demon to extract work in the second law. We can be more relaxed.”The researchers then implemented such a gambling demon in a nanoelectronic device, to show it was possible..."

Jonathan O'Callaghan, "How Maxwell’s Demon Continues to Startle Scientists,"Quanta Magazine, April 22, 2021, https://www.quantamagazine.org/how-maxwells-demon-continues-to-startle-scientists-20210422/

How Maxwell’s Demon Continues to Startle Scientists

The universe bets on disorder. Imagine, for example, dropping a thimbleful of red dye into a swimming pool. All of those dye molecules are going to slowly spread throughout the water. Physicists quantify this tendency to spread by counting the number of possible ways the dye molecules can be arranged. There’s one possible state where the molecules are crowded into the thimble. There’s another where, say, the molecules settle in a tidy clump at the pool’s bottom. But there are uncountable billions of permutations where the molecules spread out in different ways throughout the water. If the universe chooses from all the possible states at random, you can bet that it’s going to end up with one of the vast set of disordered possibilities.

Seen in this way, the inexorable rise in entropy, or disorder, as quantified by the second law of thermodynamics, takes on an almost mathematical certainty. So of course physicists are constantly trying to break it.

One almost did. A thought experiment devised by the Scottish physicist James Clerk Maxwell in 1867 stumped scientists for 115 years. And even after a solution was found, physicists have continued to use “Maxwell’s demon” to push the laws of the universe to their limits.

In the thought experiment, Maxwell imagined splitting a room full of gas into two compartments by erecting a wall with a small door. Like all gases, this one is made of individual particles. The average speed of the particles corresponds to the temperature of the gas — faster is hotter. But at any given time, some particles will be moving more slowly than others.

What if, suggested Maxwell, a tiny imaginary creature — a demon, as it was later called — sat at the door. Every time it saw a fast-moving particle approaching from the left-hand side, it opened the door and let it into the right-hand compartment. And every time a slow-moving particle approached from the right, the demon let it into the left-hand compartment.

After a while, the left-hand compartment would be full of slow, cold particles, and the right-hand compartment would grow hot. This isolated system would seem to grow more orderly, not less, because two distinguishable compartments have more order than two identical compartments. Maxwell had created a system that appeared to defy the rise of entropy, and thus the laws of the universe.

“He tried to prove a system where the entropy would decrease,” said Laia Delgado Callico, a physicist at King’s College London. “It’s a paradox.”

Two advances would be crucial to solving Maxwell’s demon. The first was by the American mathematician Claude Shannon, regarded as the founder of information theory. In 1948, Shannon showed that the information content of a message could be quantified with what he called the information entropy. “In the 19th century, no one knew about information,” said Takahiro Sagawa, a physicist at the University of Tokyo. “The modern understanding of Maxwell’s demon was established by Shannon’s work.”

The second vital piece of the puzzle was the principle of erasure. In 1961, the German American physicist Rolf Landauer showed that any logically irreversible computation, such as the erasing of information from a memory, would result in a minimal nonzero amount of work converted into heat dumped into the environment, and a corresponding rise in entropy. Landauer’s erasure principle provided a tantalizing link between information and thermodynamics. “Information is physical,” he later proclaimed.

In 1982, the American physicist Charles Bennett put the pieces of the puzzle together. He realized that Maxwell’s demon was at core an information-processing machine: It needed to record and store information about individual particles in order to decide when to open and close the door. Periodically it would need to erase this information. According to Landauer’s erasure principle, the rise in entropy from the erasure would more than compensate for the decrease in entropy caused by the sorting of the particles. “You need to pay,” said Gonzalo Manzano, a physicist at the Institute for Quantum Optics and Quantum Information in Vienna. The demon’s need to make room for more information inexorably led to a net increase in disorder.

Then in the 21st century, with the thought experiment solved, the real experiments began. “The most important development is we can now realize Maxwell’s demon in laboratories,” said Sagawa.

In 2007 scientists used a light-powered gate to demonstrate the idea of Maxwell’s demon in action; in 2010, another team devised a way to use the energy produced by the demon’s information to coax a bead uphill; and in 2016 scientists applied the idea of Maxwell’s demon to two compartments containing not gas, but light.

“We switched the roles of matter and light,” said Vlatko Vedral, a physicist at the University of Oxford and one of the study’s co-authors. The researchers were ultimately able to charge a very small battery.

Others wondered if there might be less demanding ways to use information to extract useful work from a similar system. And research published in February in Physical Review Letters seems to have found a way to do so. The work makes the demon into a gambler.

The team, led by Manzano, wondered if there was a way to implement something like Maxwell’s demon but without the information requirements. They imagined a two-compartment system with a door, as before. But in this case, the door would open and close on its own. Sometimes particles would randomly separate themselves into hotter and colder compartments. The demon could only watch this process and decide when to turn the system off. In theory this process could create a small temperature imbalance, and therefore a useful heat engine, if the demon was smart about when to end the experiment and lock any temperature imbalance in place, much as a smart gambler on a hot streak knows when to leave the table. “You can either play all night on the roulette table, or you can stop if you win $100,” said Édgar Roldán, a physicist at the International Center for Theoretical Physics in Italy who was a co-author on the study. “We’re saying we don’t need such a complicated device as Maxwell’s demon to extract work in the second law. We can be more relaxed.” The researchers then implemented such a gambling demon in a nanoelectronic device, to show it was possible.

Ideas like this could prove useful in designing more efficient thermal systems, like refrigerators, or even in developing more advanced computer chips, which may be approaching a fundamental limit dictated by Landauer’s principle.

For the time being, though, our laws of the universe are safe, even when placed under the greatest scrutiny. What has changed is our understanding of information in the universe, and with it our appreciation of Maxwell’s demon, first a troublesome paradox, and now an invaluable concept — one that has helped to illuminate the remarkable link between the physical world and information.

Allysia Finley, "The Bearer of Good Coronavirus News,"Wall Street Journal, April 24, 2020, https://www.wsj.com/articles/the-bearer-of-good-coronavirus-news-11587746176

The Bearer of Good Coronavirus News

Defenders of coronavirus lockdown mandates keep talking about science. “We are going to do the right thing, not judge by politics, not judge by protests, but by science,” California’s Gov. Gavin Newsom said this week. Michigan Gov. Gretchen Whitmer defended an order that, among other things, banned the sale of paint and vegetable seeds but not liquor or lottery tickets. “Each action has been informed by the best science and epidemiology counsel there is,” she wrote in an op-ed.

But scientists are almost never unanimous, and many appeals to “science” are transparently political or ideological. Consider the story of John Ioannidis, a professor at Stanford’s School of Medicine. His expertise is wide-ranging—he juggles appointments in statistics, biomedical data, prevention research and health research and policy. Google Scholar ranks him among the world’s 100 most-cited scientists. He has published more than 1,000 papers, many of them meta-analyses—reviews of other studies. Yet he’s now found himself pilloried because he dissents from the theories behind the lockdowns—because he’s looked at the data and found good news.

In a March article for Stat News, Dr. Ioannidis argued that Covid-19 is far less deadly than modelers were assuming. He considered the experience of the Diamond Princess cruise ship, which was quarantined Feb. 4 in Japan. Nine of 700 infected passengers and crew died. Based on the demographics of the ship’s population, Dr. Ioannidis estimated that the U.S. fatality rate could be as low as 0.025% to 0.625% and put the upper bound at 0.05% to 1%—comparable to that of seasonal flu.

“If that is the true rate,” he wrote, “locking down the world with potentially tremendous social and financial consequences may be totally irrational. It’s like an elephant being attacked by a house cat. Frustrated and trying to avoid the cat, the elephant accidentally jumps off a cliff and dies.”

Dr. Ioannidis, 54, likes metaphors. A New York native who grew up in Athens, he also teaches comparative literature and has published seven literary works—poetry and fiction, the latest being an epistolary novel—in Greek. In his spare time, he likes to fence, swim, hike and play basketball.

Early in his career, he realized that “the common denominator for everything that I was doing was that I was very interested in the methods—not necessarily the results but how exactly you do that, how exactly you try to avoid bias, how you avoid error.” When he began examining studies, he discovered that few headline-grabbing findings could be replicated, and many were later contradicted by new evidence.

Scientific studies are often infected by biases. “Several years ago, along with one of my colleagues, we had mapped 235 biases across science. And maybe the biggest cluster is biases that are trying to generate significant, spectacular, fascinating, extraordinary results,” he says. “Early results tend to be inflated. Claims for significance tend to be exaggerated.”

An example is a 2012 meta-analysis on nutritional research, in which he randomly selected 50 common cooking ingredients, such as sugar, flour and milk. Eighty percent of them had been studied for links to cancer, and 72% of the studies linked an ingredient to a higher or lower risk. Yet three-quarters of the findings were weak or statistically insignificant.

Dr. Ioannidis calls the coronavirus pandemic “the perfect storm of that quest for very urgent, spectacular, exciting, apocalyptic results. And as you see, apparently our early estimates seem to have been tremendously exaggerated in many fronts.”

Chief among them was a study by modelers at Imperial College London, which predicted more than 2.2 million coronavirus deaths in the U.S. absent “any control measures or spontaneous changes in individual behaviour.” The study was published March 16—the same day the Trump administration released its “15 Days to Slow the Spread” initiative, which included strict social-distancing guidelines.

Dr. Ioannidis says the Imperial projection now appears to be a gross overestimate. “They used inputs that were completely off in some of their calculation,” he says. “If data are limited or flawed, their errors are being propagated through the model.... So if you have a small error, and you exponentiate that error, the magnitude of the final error in the prediction or whatever can be astronomical.”

“I love models,” he adds. “I do a lot of mathematical modeling myself. But I think we need to recognize that they’re very, very low in terms of how much weight we can place on them and how much we can trust them.... They can give you a very first kind of mathematical justification to a gut feeling, but beyond that point, depending on models for evidence, I think it’s a very bad recipe.”

Modelers sometimes refuse to disclose their assumptions or data, so their errors go undetected. Los Angeles County predicted last week that 95.6% of its population would be infected by August if social distancing orders were relaxed. (Confirmed cases were 0.17% of the population as of Thursday.) But the basis for this projection is unclear. “At a minimum, we need openness and transparency in order to be able to say anything,” Dr. Ioannidis says.

Most important, “what we need is data. We need real data. We need data on how many people are infected so far, how many people are actively infected, what is really the death rate, how many beds do we have to spare, how has this changed.”

That will require more testing. Dr. Ioannidis and colleagues at Stanford last week published a study on the prevalence of coronavirus antibodies in Santa Clara County. Based on blood tests of 3,300 volunteers in the county—which includes San Jose, California’s third-largest city—during the first week of April, they estimated that between 2.49% and 4.16% of the county population had been infected. That’s 50 to 85 times the number of confirmed cases and implies a fatality rate between 0.12% and 0.2%, consistent with that of the Diamond Princess.

The study immediately came under attack. Some statisticians questioned its methods. Critics noted the study sample was not randomly selected, and white women under 64 were disproportionately represented. The Stanford team adjusted for the sampling bias by weighting the results by sex, race and ZIP Code, but the study acknowledges that “other biases, such as bias favoring individuals in good health capable of attending our testing sites, or bias favoring those with prior Covid-like illnesses seeking antibody confirmation are also possible. The overall effect of such biases is hard to ascertain.”

Dr. Ioannidis admits his study isn’t “bulletproof” and says he welcomes scrutiny. But he’s confident the findings will hold up, and he says antibody studies from around the world will yield more data. A study published this week by the University of Southern California and the Los Angeles County Department of Public Health estimated that the virus is 28 to 55 times as prevalent in that county as confirmed cases are. A New York study released Thursday estimated that 13.9% of the state and 21.2% of the city had been infected, more than 10 times the confirmed cases.

Yet most criticism of the Stanford study has been aimed at defending the lockdown mandates against the implication that they’re an overreaction. “There’s some sort of mob mentality here operating that they just insist that this has to be the end of the world, and it has to be that the sky is falling. It’s attacking studies with data based on speculation and science fiction,” he says. “But dismissing real data in favor of mathematical speculation is mind-boggling.”

In part he blames the media: “We have some evidence that bad news, negative news, are more attractive than positive news—they lead to more clicks, they lead to people being more engaged. And of course we know that fake news travels faster than true news. So in the current environment, unfortunately, we have generated a very heavily panic-driven, horror-driven, death-reality-show type of situation.”

The news is filled with stories of healthy young people who die of coronavirus. But Dr. Ioannidis recently published a paper with his wife, Despina Contopoulos-Ioannidis, an infectious-disease specialist at Stanford, that showed this to be a classic man-bites-dog story. The couple found that people under 65 without underlying conditions accounted for only 0.7% of coronavirus deaths in Italy and 1.8% in New York City.

“Compared to almost any other cause of disease that I can think of, it’s really sparing young people. I’m not saying that the lives of 80-year-olds do not have value—they do,” he says. “But there’s far, far, far more... young people who commit suicide.” If the panic and attendant disruption continue, he says, “we will see many young people committing suicide... just because we are spreading horror stories with Covid-19. There’s far, far more young people who get cancer and will not be treated, because again, they will not go to the hospital to get treated because of Covid-19. There’s far, far more people whose mental health will collapse.”

He argues that public officials need to weigh these factors when making public-health decisions, and more hard data from antibody and other studies will help. “I think that we should just take everything that we know, put it on the table, and try to see, OK, what’s the next step, and see what happens when we take the next step. I think this sort of data-driven feedback will be the best. So you start opening, you start opening your schools. You can see what happens,” he says. “We need to be open minded, we need to just be calm, allow for some error, it’s unavoidable. We started knowing nothing. We know a lot now, but we still don’t know everything.”

He cautions against drawing broad conclusions about the efficacy of lockdowns based on national infection and fatality rates. “It’s not that we have randomized 10 countries to go into lockdown and another 10 countries to remain relatively open and see what happens, and do that randomly. Different prime ministers, different presidents, different task forces make decisions, they implement them in different sequences, at different times, in different phases of the epidemic. And then people start looking at this data and they say, ‘Oh look at that, this place did very well. Why? Oh, because of this measure.’ This is completely, completely opinion-based.”

People are making “big statements about ‘lockdowns save the world.’ I think that they’re immature. They’re tremendously immature. They may have worked in some cases, they may have had no effect in others, and they may have been damaging still in others.”

Most disagreements among scientists, he notes, reflect differences in perspective, not facts. Some find the Stanford study worrisome because it suggests the virus is more easily transmitted, while others are hopeful because it suggests the virus is far less lethal. “It’s basically an issue of whether you’re an optimist or a pessimist. Even scientists can be optimists and pessimists. Probably usually I’m a pessimist, but in this case, I’m probably an optimist.”

“…Yet most criticism of the Stanford study has been aimed at defending the lockdown mandates against the implication that they’re an overreaction. “There’s some sort of mob mentality here operating that they just insist that this has to be the end of the world, and it has to be that the sky is falling. It’s attacking studies with data based on speculation and science fiction,” he says. “But dismissing real data in favor of mathematical speculation is mind-boggling.” In part he blames the media: “We have some evidence that bad news, negative news, are more attractive than positive news—they lead to more clicks, they lead to people being more engaged. And of course we know that fake news travels faster than true news. So in the current environment, unfortunately, we have generated a very heavily panic-driven, horror-driven, death-reality-show type of situation.”…”