Uncertainty is the only certainty

The only problem with this bit of relatively good news? It’s almost certainly wrong. All models are wrong. Some are just less wrong than others — and those are the ones that public health officials rely on.

Welcome to the grimace-andbearit world of modelling. “The key thing is that you want to know what’s happening in the future,” said NASA top climate modeler Gavin Schmidt. “Absent a time machine you’re going to have to use a model.” Weather forecasters use models. Climate scientists use them. Supermarkets use them.

As leaders try to get a handle on the coronavirus outbreak, they are turning to numerous mathematical models to help them figure out what might happen next and what they should try to do now to contain and prepare for the spread. The model updated this week by the University of Washington — the one most often mentioned by US health officials at White House briefings — predicts daily deaths in the US will hit a peak in mid-April then decline through the summer.

Their latest projection shows that anywhere from 49,431 to 136,401 Americans will die in the first wave, which will last into the summer. That’s a huge range of 87,000.

But only a few days earlier the same team had a range of nearly 138,000, with 177,866 as the top number of deaths. Officials credit social distancing.

The latest calculations are based on better data on how the virus acts, more information on how people act and more cities as examples. For example, new data from Italy and Spain suggest social distancing is working even better than expected to stop the spread of the virus. The time it took for the epidemic to peak i.e. for those deaths to start declining was shorter in those Italian and Spanish cities than it was Wuhan, China, said Dr Christopher Murray of University of Washington, who developed the model.

So how does modelling work? Take everything we know about how the coronavirus is spreading, when it’s deadly and when it’s not, when symptoms show and when they don’t. Then factor in everything we know about how people are reacting, social distancing, stay-at-home orders and other squishy human factors. Now add everything we know about testing, treating the disease and equipment shortages. Finally, mix in large dollops of uncertainty at every level. Squeeze all those thousands of data points into incredibly complex mathematical equations and voila, here’s what’s going to happen next with the pandemic.

Except, remember, there’s a huge margin of error: For the prediction of US deaths, the range is larger than the population of Wilmington, Delaware. “No model is perfect, but most models are somewhat useful,” said John Allen Paulos, a professor of math at Temple University and author of books about math and everyday life. “But we can’t confuse the model with reality.” 

One challenge for modelers is dealing with seesawing death totals from overburdened public health departments. A state’s data might show big swings in deaths — but only because a backlog of reports showed up all at once. The tremendous leaps in deaths in a single day could throw off predictions.

Because of the large fudge factor, it’s smart not to look at one single number — the minimum number of deaths, or the maximum for that matter — but instead at the range of confidence, where there’s a 95% chance reality will fall, mathematician Paulos said. For the University of Washington model, that’s from 50,000 to 136,000 deaths.