When a Forecast Flops: Post-Hoc Rationalization in Climate Science

This misalignment extends to his forecasts. Mann and his team predicted an “extremely active” hurricane season, with a most likely estimate of 33 named storms. Instead, the season produced just 18—or 19 if we generously include a borderline case. For perspective, this falls well below Mann’s projected range of 27–39 storms. Not exactly the “record-shattering” season anticipated.

space view of the American Ian hurricane in Florida state of United States showing the effects of climate change on cities of America. 3D illustration.

From Watts Up With That?

By Charles Rotter

But only today did I become aware of his own post-mortem analysis. Mann’s reflection on the 2024 Atlantic hurricane season provides a fascinating case study in how climate forecasts go astray—and how their authors work to reframe misses as meaningful contributions. While the piece starts by heralding an “active, destructive, and deadly” hurricane season, its true focus is a far less successful story: the failure of Mann’s own predictions to match reality.

The Setup: Bold Forecasts, But a Lackluster Outcome

Mann opens with dramatic language about “unprecedented” hurricanes and their links to warming oceans. His piece asserts that human-caused warming is driving stronger storms, citing rapid intensification in specific cases like Hurricane Milton (which reached 185 mph winds) and even speculating about the need for a hypothetical “Category 6” classification.

Indeed Milton nearly breached the threshold of 192 mph sustained winds argued by one recent study to constitute a whole new “category six” caliber of hurricanes that has emerged in an era of unprecedented ocean warmth. A separate study estimated that the deadly flooding in the southeastern U.S. from hurricane Helene was increased by 50% by human-caused warming.

https://michaelmann.net/content/reflections-2024-atlantic-hurricane-season

However, these claims about stronger hurricanes don’t align with the latest findings from the IPCC. The 6th Assessment Report (AR6) explicitly states that evidence for long-term trends in hurricane frequency and intensity is inconclusive, with no detectable increase in global cyclone frequency and mixed regional trends. While short-term variability may yield extreme seasons, the broader picture contradicts Mann’s insistence that climate change is creating reliably stronger storms. His narrative relies on cherry-picking extreme cases rather than examining the full record.

This misalignment extends to his forecasts. Mann and his team predicted an “extremely active” hurricane season, with a most likely estimate of 33 named storms. Instead, the season produced just 18—or 19 if we generously include a borderline case. For perspective, this falls well below Mann’s projected range of 27–39 storms. Not exactly the “record-shattering” season anticipated.

The Excuses: Blame the Variables, Ignore the Model

Rather than owning the shortcomings of their forecasts, Mann and his colleagues turn to a familiar playbook: citing unpredictable variables to explain their miss. They blame the Madden-Julian Oscillation (MJO)—a well-known atmospheric cycle—for suppressing storm formation during the crucial July and August peak. Saharan dust outbreaks are also invoked as a contributing factor.

So there’s no real discrepancy when it comes to the latter half of the season. It was basically as active as predicted. The puzzle is why July and August were so quiet despite clearly favorable seasonal large-scale climate conditions. This is where one runs into complications with intraseasonal variability. Of particular relevance is the so-called Madden-Julian oscillation or simply “MJO” to its friends. The MJO is a roughly 40-50 day oscillation in the tropical atmospheric circulation which influences the location of convection, which shifts east and west over the course of a single 40-50 day cycle. When the center of convection coincides with the tropical Atlantic, conditions are more favorable for tropical cyclogenesis.

https://michaelmann.net/content/reflections-2024-atlantic-hurricane-season

While these factors undoubtedly play a role, they are hardly “unknowns.” Both phenomena have long been recognized as influential in tropical weather. Shouldn’t a sophisticated statistical model, touted as one of the “most accurate,” account for such routine variability? Mann’s reliance on these explanations reads less as scientific insight and more as retroactive justification.

Alternative Models: When One Forecast Fails, Pivot to Another

In a curious twist, Mann highlights an alternative model that predicted 19.9 storms—a remarkably close match to the observed total. Yet he admits that this model is generally less reliable than the one that failed spectacularly. Touting the success of a secondary, less accurate framework seems like an exercise in hedging bets rather than improving the science. If your “backup” prediction worked better, why not use it as the primary model going forward? This sleight-of-hand raises more questions than it answers.

There is one other noteworthy detail here. Our group makes an alternative forecast in which tropical sea surface temperature (SST) in the main development region (MDR) is replaced with what we call “relative SST”, defined as the difference between MDR SST and the average SST throughout the entire tropics, which some researchers have argued might be a better predictor of Atlantic hurricane activity. While our previous analyses have found that this alternative model yields less skillful predictions, it is notable that this year it yielded a much more accurate prediction of 19.9 +/- 4.5 total named storms that was remarkably close to the seasonal total.

Stronger Hurricanes? Not So Fast

A particularly bold claim in Mann’s reflection is that human-caused warming is directly responsible for the rapid intensification and increased destructiveness of storms. He points to Milton and Helene as evidence, even citing studies that argue for the necessity of a new “Category 6” hurricane classification.

However, this narrative overlooks the IPCC’s cautious stance on the issue. The IPCC AR6 finds only low confidence in detectable increases in hurricane intensity globally. While there is moderate confidence in increased peak wind speeds for a subset of tropical cyclones, these trends are not consistently observed across all ocean basins. Moreover, the number of global cyclones has either decreased or remained flat. Mann’s narrative about a world of ever-stronger storms is more rhetorical than rigorously scientific.

Here is the reality of Tropical Cyclone trends from Roger Pielke Jr, and Ryan Maue

“We have identified considerable interannual variability in the frequency of global hurricane landfalls; but within the resolution of the available data, our evidence does not support the presence of significant long-period global or individual basin linear trends for minor, major, or total hurricanes within the period(s) covered by the available quality data.”

Broader Implications: Science or Spin?

Mann’s post inadvertently highlights a key issue in climate science: the gap between predictive confidence and observed outcomes. When forecasts fail, climate scientists often claim the climate system is no longer behaving predictably—implying their models are still right, just incapable of adapting to a “changing system.” This raises a critical question: If the system is behaving unpredictably, how can forecasts demand such unwavering trust, let alone justify sweeping climate policies?

Mann’s reflection ends with an ominous flourish: “There could well be far more unpleasant surprises in the greenhouse.” While such warnings are useful for grabbing headlines, they risk undermining public confidence when paired with unfulfilled predictions. If we’re not sure what to expect, how can anyone claim certainty about the impacts of climate change? This is less science and more speculative storytelling.

Final Thoughts: Missed Marks and Moving Goalposts

The 2024 Atlantic hurricane season wasn’t the catastrophe Mann’s models forecasted. While the storms that did form were destructive, the season as a whole fell far short of expectations. This raises a critical issue: When predictions fail, should we be refining models or doubling down on fear-driven narratives?

Mann’s reflections suggest the latter approach. His insistence that missed forecasts still “teach us important lessons” sidesteps the more obvious conclusion: overconfidence in flawed models does more harm than good. Rather than admitting these forecasts have limits, he suggests the rules of the climate system itself may be changing. It’s a convenient excuse but an unconvincing one.

For climate science to have any credibility, it needs to grapple honestly with its uncertainties—not reframe every miss as proof of an unknowable, ever-shifting reality. Until then, one can’t help but see this as another chapter in the growing credibility crisis of climate forecasting.

The Future of Climate Forecasting (Part 1)

John Abbot, has kept going with research into AI and climate forecasting.   One of his most important recent papers can be downloaded from Earth Sciences.

From Jennifer Marohasy

By jennifer 

My husband, John Abbot, has kept going with research into AI and climate forecasting.   One of his most important recent papers can be downloaded from Earth Sciences.

Some of the latest Nobel prizes in science, including in chemistry, have been for developments in artificial intelligence (AI).  Of course, John Abbot and I began working on the application of this technology for forecasting rainfall soon after Brisbane flooded back in 2011.    Back then, we had just started dating.  It would be some years before we got married.

We had a first AI model developed just a couple of months later, this included some hindcasting showing that the flooding of Brisbane could have been forecast given the temperature and pressure setup across the Pacific Ocean through 2010, and natural climate cycles.

John Abbot and I published a series of papers together through until 2017, after that I lost interest in developing the temperature series that were part of the arrays that John inputted into the neural networks.

I gave-up in 2017, in part because of the hatred that was directed at me, and John, including on Twitter with what was the publication of perhaps our most important paper, newly published in the journal GeoResJ on the application of artificial intelligence, for evaluating anthropogenic versus natural climate change (GeoResJ, Vol. 14, Pgs 36-46 published in July 2017).  This research was pilloried on Twitter, and we were defamed by Graham Readfearn in The Guardian.  Meanwhile, the editor of the journal was under intense pressure for the paper to be retracted.   And some time was expended in writing what seemed like endless letters in its defence.    The paper was never retracted, but the journal was closed.

I also gave-up, because I lost confident in the integrity of the actual temperature measurements being recorded by the Australian Bureau of Meteorology.   Previously I put a lot of work into ensuring that we inputted unhomogenised data.  Then, when I realised the extent to which the new platinum resistance probes could be calibrated to basically measure up or down relative to a mercury thermometer and in fact, they were being recalibrated to measure hotter – well I gave up, in tears.  My focus then become getting the parallel data to better understand the relationship between the two different types of temperature measuring.

I put a lot of effort into this until last April 2023, that was after the Administrative Appeals Tribunal Hearing, a front-page story in The Australian, and an understanding that not even the Conservative side of politics had any interest in holding the Bureau to account on this fraudulent remodelling.   I understood that we were on our own.

Timing is everything they say, if one is to be successful at forcing change, and so it will need to be a team effort, we will need to be supported, we will need to wait.

Meanwhile, John Abbot, who tends to be less affected by the politics, and the injustices, has continued to run the AI.  Instead of relying on me for long continuous temperature series, he began using much longer, and already published temperature series.  And from both those who believe in the existence of Medieval Warm Period and those who dispute its existence.

He had an important paper published in 2021, further showing the application of AI for distinguishing natural from anthropogenic climate change.  This research concludes:

The presence of oscillatory characteristics within proxy- temperature reconstructions across a range of time-scales, including millennial, centennial and decadal, has been reported in many investigations. The present study examines oscillations from spectral analysis applied to eight published multi-proxy temperature records, including examples representing both hockey stick [catastrophic recent warming] and MWP_LIA* cycles [it was warmer in the past during the medieval warm period].

The analysis shows that each record can be represented by a set of 4-11 sine curves from spectral analysis that include a dominant millennial oscillation and several centennial and decadal oscillations. The apparent divergence into either a hockey stick or MWP_LIA* cycles can be derived from the phase alignment of the centennial and decadal oscillations with respect to the millennial oscillation. The maximum temperature of the dominant oscillation at around 1000 AD is increased by superimposing the centennial/decadal oscillations for MWP-LIA* cycles, whereas it is reduced and the profile flattened for the hockey stick. This may explain why current temperatures may exceed any in past 1,000 years with hockey stick profile.

Forecasting through projection of pre-industrial temperature oscillatory patterns beyond 1880 AD by applying spectral analysis to generate input to train ANNs show that current atmospheric temperatures can be largely explained on basis of continuation of natural oscillations. This is the case irrespective of whether the hockey stick or MWP_LIA* cycles are operative. This process could give rise to temperatures higher that past 1000 years without major contribution from anthropogenic influences.

*Medieval Warm Period – Little Ice Age.

It is surprising that these important findings are not of more interest to those who claim to care about science and especially climate science.

Back in 2011, in fact right up until 2017, John and I were laughed at, including by our colleagues for suggesting the relevance of AI for elucidating natural climate cycles and using these same cycles to forecast monthly rainfall.

But perhaps the time is coming when it will be realised that we were just a bit ahead of the times.

Of course all our work was, and continues, to be funded by the B.Macfie Family Foundation through the Institute of Public Affairs for which we are grateful.

This article is not behind a paywall, it can be downloaded for free at this link.

Relevant and related blog posts

  1. Fake justifications for rubbish temperature series:

2. Holding Bureau to account:

3. Confused and misguided colleagues: