Posts tagged ‘Judith Curry’

Trusting Experts and Their Models

Russ Roberts over at Cafe Hayek quotes from a Cathy O’Neill review of Nate Silvers recent book:

Silver chooses to focus on individuals working in a tight competition and their motives and individual biases, which he understands and explains well. For him, modeling is a man versus wild type thing, working with your wits in a finite universe to win the chess game.

He spends very little time on the question of how people act inside larger systems, where a given modeler might be more interested in keeping their job or getting a big bonus than in making their model as accurate as possible.

In other words, Silver crafts an argument which ignores politics. This is Silver’s blind spot: in the real world politics often trump accuracy, and accurate mathematical models don’t matter as much as he hopes they would....

My conclusion: Nate Silver is a man who deeply believes in experts, even when the evidence is not good that they have aligned incentives with the public.

Distrust the experts

Call me “asinine,” but I have less faith in the experts than Nate Silver: I don’t want to trust the very people who got us into this mess, while benefitting from it, to also be in charge of cleaning it up. And, being part of the Occupy movement, I obviously think that this is the time for mass movements.

Like Ms. O'Neill, I distrust "authorities" as well, and have a real problem with debates that quickly fall into dueling appeals to authority.  She is focusing here on overt politics, but subtler pressure and signalling are important as well.  For example, since "believing" in climate alarmism in many circles is equated with a sort of positive morality (and being skeptical of such findings equated with being a bad person) there is an underlying peer pressure that is different from overt politics but just as damaging to scientific rigor.  Here is an example from the comments at Judith Curry's blog discussing research on climate sensitivity (which is the temperature response predicted if atmospheric levels of CO2 double).

While many estimates have been made, the consensus value often used is ~3°C. Like the porridge in “The Three Bears”, this value is just right – not so great as to lack credibility, and not so small as to seem benign.

Huybers (2010) showed that the treatment of clouds was the “principal source of uncertainty in models”. Indeed, his Table I shows that whereas the response of the climate system to clouds by various models varied from 0.04 to 0.37 (a wide spread), the variation of net feedback from clouds varied only from 0.49 to 0.73 (a much narrower relative range). He then examined several possible sources of compensation between climate sensitivity and radiative forcing. He concluded:

“Model conditioning need not be restricted to calibration of parameters against observations, but could also include more nebulous adjustment of parameters, for example, to fit expectations, maintain accepted conventions, or increase accord with other model results. These more nebulous adjustments are referred to as ‘tuning’.”  He suggested that one example of possible tuning is that “reported values of climate sensitivity are anchored near the 3±1.5°C range initially suggested by the ad hoc study group on carbon dioxide and climate (1979) and that these were not changed because of a lack of compelling reason to do so”.

Huybers (2010) went on to say:

“More recently reported values of climate sensitivity have not deviated substantially. The implication is that the reported values of climate sensitivity are, in a sense, tuned to maintain accepted convention.”

Translated into simple terms, the implication is that climate modelers have been heavily influenced by the early (1979) estimate that doubling of CO2 from pre-industrial levels would raise global temperatures 3±1.5°C. Modelers have chosen to compensate their widely varying estimates of climate sensitivity by adopting cloud feedback values countering the effect of climate sensitivity, thus keeping the final estimate of temperature rise due to doubling within limits preset in their minds.

There is a LOT of bad behavior out there by models.  I know that to be true because I used to be a modeler myself.  What laymen do not understand is that it is way too easy to tune and tweak and plug models to get a preconceived answer -- and the more complex the model, the easier this is to do in a non-transparent way.  Here is one example, related again to climate sensitivity

When I looked at historic temperature and CO2 levels, it was impossible for me to see how they could be in any way consistent with the high climate sensitivities that were coming out of the IPCC models.  Even if all past warming were attributed to CO2  (a heroic assertion in and of itself) the temperature increases we have seen in the past imply a climate sensitivity closer to 1 rather than 3 or 5 or even 10  (I show this analysis in more depth in this video).

My skepticism was increased when several skeptics pointed out a problem that should have been obvious.  The ten or twelve IPCC climate models all had very different climate sensitivities — how, if they have different climate sensitivities, do they all nearly exactly model past temperatures?  If each embodies a correct model of the climate, and each has a different climate sensitivity, only one (at most) should replicate observed data.  But they all do.  It is like someone saying she has ten clocks all showing a different time but asserting that all are correct (or worse, as the IPCC does, claiming that the average must be the right time).

The answer to this paradox came in a 2007 study by climate modeler Jeffrey Kiehl.  To understand his findings, we need to understand a bit of background on aerosols.  Aerosols are man-made pollutants, mainly combustion products, that are thought to have the effect of cooling the Earth’s climate.

What Kiehl demonstrated was that these aerosols are likely the answer to my old question about how models with high sensitivities are able to accurately model historic temperatures.  When simulating history, scientists add aerosols to their high-sensitivity models in sufficient quantities to cool them to match historic temperatures.  Then, since such aerosols are much easier to eliminate as combustion products than is CO2, they assume these aerosols go away in the future, allowing their models to produce enormous amounts of future warming.

Specifically, when he looked at the climate models used by the IPCC, Kiehl found they all used very different assumptions for aerosol cooling and, most significantly, he found that each of these varying assumptions were exactly what was required to combine with that model’s unique sensitivity assumptions to reproduce historical temperatures.  In my terminology, aerosol cooling was the plug variable.

By the way, this aerosol issue is central to recent work that is pointing to a much lower climate sensitivity to CO2 than has been reported in past IPCC reports.

Climate and Post-Modern Science

I have written before of my believe that climate has become the first post-modern science.  This time, I will yield the floor to Garth Paltridge to make the same point:

But the real worry with climate research is that it is on the very edge of what is called postmodern science. This is a counterpart of the relativist world of postmodern art and design. It is a much more dangerous beast, whose results are valid only in the context of society’s beliefs and where the very existence of scientific truth can be denied. Postmodern science envisages a sort of political nirvana in which scientific theory and results can be consciously and legitimately manipulated to suit either the dictates of political correctness or the policies of the government of the day.

There is little doubt that some players in the climate game – not a lot, but enough to have severely damaged the reputation of climate scientists in general – have stepped across the boundary into postmodern science. The Climategate scandal of 2009, wherein thousands of emails were leaked from the Climate Research Unit of the University of East Anglia in England, showed that certain senior members of the research community were, and presumably still are, quite capable of deliberately selecting data in order to overstate the evidence for dangerous climate change. The emails showed as well that these senior members were quite happy to discuss ways and means of controlling the research journals so as to deny publication of any material that goes against the orthodox dogma. The ways and means included the sacking of recalcitrant editors.

Whatever the reason, it is indeed vastly more difficult to publish results in climate research journals if they run against the tide of politically correct opinion. Which is why most of the sceptic literature on the subject has been forced onto the web, and particularly onto web-logs devoted to the sceptic view of things. Which, in turn, is why the more fanatical of the believers in anthropogenic global warming insist that only peer-reviewed literature should be accepted as an indication of the real state of affairs. They argue that the sceptic web-logs should never be taken seriously by “real” scientists, and certainly should never be quoted. Which is a great pity. Some of the sceptics are extremely productive as far as critical analysis of climate science is concerned. Names like Judith Curry (chair of the School of Earth and Atmospheric Sciences at the Georgia Institute of Technology in Atlanta), Steve McIntyre (a Canadian geologist-statistician) and blogger Willis Eschenbach come to mind. These three in particular provide a balance and maturity in public discussion that puts many players in the global warming movement to shame, and as a consequence their outreach to the scientifically inclined general public is highly effective. Their output, together with that of other sceptics on the web, is fast becoming a practical and stringent substitute for peer review.

Update:  The IPCC does not seem to be on a path to building the credibility of climate science.  In their last report, the IPCC was rightly criticized for using "grey" literature as a source for their findings, against their own rules.  Grey literature encompasses about anything that is not published peer-reviewed literature, including, from the last report, sources that were essentially press releases from advocacy groups like the IPCC.  They even use a travel brochure as a source.

This time, to avoid this criticism, the IPCC is ... changing their rules to allow such grey literature citations.    I am pretty sure that this was NOT passed in order to get more material from Steve McIntyre's blog.  In related news, the IPCC also changed the makeup of its scientific panel, putting geographical and gender diversity over scientific qualifications as a criteria.  The quota for African climate scientists will, for example, be higher than that of North America.  See the whole story here.

Though this was all presented with pious words, my guess is that it was felt by the political leaders of the IPCC in the UN that the last report was not socialist or totalitarian enough and that more of such content was necessary.  We'll see.