Statement from IOP Publishing on story in The Times

Updated 19 May 2014

Dr. Nicola Gulley, Editorial Director at IOP Publishing, says, “The draft journal paper by Lennart Bengtsson that Environmental Research Letters declined to publish, which was the subject of this morning’s front page story of The Times, contained errors, in our view did not provide a significant advancement in the field, and therefore could not be published in the journal.”

“The decision not to publish had absolutely nothing to do with any ‘activism’ on the part of the reviewers or the journal, as suggested in The Times’ article; the rejection was solely based on the content of the paper not meeting the journal’s high editorial standards, ” she continues.

“The referees selected to review this paper were of the highest calibre and are respected members of the international science community. The comments taken from the referee reports were taken out of context and therefore, in the interests of transparency, we have worked with the reviewers to make the full reports available.”

The full quote actually said “Summarising, the simplistic comparison of ranges from AR4, AR5, and Otto et al, combined with the statement they are inconsistent is less then helpful, actually it is harmful as it opens the door for oversimplified claims of "errors" and worse from the climate sceptics media side.”

 “As the referee’s report states, ‘The overall innovation of the manuscript is very low.’ This means that the study does not meet ERL’s requirement for papers to significantly advance knowledge of the field.”

“Far from denying the validity of Bengtsson’s questions, the referees encouraged the authors to provide more innovative ways of undertaking the research to create a useful advance.”

“As the report reads, ‘A careful, constructive, and comprehensive analysis of what these ranges mean, and how they come to be different, and what underlying problems these comparisons bring would indeed be a valuable contribution to the debate.”

“Far from hounding ‘dissenting’ views from the field, Environmental Research Letters positively encourages genuine scientific innovation that can shed light on complicated climate science.”

“The journal Environmental Research Letters is respected by the scientific community because it plays a valuable role in the advancement of environmental science – for unabashedly not publishing oversimplified claims about environmental science, and encouraging scientific debate.”

“With current debate around the dangers of providing a false sense of ‘balance’ on a topic as societally important as climate change, we’re quite astonished that The Times has taken the decision to put such a non-story on its front page.”

Please find the reviewers’ reports below, exactly as sent to Lennart Bengtsson.

We have full permission from the referees of this paper to make their reviews public.

REFEREE REPORT(S):
Referee one:
COMMENTS TO THE AUTHOR(S)
The manuscript uses a simple energy budget equation (as employed e.g. by Gregory et al 2004, 2008, Otto et al 2013) to test the consistency between three recent "assessments" of radiative forcing and climate sensitivity (not really equilibrium climate sensitivity in the case of observational studies).

The study finds significant differences between the three assessments and also finds that the independent assessments of forcing and climate sensitivity within AR5 are not consistent if one assumes the simple energy balance model to be a perfect description of reality.

The overall innovation of the manuscript is very low, as the calculations made to compare the three studies are already available within each of the sources, most directly in Otto et al.

The finding of differences between the three "assessments" and within the assessments (AR5), when assuming the energy balance model to be right, and compared to the CMIP5 models are reported as apparent inconsistencies.

The paper does not make any significant attempt at explaining or understanding the differences, it rather puts out a very simplistic negative message giving at least the implicit impression of "errors" being made within and between these assessments, e.g. by emphasising the overlap of authors on two of the three studies.

What a paper with this message should have done instead is recognising and explaining a series of "reasons" and "causes" for the differences.

– The comparison between observation based estimates of ECS and TCR (which would have been far more interesting and less impacted by the large uncertainty about the heat content change relative to the 19th century) and model based estimates is comparing apples and pears, as the models are calculating true global means, whereas the observations have limited coverage. This difference has been emphasised in a recent contribution by Kevin Cowtan, 2013.
– The differences in the forcing estimates used e.g. between Otto et al 2013 and AR5 are not some "unexplainable change of mind of the same group of authors" but are following different tow different logics, and also two different (if only slightly) methods of compiling aggregate uncertainties relative to the reference period, i.e. the Otto et al forcing is deliberately "adjusted" to represent more closely recent observations, whereas AR5 has not put so much weight on these satellite observations, due to still persisting potential problems with this new technology
– The IPCC process itself explains potential inconsistencies under the strict requirement of a simplistic energy balance: The different estimates for temperature, heat uptake, forcing, and ECS and TCR are made within different working groups, at slightly different points in time, and with potentially different emphasis on different data sources. The IPCC estimates of different quantities are not based on single data sources, nor on a fixed set of models, but by construction are expert based assessments based on a multitude of sources. Hence the expectation that all expert estimates are completely consistent within a simple energy balance model is unfunded from the beginning.
– Even more so, as the very application of the Kappa model (the simple energy balance model employed in this work, in Otto et al, and Gregory 2004) comes with a note of caution, as it is well known (and stated in all these studies) to underestimate ECS, compared to a model with more time-scales and potential non-linearities (hence again no wonder that CMIP5 doesn't fit the same ranges)

Summarising, the simplistic comparison of ranges from AR4, AR5, and Otto et al, combined with the statement they they are inconsistent is less then helpful, actually it is harmful as it opens the door for oversimplified claims of "errors" and worse from the climate sceptics media side.

One cannot and should not simply interpret the IPCCs ranges for AR4 or 5 as confidence intervals or pdfs and hence they are not directly comparable to observation based intervals (as e.g. in Otto et al).

In the same way that one cannot expect a nice fit between observational studies and the CMIP5 models.

A careful, constructive, and comprehensive analysis of what these ranges mean, and how they come to be different, and what underlying problems these comparisons bring would indeed be a valuable contribution to the debate.

I have rated the potential impact in the field as high, but I have to emphasise that this would be a strongly negative impact, as it does not clarify anything but puts up the (false) claim of some big inconsistency, where no consistency was to be expected in the first place.
And I can't see an honest attempt of constructive explanation in the manuscript.

Thus I would strongly advise rejecting the manuscript in its current form.

Referee two:
COMMENTS TO THE AUTHOR(S)

I would be interested in learning whether or not there are internal inconsistencies in estimates of climate sensitivity and forcing in individual studies and in learning if there are substantial differences among the studies. I would be even more interested in understanding why any apparent inconsistencies and differences might exist. On this second point, the manuscript has little to offer (other than some speculation that aerosol forcing estimates have changed). And unfortunately on the first point, the authors have only superficially demonstrated possible inconsistencies.  Moreover, in addressing the question of “committed warming”, the authors have inexplicably used the wrong equation. For all these reasons, I recommend the paper be rejected.

The authors use the wrong equation to calculate the “committed warming”. In their equation 3, they should use the equilibrium climate sensitivity, not the transient climate sensitivity. This would then yield the climate system’s eventual equilibrium temperature increase (relative to pre‐industrial temperature) for a given forcing, which they take to be present day GHG forcing. Since the transient climate sensitivity is quite a bit lower than the equilibrium climate sensitivity, they have substantially underestimated the committed warming.