Climate Research Fails a Science Integrity Test

Last February I documented how PNAS had published a paper — Grinsted et al. 2018 — that was based on a fake ‘dataset” of hurricane losses assembled by a successive set of interns for a now defunct insurance company, for purposes of marketing insurance products. The “dataset” was never intended for research.

I won’t rehash the details here — you can take a deep dive here. The “dataset” simply does not exist and thus the paper’s analysis and conclusions are based on false information. This case is not complicated or difficult to understand.

At the time, I requested of the editor of the paper, Kerry Emanuel of MIT, that the paper be retracted based on its reliance on a fake dataset. Emanuel agreed to escalate my request to PNAS.

Today, I heard back from PNAS that the dataset and paper are without problems and the matter is now closed. I reproduce the full PNAS email to me below. Some highlights:

• Remarkably, PNAS did not actually examine the dataset in question;
• PNAS apparently relied instead on an unrelated letter I submitted on the paper’s methods from 2019 — the information I shared with them earlier this year was based on new information, which was apparently ignored.
• Remarkably, one of the “expert” reviewers wrote: “the conclusions of the Grinsted et al. article do not depend on the ICAT dataset due to the robustness analyses performed with the other datasets.” This is easily shown to be false — The “other” datasets are subsets of the fake dataset, as I explained to PNAS but which they apparently did not read or ignored. Remarkable.
• The “expert” reviewer wrote that my request: “does not change my impression of the validity of the data, and again ignores the robustness analyses performed with the other datasets.” There are no other datasets. Rather than rely on an “impression,” PNAS could have actually looked at the data and done some simple analyses to confirm my assertions — it might have taken all of 10 minutes.

Today, I emailed Kerry Emanuel, who edited the original paper, and asked if he agreed with the PNAS verdict. He said that he did agree that the paper was fine.

Keep reading