Why We Disagree About Forest Carbon. II. Objectivity, Peer Review, Predictions and Funding Sources
In the quest to understand Why People Disagree About Forest Carbon (if last year summer was the Summer of Fuel Treatments, this summer can be the Summer of Forest Carbon), I’ve been thinking that this would be a great topic to explore from two angles. The first is what scientists have to say about it, and why they disagree. But what I’ve found out by exploring around the edges is that it can also be a case study in the sociology of science. Looking at what’s out there can help people understand how scientific research is produced and used in policy or management. This includes the unimaginably complicated and preternaturally vitriolic field of climate science/policy.
Fergus McLean, in a previous comment here, raised four points that can add to this discussion. First, he mentioned that Law’s paper is objective and peer-reviewed.
1. Peer review.
Without reviewing the literature on peer review in detail, I can only say here that if people think something is important, it’s not usually a volunteer activity in the sense that people aren’t paid to do it. Let’s use an analogy. We think wildland firefighting is important. We pay people to do it. We even pay them overtime and hazard pay. Doing peer review well is time-consuming and, if done well, may have hazards like falling behind in what you are being paid to do, and critical reviews, if not completely blind, have risks of irritating your colleagues. They can retaliate in a variety of unpleasant ways. People who are close enough to the topic are probably not objective (is Professor A objective when Professor C models the same phenomenon as she does, using different techniques and coming to different conclusions?). People who are far away enough to be objective usually don’t know the topic as well. We are asking for a quality product with incentives that run against the basic principles of human nature. These problems are well known in the literature, and a variety of tweaks to the process have been proposed (e.g. this Lancet paper has quite a round-up of approaches) https://ift.tt/2zaqZ6V
But don’t believe me about objectivity here’s an article in the Stanford Encyclopedia of Philosophy. Through the dense fog of academic philosophy lingo, we can see the vague outlines of observations within our own experiences.
3. Handling uncertainty
When Fergus said “Choosing to regard existing export arrangements as permanent is a political, rather than a scientific judgement, and deserving of in-depth and critical analysis.” I agree but I would tend to take a different approach. I would imagine that I had crossed disciplinary thresholds into the world of economics.
Economists have a long history of making projections about imports, exports, demand, supply, prices, and so on. Even now, I suspect there is a cadre somewhere working on today’s installment of the Softwood Lumber Agreement with Canada. One of the tools economists use is “sensitivity analysis”. When you make many assumptions about things that are unpredictable, this tool helps you figure out which ones are really meaningful to the end you are studying. Let me restate, rather than arguing about which predictions will be more accurate based on whatever criteria (after all, how good have we really been about predicting the future?), they include a range of for each unknown and it helps them understand which assumptions are more important to the outcome. I think that this is important to consider, because we rely on models so much these days, and some disciplines use sensitivity analysis much more than others.
4.How much research on carbon does forest industry fund? Does funding source matter?
“Another relevant point that can be drawn from the Atkins article is the much greater scale of resources backing research oriented to the industry point of view about forest carbon (including TreeSource itself) in contrast to Law who, since Harmon’s recent retirement, essentially works alone. “
The idea that industry backs more carbon research than NSF, the Forest Service, EPA and so on is interesting, and possible to investigate. I’m not much of an industry person but I believe there was some corporate restructuring at some point that led to them pretty much getting out of the research business. Many of my industry colleagues lost their jobs. Has that changed?
via A New Century of Forest Planning https://ift.tt/YeNBM9