Tag Archives: global warming

Quality Metrics for Policy Evaluation?

The Center for Environmental Journalism (CEJ) recently posted an interview with Roger Pielke, Jr., an authority on (as CEJ calls it) “the nexus of science and technology in decision making”. The interview seeks to provide a perspective on how journalists can more accurately address climate change in the context of public policy over the next several years.

I was really intrigued by this part:

Reporters could help clarify understandings by asking climate scientists: “What behavior of the climate system over the next 5-10 years would cause you to question the IPCC consensus?” This would give people some metrics against which to evaluate future behavior as it evolves.

Similarly, you could ask partisans in the political debate “What science would cause you to change your political position on the issue?” This would allow people to judge how much dependence partisans put on science and what science would change their views. I would be surprised if many people would give a concrete answer to this!!

For the first question, Pielke is recommending is that we take an approach conceptually resembling statistical process control to help us figure out how to evaluate the magnitude and potential impacts of climate change. (Could we actually apply such techniques? It would be an interesting research question. Makes me think of studies like Khoo & Ariffin (2006), for example, who propose one method based on Shewhart x-bar charts to detect process shifts with a higher level of sensitivity – only tuned for a particular policy problem.) For the second question, I’m reminded of “willingness to pay” or “willingness to recommend” or other related marketing metrics. I’m sure that one of these established approaches could be extended to the policy domain (if it hasn’t been done already).

Quality Impacts of Global Warming and Climate Change

Temperatures in central Alaska have been 60 below zero (degrees F) for two weeks now:

Alaska Extreme Cold

Extreme temperatures — in Johnson’s case about 60 below zero — call for extreme measures in a statewide cold snap so frigid that temperatures have grounded planes, disabled cars, frozen water pipes and even canceled several championship cross country ski races. Alaskans are accustomed to subzero temperatures but the prolonged conditions have folks wondering what’s going on with winter less than a month old.

This is not an isolated event. Just last week, a record snow event in Washington state and British Columbia caused roofs to collapse.

What does it mean when “extreme events” happen more and more often? Are we really succumbing to global warming, or has global warming stopped, putting us on the threshold of a new ice age? I’m not interested in assessing the scientific validity of these speculations, especially since in many cases the observed data doesn’t match earlier predictions – collectively, we still have a lot to learn about the true impacts of anthropic climate change.

What I do want to focus on is one way in which our expectations influence decision making in quality management, and how this relates to climate change and the prospect of global warming. We don’t construct buildings that can withstand such heavy snow in Washington state, because historical weather records indicate that such weather is not likely to occur. Similarly, we don’t fortify buildings to be earthquake-proof in New England, because we don’t expect that a damaging event will ever happen there. Our expectations of environmental conditions influence the technical specifications that we establish.And our ability to conform to those specifications is one factor that determines quality of output.

Juran’s definition of quality as “fitness for use” implies that we understand the typical environmental conditions that characterize the context of use. We also have to be cognizant of the extreme events that might occur, and when these extreme events are outside the bounds of our expectations, failures can occur.

So from the quality perspective, it doesn’t matter if the polar ice caps melt or if they advance as far as Florida. A major unspoken risk of climate change is that we will be required to adapt to new environmental expectations, and it will take some time for us to make our manufacturing systems respond. For example, airplanes are air-worthy because they are fit for the expected context of use (flight altitude, expected outside air pressure, turbulence that’s not severe). This week in fact, many planes in Alaska have been grounded because they weren’t built for the extreme conditions.

If the environment changes significantly (whether it’s through global warming or global cooling), the assumptions underlying the technical specifications for many of the products that support our economy may have to shift. In the meantime, we can expect frequent and potentially serious quality problems to emerge.