Mark Harrower.
Representing Uncertainty: Does it Help People Make Better Decisions?.
Technical Report, University Consortium for Geographic Information Science, Geospatial Visualization and Knowledge Discovery Workshop White Paper, 2003.


Links:

Abstract:

If there is one thing that defines and limits our efforts to better understand extreme and rare events it is uncertainty. Uncertainty arises from both an imperfect understanding of the rare events and processes we wish to study (e.g., terrorism, natural hazards), and the imperfect, out-of-date, and incomplete data we must work with in order to try and understand these events and processes. No data are perfect. However, uncertainty is more than a technical "failing" of our data (e.g., measurement error); it arises, in part, because there are simply some things that are unknowable (Couclelis 2003) or, as Fischer (1999) articulates, may not be knowable with precision (i.e., inherent vagueness).1 Nevertheless, outside of academic circles one rarely sees maps, GIS databases, or visualization systems that acknowledge these fundamental limitations. This omission is problematic because, as MacEachren (1992, p.10) notes: In the early stages of scientific analysis or policy formulation, providing a way for analysts to assess uncertainty in the data they are exploring is critical to the perspectives they form and the approaches they decide to pursue. In the last 15 years, researchers in GIScience have made great advances in defining, measuring, modeling, and visualizing uncertainty and data quality (notably, Buttenfield, Clarke, Goodchild, MacEachren, Fischer, Beard, Ehlschlaeger, see references). Indeed, uncertainty has become a central issue in GIScience research with numerous conference sessions and journal articles devoted to the topic. Despite this sustained attention, a basic question that remains largely unanswered is whether displaying uncertainty helps users. In other words, does displaying uncertainty on maps fundamentally change the way people think and problem-solve and ultimately lead to better decisions? In this paper I will (1) argue why we need answers to these questions, (2) briefly review and synthesize relevant research findings to date, (3) define what constitutes "better decisions," and (4) outline how we might proceed from here.

Bibtex:

@TechReport{     harrower:2003:RUBD,
  author = 	 {Mark Harrower},
  title = 	 {Representing Uncertainty: Does it Help People Make
                  Better Decisions?},
  institution =  {University Consortium for Geographic Information
                  Science, Geospatial Visualization and Knowledge
                  Discovery Workshop White Paper},
  year = 	 {2003},
}

References:

Aerts, J. C. J. H., Clarke, K. C. and Keuper, A. D. (2003). Testing popular visualization techniques for representing model uncertainty. Cartography and Geographic Information Science, 30 (3), pp. 249-261.
Agumya, A., and Hunter, G. J., (1999). A risk-based approach to assessing the fitness for use of spatial data. URISA Journal, 11, 33-44.
Agumya, A. and G. J. Hunter (2002). Responding to the consequences of uncertainty in geographical data. International Journal of Geographical Information Science, 16 (5): 405-417.
Aspinall, R.J. and Pearson, D.M. (1995). Describing and managing uncertainty of categorical maps in GIS, in Fisher, P. (Ed.), Innovations in GIS 2, London: Taylor & Francis, 71-83
Beard, M.K., Buttenfield, B.P., and Clapham, S.B. (1991). NCGIA Research Initiative 7: Visualization of Spatial Data Quality. Technical Paper 91-26, National Center for Geographic Information and Analysis, Santa Barbara, CA.
Beard, K. (1994). Accommodating Uncertainty in Query Response. Sixth International Symposium on Spatial Data Handling, Edinburgh, Scotland, International Geographical Union.
Buttenfield, B. P. (1993). Representing data quality. Cartographica, 30(2): 1-7.
Buttenfield, B. and M. K. Beard (1994). Graphical and geographical components of data quality. In Hearnshaw, H. M., and Unwin, D. J., (eds.) Visualization in Geographical Information Systems: John Wiley and Sons, New York, p. 150-157.
Clarke, K. C. and P. D. Teague (2000). "Representation of Cartographic Uncertainty Using Virtual Environments", in Heuvelink, G. B. M. and Lemmens, M. J. P. M. (eds) Proceedings, Accuracy 2000, 4th International Symposium on Spatial Accuracy Assessment in Natural Resources and Environmental Sciences, Amsterdam, Netherlands, pp. 109-116.
Chrisman, N. R. (1991). The Error Component in Spatial Data. Geographic Information Systems. New York, Wiley: 165-174.
Clapham, S. B. and K. Beard (1991). The Development of an Initial Framework for the Visualization of Spatial Data Quality. Proceedings ACSM-ASPRS Annual Convention 2: 73-82.
Crowley, J. L. and F. Ramparany (1987). Mathematical Tools for Representing Uncertainty in Perception. Spatial Reasoning and Multi-Sensor Fusion, St. Charles, Illinois, Morgan Kaufmann Publishers, Inc.
Couclelis, H. (2003). The certainty of uncertainty: GIS and the limits of geographic knowledge. Transactions in GIS, 7(2): 165-175.
Covello, V. T. (1987). Decision analysis and risk management decision making: Issues and methods. Risk Analysis, 7: 131-139.
Davis, T.J., and Keller, C.P., 1997, Modelling and visualizing multiple spatial uncertainties. Computers & Geosciences, 23(4): 397-408.
Edwards, L. D., and E. S. Nelson (2001). Visualizing data certainty: A case study using graduated circles maps. Cartographic Perspectives, 38 (Winter): 19-36.
Ehlschlaeger, C.R., and Goodchild, M.F. (1994). Uncertainty in spatial data: defining, visualizing, and managing data errors. Proceedings of GIS/LIS, 246-253.
Ehlschlaeger, C.R., Shortridge, A.M., and Goodchild, M.F., 1997, Visualizing spatial data uncertainty using animation. Computers & Geosciences, 23(4), 387-395.
Evans, B. J. (1997). Dynamic display of spatial data-reliability: does it benefit the map user? Computers and Geosciences 24(1): 1-14.
Fauerbach, E., R. Edsall, et al. (1996). Visualization of uncertainty in meteorological forecast models. Proceedings of the International Symposium on Spatial Data Handling, Delft, The Netherlands, August 12-16, Taylor & Francis.
Fisher, P.F. (1993). Visualizing uncertainty in soil maps by animation. Cartographica, 30(2&3), 20-27. Fisher, P.F. (1994). Visualization of the reliability in classified remotely sensed images. Photogrammetric Engineering and Remote Sensing, 60(7), 905-910.
Fisher, P.F. (1996). Animation of reliability in computer-generated dot maps and elevation models. Cartography and Geographic Information Systems, 23(4), 196-205.
Fischer (1999). Models of uncertainty in spatial data. In Longley P A, Goodchild M F, Maguire D J, and Rhind D W (eds), Geographical Information Systems: Principles, Techniques, Management, and Applications. New York: Wiley: 191-205.
Frank, A. U. (1998). Metamodels for data quality description. In Data Quality in Geographic Information: From Error to Uncertainty, edited by M. F. Goodchild and R. Jeansoulin (Paris: Hermes), pp. 15-29.
Goodchild, M.F. (1991). Issues of Quality and Uncertainty, in Muller, J.C. (Ed.), Advances in Cartography, Essex: Elsevier Science Publishers.
Goodchild, M., Chih-Chang, L., and Leung, Y. (1994). Visualizing fuzzy maps. In Hearnshaw, H. M. and Unwin, D. J., (eds.), Visualization in Geographical Information Systems: John Wiley & Sons, New York, p. 158-167.
Goodchild, M. F. and Clarke, K. C. (2002). "Data Quality in Massive Data Sets", Chapter 18 in J. Abello et al. (eds) Handbook of Massive Data Sets , Amsterdam, Kluwer Academic. pp. 643-659.
Howard, D. and MacEachren, A.M. (1996). Interface design for geographic visualization: tools for representing reliability. Cartography and Geographic Information Systems, 23(2): 59-77.
Hunter, G.J. and Goodchild, M.F. (1994). Design and application of a methodology for reporting uncertainty in spatial databases. Proceedings, Urban and Regional Information Association, 771-786. Available: http://wwwsgi.ursus.maine.edu/gisweb/spatdb/urisa/ur94069
Hunter, G. J., and Goodchild, M. (1993). Managing uncertainty in spatial databases: putting theory into practice. URISA Journal, 5, 55-62.
Kaplan, S. (1997). The words of risk analysis. Risk Analysis, 17: 407-417.
Leitner, M., and B. P. Buttnefield (2000). Guidelines for trhe display of attribute certainty. Cartography and Geographic Information Science. 27(1): 3-14.
McGranaghan, M. (1993). A cartographic view of spatial data quality. Cartographica, 30(2&3): 8-19. MacEachren, A. M. (1992). Visualizing uncertain information. Cartographic Perspectives (13): 10-19.
MacEachren, A. M., D. Howard, et al. (1993). Visualizing the health of Chesapeake Bay: An uncertain endeavor. GIS/LIS Proceedings, vol. 1, American Society for Photogrammetry and Remote Sensing/American Congress on Surveying and Mapping, Bethesda MD, p. 449-458.
MacEachren, A. M. (1995). How Maps Work. New York, London: The Guilford Press.
Muehrcke, P. C. and J. O. Muehrcke (1992). Map Use: Reading, Analysis, and Interpretation. 3rd Edition. Madison WI: JP Publications.
Openshaw, S. (1989). Learning to Live with Errors in Spatial Databases. Accuracy of Spatial Databases. M. Goodchild and S. Gopal. New York, Taylor and Francis: 263-276.
Plewe, B. (2002). The nature of uncertainty in historical geographic information. Transactions in GIS, 6(4): 431-456.
Schweizer, D. M., and M. F. Goodchild (1992). Data Quality and Choropleth Maps: An Experiment with the Use of Color. Proceedings, GIS/LIS. 2:686-699.
Unwin, D. J. (1995). Geographical information systems and the problem of 'error and uncertainty'. Progress in Human Geography 19(4): 549-558.
van der Wel, F. J. M., Hootsman, et al. (1994). Visualization of data quality. In Visualization in Modern Cartography. A. M. MacEachren and D. R. F. Taylor (eds.). London, Pergamon: 313-332.