Ken Brodlie and Rodolfo Allendes Osorio and Adriano Lopes.
A Review of Uncertainty in Data Visualization.
In John Dill, Rae Earnshaw, David Kasik, John Vince and Pak Chung Wong (Eds.), Expanding the Frontiers of Visual Analytics and Visualization, Springer Verlag London, pp. 81--109, 2012.


Links:

Abstract:

Most visualization techniques have been designed on the assumption that the data to be represented are free from uncertainty. Yet this is rarely the case. Recently the visualization community has risen to the challenge of incorporating an indication of uncertainty into visual representations, and in this article we review their work. We place the work in the context of a reference model for data visualization, that sees data pass through a pipeline of processes. This allows us to distinguish the visualization of uncertainty - which considers how we depict uncertainty specified with the data - and the uncertainty of visualization - which considers how much inaccuracy occurs as we process data through the pipeline. It has taken some time for uncertain visualization methods to be developed, and we explore why uncertainty visualization is hard - one explanation is that we typically need to find another display dimension and we may have used these up already! To organise the material we return to a typology developed by one of us in the early days of visualization, and make use of this to present a catalogue of visualization techniques describing the research that has been done to extend each method to handle uncertainty. Finally we note the responsibility on us all to incorporate any known uncertainty into a visualization, so that integrity of the discipline is maintained.

Bibtex:

@InCollection{   brodlie:2012:RUDV,
  author = 	 {Ken Brodlie and Rodolfo Allendes Osorio and Adriano Lopes},
  title = 	 {A Review of Uncertainty in Data Visualization},
  booktitle = 	 {Expanding the Frontiers of Visual Analytics and Visualization},
  pages = 	 {81--109},
  publisher =    {Springer Verlag London},
  year = 	 {2012},
  editor = 	 {John Dill, Rae Earnshaw, David Kasik, John Vince and Pak Chung Wong},
}

Images:

References:

1. Jeroen C.J.H. Aerts, Keith C. Clarke, and Alex D. Keuper. Testing popular visualization techniques for representing model uncertainty. Cartography and Geographic Information Science, 30(3):249-261, 2003.
2. Rodolfo S. Allendes Osorio. Visualization of Uncertainty in Scientific Data. PhD thesis, University of Leeds, 2010.
3. Rodolfo S. Allendes Osorio and Ken W. Brodlie. Contouring with uncertainty. In Ik Soo Lim and Wen Tang, editors, Proceedings 6th Theory & Practice of Computer Graphics Conference(TP.CG.08). Eurographics Association, 2008.
4. Rodolfo S. Allendes Osorio and Ken W. Brodlie. Uncertain flow visualization using LIC. In W. Tang and J. Collomosse, editors, Theory and Practice of Computer Graphics - Eurographics UK Chapter Proceedings, pages 215-222, 2009.
5. W. Berger, H. Piringer, P. Filzmoser, and E. Groller. Uncertainty-aware exploration of continuous parameter spaces using multivariate prediction. Computer Graphics Forum, 30(3):911-920, 2011.
6. H. Bhatia, S. Jadhav, P.-T. Bremer, G. Chen, J.A. Levine, L.G. Nonato, and V. Pascucci. Edge maps: Representing flow with bounded error. In Proceedings of IEEE Pacific Visualization Symposium 2011, pages 75-82, March 2011.
7. Rory J. Bingham and Keith Haines. Mean dynamic topography: intercomparisons and errors. Philosophical Transactions of The Royal Society A, pages 903 - 916, 2006.
8. R.A. Boller, S.A. Braun, J. Miles, and D.H. Laidlaw. Application of uncertainty visualization methods to meteorological trajectories. Earth Science Informatics, 3:119-126, 2010.
9. Georges-Pierre Bonneau, Gordon Kindlmann, Hans-Christian Hege, Chris R. Johnson, Manuel Oliveira, Kristin Potter, and Penny Rheinghans. Overview and state-of-the-art of uncertainty visualization. In Scientific Visualization: Challenges for the Future, Min Chen, Hans Hagen, Charles Hansen, Chris Johnson and Arie Kaufmann (eds), in preparation, 2012.
10. Ralf P. Botchen, Daniel Weiskopf, and Thomas Ertl. Texture-based visualization of uncertainty in flow fields. In Proceedings of IEEE Visualization 2005, pages 647-654, 2005.
11. Nadia Boukhelifa and David J. Duke. The uncertain reality of underground assets. In Proceedings of ISPRS/ICA/DGfK Joint Workshop on Visualization and Exploration of Geospatial Data. ISPRS, 2007.
12. K. Brodlie. A classification scheme for scientific visualization. In R.A. Earnshaw and D. Watson, editors, Animation and Scientific Visualization, pages 125-140. Academic Press, 1993.
13. K. W. Brodlie, L. A. Carpenter, R. A. Earnshaw, J. R. Gallop, R. J. Hubbold, A. M. Mumford, C. D. Osland, and P. Quarendon, editors. Scientific Visualization - techniques and applications.Springer-Verlag, 1992.
14. Ross A Brown. Animated visual vibrations as an uncertainty visualisation technique. In International Conference on Computer Graphics and Interactive Techniques in Australasia and South East Asia, pages 84-89, 2004.
15. B. Buttenfield and M.K. Beard. Graphical and geographical components of data quality. In H.M. Hearnshaw and D.J. Unwin, editors, Visualization in Graphical Information Systems, pages 150-157. Wiley, 1994.
16. Hamish Carr, Torsten Moller, and Jack Snoeyink. Artifacts caused by simplicial subdivision. IEEE Transactions on Visualization and Computer Graphics, 12(2):231-242, 2006.
17. Andrej Cedilnik and Penny Rheingans. Procedural annotation of uncertain information. In Proceedings of Visualization 2000, pages 77-84. IEEE Computer Society Press, 2000.
18. Alexandre Coninx, Georges-Pierre Bonneau, Jacques Droulez, and Guillaume Thibault. Visualization of uncertain scalar data fields using color scales and perceptually adapted noise. In Applied Perception in Graphics and Visualization, Toulouse, France, 2011.
19. G. Coppola, S.J. Sherwin, and J. Peiro. Nonlinear particle tracking for high-order elements. Journal of Computational Physics, 172(1):356-386, 2001.
20. Carlos D. Correa, Yu-Hsuan Chan, and Kwan-Liu Ma. A framework for uncertainty-aware visual analytics. In Proceedings of IEEE Symposium on Visual Analytics Science and Technology VAST 09, 2009.
21. M.G. Cox and P.M. Harris. Uncertainty evaluation. Technical report, National Physical Laboratory, March 2004. Software Support for Metrology. Best Practice Guide No. 6.
22. G. Cumming, F. Fidler, and D.L. Vaux. Error bars in experimental biology. The Journal of Cell Biology, 177(1):7-11, 2007.
23. Mohammad Daradkeh, Alan McKinnon, and Clare Churcher. Visualisation tools for exploring the uncertainty-risk relationship in the decision-making process: a preliminary empirical evaluation. In Proceedings of the Eleventh Australasian Conference on User Interface - Volume 106, AUIC '10, pages 42-51, Darlinghurst, Australia, Australia, 2010. Australian Computer Society, Inc.
24. Trevor J. Davis and C. Peter Keller. Modelling and visualizing multiple spatial uncertainties. Computers and Geosciences, 23(4):397 - 408, 1997. Exploratory Cartograpic Visualisation.
25. Suzana Djurcilov, Kwansik Kim, Pierre Lermusiaux, and Alex Pang. Visualizing scalar volumetric data with uncertainty. Computers & Graphics, 26:239-248, 2002.
26. C.R. Ehlschlaeger, A.M. Shortridge, and M.F. Goodchild. Visualizing spatial data uncertainty using animation. Computers and Geosciences, 23(4):387-395, 1997.
27. D. Feng, L. Kwock, Y. Lee, and R.M. Taylor. Matching visual saliency to confidence in plots of uncertain data. IEEE Transactions on Visualization and Computer Graphics, 16(6):980-989, 2010.
28. P. Fisher. Animation and sound for the visualization of uncertain spatial information. In Visualization in Graphical Information Systems, pages 181-185. Wiley, 1994.
29. M. Goodchild, B.Buttenfield, and J. Wood. Introduction to visualizing data validity. In H.M. Hearnshaw and D.J. Unwin, editors, Visualization in Graphical Information Systems, pages 141-149. Wiley, 1994.
30. Henning Griethe and Heidrun Schumann. The visualization of uncertain data: Methods and problems. In Proceedings of the 17th Simulation and Visualization Conference, 2006.
31. Gevorg Grigoryan and Penny Rheingans. Point-based probabilistic surfaces to show surface uncertainty. IEEE Transactions on Visualization and Computer Graphics, 10(5):564-573, 2004.
32. Robert B. Haber and David A. McNabb. Visualization idioms: A conceptual model for scientific visualization systems. In B. Shriver, G.M. Nielson, and L.J. Rosenblum, editors, Visualization in Scientific Computing, pages 74-93. IEEE, 1990.
33. T. Hengl. Visualisation of uncertainty using the hsi colour model: Computation with colours. InProceedings of the 7th International Conference on GeoComputation, pages 8-17, Southampton, United Kingdom, 2003.
34. Marcel Hlawatsch, Philipp Leube, Wolfgang Nowak, and Daniel Weiskopf. Flow radar glyphs - static visualization of unsteady flow with uncertainty. IEEE Transactions on Visualization and Computer Graphics, 17(12):1949-1958, 2011.
35. H. Janicke, A. Wiebel, G. Scheuermann, and W. Kollmann. Multifield visualization using ölocal statistical complexity. IEEE Transactions on Visualization and Computer Graphics, 13(6):1384-1391, 2007.
36. Chris Johnson. Top scientific visualization research problems. IEEE Computer Graphics and Applications, pages 13-17, July/August 2004.
37. Chris R. Johnson and Allen R. Sanderson. A next step: Visualizing errors and uncertainties. IEEE Computer Graphics and Applications, pages 6-10, 2003.
38. K.-W. Juang, Y.-S. Chen, and D.-Y. Lee. Using sequential indicator simulation to assess the uncertainty of delineating heavy-metal contaminated soils. Environmental Pollution, 127:229-238, 2004.
39. J.D. Kahl and P.J. Sampson. Uncertainty in trajectory calculations due to low resolution meteorological data. Journal of Climate and Applied Meteorology, 25:1816-1831, 1986.
40. P. Kipfer, F. Reck, and G. Greiner. Local exact particle tracing on unstructured grids. Computer Graphics Forum, 22:133-142, 2003.
41. J.M. Kniss, R.V. Uitert, A. Stephens, G.-S. Li, T. Tasdizen, and C. Hansen. Statistically quantitative volume visualization. In IEEE Visualization 2005, 2005.
42. Hongwei Li, Chi-Wing Fu, Yinggang Li, and Andrew J. Hanson. Visualizing large-scale uncertainty in astrophysical data. IEEE Transactions on Visualization and Computer Graphics, 13(6):1640-1647, 2007.
43. S.K. Lodha, C.M. Wilson, and R.E. Sheehan. LISTEN: Sounding uncertainty visualization. In Proceedings of Visualization 96, pages 189-195, 1996.
44. Suresh K. Lodha, Alex Pang, Robert E. Sheehan, and Craig M. Wittenbrink. UFLOW: Visualizing uncertainty in fluid flow. In Roni Yagel and Gregory M. Nielson, editors, IEEE Visualization '96,, pages 249-254, 1996.
45. Adriano Lopes and K. Brodlie. Accuracy in 3D particle tracing. In H.C. Hege and K. Polthier, editors, Mathematical Visualization: Algorithms, Applications and Numerics, pages 329-341.Springer Verlag, 1999.
46. Adriano Lopes and Ken Brodlie. Accuracy in contour drawing. InProceedings of Eurographics, pages 301-312, 1998.
47. Adriano Lopes and Ken Brodlie. Improving the robustness and accuracy of the marching cubes algorithm for isosurfacing. IEEE Transactions on Visualization and Computer Graphics, 9:16-29, January 2003.
48. Alison L. Love, Alex T. Pang, and David L. Kao. Visualizing spatial multivalue data. IEEE Computer Graphics and Applications, pages 69-79, 2005.
49. C. Lundstrom, P. Ljung, A. Persson, and A. Ynnerman. Uncertainty visualization in medical volume rendering using probabilistic animation. IEEE Transactions on Visualization and Computer Graphics, 13(6):1648-1655, 2007.
50. A. Luo, D. Kao, and A. Pang. Visualizing spatial distribution data sets. In Proceedings of VISSYM '03 - Eurographics and IEEE TVCG Symposium on Visualization, pages 29-38. Eurographics Association, 2003.
51. Alan M. MacEachren. Visualizing uncertain information. Cartographic Perspective, Fall(13):10-19, 1992.
52. Alan M. MacEachren, Anthony Robinson, Susan Hopper, Steven Gardner, Robert Murray, Mark Gahegan, and Elisabeth Hetzler. Visualizing geospatial information uncertainty: what we know and what we need to know. Cartography and Geographic Information Science, 32(8):139-160, 2005.
53. Blake Nelson and Robert M. Kirby. Ray-tracing polymorphic multidomain spectral/hp elements for isosurface rendering. IEEE Transactions on Visualization and Computer Graphics, 12(1):114-126, 2006.
54. Nelson, Blake and Kirby, Robert M. and Haimes, Robert. Gpu-based interactive cut-surface extraction from high-order finite element fields. IEEE Transactions on Visualization and Computer Graphics, 17(12):1803-1811, 2011.
55. T.S. Newman and W. Lee. On visualizing uncertainty in volumetric data: techniques and their evaluation. Journal of Visual Languages and Computing, 15:463-491, 2004.
56. G.M. Nielson and I.-H. Jung. Tools for computing tangent curves for linearly varying vector fields over tetrahedral domains. IEEE Transactions on Visualization and Computer Graphics, 5(4):360-372, 1999.
57. Chris Olston and Jock D. Mackinlay. Visualizing data with bounded uncertainty. In INFOVIS, pages 37-, 2002.
58. M. Otto, T. Germer, H.-C. Hege, and H. Theisel. Uncertain 2d vector field topology. Computer Graphics Forum, 29(2):347-356, 2010.
59. Mathias Otto, Tobias Germer, and Holger Theisel. Uncertain topology of 3d vector fields. Visualization Symposium, IEEE Pacific, 0:67-74, 2011.
60. Alex T. Pang, Craig M. Wittenbrink, and Suresh K. Lodha. Approaches to uncertainty visualization. The Visual Computer, 13(8):370-390, 1997.
61. Frits H. Post, Benjamin Vrolijk, Helwig Hauser, Robert S. Laramee, and Helmut Doleisch. The state of the art in flow visualisation: Feature extraction and tracking. Computer Graphics Forum, 22(4):775-792, 2003.
62. K. Pothkow and H.-C. Hege. Positional uncertianty of isocontours: Condition analysis and öprobabilistic measures. IEEE Transactions on Visualization and Computer Graphics, 2010.
63. Kai Pothkow, Britta Weber, and Hans-Christian Hege. Probabilistic marching cubes. ö Computer Graphics Forum, 30(3):931-940, 2011.
64. K. Potter, J. Kniss, R. Riesenfeld, and C.R. Johnson. Visualizing summary statistics and uncertainty. Computer Graphics Forum, 29(3):823-831, 2010.
65. K. Potter, A. Wilson, P.-T. Bremer, D. Williams, C. Doutriaux, V. Pascucci, and C.R. Johnson. Ensemble-vis: A framework for the statistical visualization of ensemble data. In Proceedings of the 2009 IEEE International Conference on Data Mining Workshops, pages 233-240. IEEE Computer Society, 2009.
66. J.-S. Prabni, T. Ropinski, and K. Hinrichs. Uncertainty-aware guided volume segmentation.IEEE Transactions on Visualization and Computer Graphics, 16(6):1358-1365, 2010.
67. A. Preusser. Algorithm 671: Farb-e-2d: fill area with bicubics on rectangles—a contour plot program. ACM Trans. Math. Softw., 15:79-89, March 1989.
68. Philip J. Rhodes, Robert S. Laramee, R. Daniel Bergeron, and Ted M. Sparr. Uncertainty visualization methods in isosurface rendering. In M. Chover, H. Hagen, and D. Tost, editors, Proceedings of Eurographics. The Eurographics Association, 2003.
69. J. Sanyal, S. Zhang, G. Bhattacharya, P. Amburn, and R.J. Moorhead. A user study to compare four uncertainty visualization methods for 1D and 2D datasets. IEEE Transactions on Visualization and Computer Graphics, 15(6):1209-1218, 2009.
70. J. Sanyal, S. Zhang, J. Dyer, A. Mercer, P. Amburn, and R.J. Moorhead. Noodles: A tool for visualization of numerical weather model ensemble uncertainty. IEEE Transactions on Visualization and Computer Graphics, 16(6):1421-1430, 2010.
71. Judi Thomson, Beth Hetzler, Alan MacEachren, Mark Gahegan, and Misha Pavel. A typology for visualizing uncertainty. In Proceedings of the SPIE, Visualization and Data Analysis, pages 146-157, 2005.
72. M. Tory and T. Moeller. Rethinking visualization: A high-level taxonomy. In Proceedings of IEEE Symposium on Information Visualization, pages 151-158, 2004.
73. J.W. Tukey. Exploratory Data Analysis. Addison-Wesley, 1977.
74. USGS. Spatial Data Transfer Standard (SDTS): Logical Specifications, 1977.
75. Craig M. Wittenbrink, Alex T. Pang, and Suresh K. Lodha. Glyphs for visualizing uncertainty in vector fields. IEEE Transactions on Visualization and Computer Graphics, 2:266-279, 1996.
76. H. Wright, K. Brodlie, and T. David. Navigating high-dimensional spaces to support design steering. In Proceedings of IEEE Visualization 2000, pages 291-296, 2000.
77. Z. Xie, S. Huang, M.O. Ward, and E.A. Rundensteiner. Exploratory visualization of multivariate data with variable quality. In IEEE Symposium on Visual Analytics Science and Technology, pages 183-190, 2006.
78. B. Zehner, N. Watanabe, and O. Kolditz. Visualization of gridded scalar data with uncertainty in geosciences. Computers and Geosciences, 36(10):1268-1275, 2010.
79. T. Zuk. Visualizing Uncertainty. PhD thesis, Department of Computer Science, University of Calgary, 2008.
80. T. Zuk and S. Carpendale. Theoretical analysis of uncertainty visualizations. In Visualization and Data Analysis, 2006.
81. Torre Zuk, Jon Downton, David Gray, Sheelagh Carpendale, and J.D. Liang. Exploration of uncertainty in bidirectional vector fields. In Katy Borner, Matti T. Gr ö onh, Jinah Park, and öJonhathan C. Roberts, editors, Visualization and Data Analysis 2008, Proceedings of SPIEIS&T Electroning Imaging. SPIE and IS&T, 2008.