Processing of volumetric data by slice- and process-based streaming

ABSTRACT

Although the main memory capacity of modern computers is constantly growing, the developers and users of data manipulation and visualization tools fight all over again with the problem of its shortage. In this paper, we advocate slice-based streaming as a possible solution for the memory shortage problem in the case of preprocessing and analysis of volumetric data defined over Cartesian, regular and other types of structured grids. In our version of streaming, data flows through independent processing units---filters---represented by individual system processes, which store each just a minimal fraction of the whole data set, with a slice as a basic data entity. Such filters can be easily interconnected in complex networks by means of standard interprocess communication using named pipes and are executed concurrently on a parallel system without a requirement of specific modification or explicit parallelization.

In our technique, the amount of stored data by a filter is defined by the algorithm implemented therein, and is in most cases as small as one data slice or only several slices. Thus, the upper bound on the processed data volume is not any more defined by the main memory size but is shifted to the disc capacity, which is usually orders of magnitude larger. We propose implementations of this technique for various point, local and even global data processing operations, which may require multiple runs over the input data or eventually temporary data buffering. Further, we give a detailed performance analysis and show how well this approach fits to the current trend of employing cheap multicore processors and multiprocessor computers.

REFERENCES

• 1: James Ahrens , Kristi Brislawn , Ken Martin , Berk Geveci , C. Charles Law , Michael Papka, Large-Scale Data Visualization Using Parallel Data Streaming, IEEE Computer Graphics and Applications, v.21 n.4, p.34-41, July 2001
• 2: Bærentzen, J. A., and Christensen, N. J. 2002. A technique for volumentric CSG based on morphology. In Volume Graphics'01, K. Mueller, Ed., 71--79.
• 3: Ingmar Bitter , Robert Van Uitert , Ivo Wolf , Luis Ibanez , Jan-Martin Kuhnigk, Comparison of Four Freely Available Frameworks for Image Processing and Visualization That Use ITK, IEEE Transactions on Visualization and Computer Graphics, v.13 n.3, p.483-493, May 2007 [doi>10.1109/TVCG.2007.1001]
• 4: Ricardo Farias , Cláudio T. Silva, Out-Of-Core Rendering of Large, Unstructured Grids, IEEE Computer Graphics and Applications, v.21 n.4, p.42-50, July 2001
• 5: Fleischmann, D., Hallett, R. L., and Rubin, G. D. 2006. CT angiography of peripheral arterial disease. J Vasc Interv Radiol 17, 3--26.
• 6: Alejandro F. Frangi , Wiro J. Niessen , Koen L. Vincken , Max A. Viergever, Muliscale Vessel Enhancement Filtering, Proceedings of the First International Conference on Medical Image Computing and Computer-Assisted Intervention, p.130-137, October 11-13, 1998
• 7: Sarah F. Frisken , Ronald N. Perry , Alyn P. Rockwood , Thouis R. Jones, Adaptively sampled distance fields: a general representation of shape for computer graphics, Proceedings of the 27th annual conference on Computer graphics and interactive techniques, p.249-254, July 2000 [doi>10.1145/344779.344899]
• 8: Ibanez, L., Schroeder, W., Ng, L., and Cates, J. 2003. The ITK Software Guide: The Insight Segmentation and Registration Toolkit, first ed. Kitware Inc.
• 9: Ibarria, L., Lindstrom, P., Rossignac, J., and Szymczak, A. 2003. Out-of-core compression and decompression of large n-dimensional scalar fields. In Proceedings of Eurographics 2003, Blackwell Publishing Inc, P. Brunet and D. Fellner, Eds., vol. 22(3) of Computer Graphics Forum, 343--348.
• 10: Martin Isenburg , Peter Lindstrom , Stefan Gumhold , Jonathan Shewchuk, Streaming compression of tetrahedral volume meshes, Proceedings of Graphics Interface 2006, June 07-09, 2006, Quebec, Canada
• 11: Martin Isenburg , Yuanxin Liu , Jonathan Shewchuk , Jack Snoeyink, Streaming computation of Delaunay triangulations, ACM SIGGRAPH 2006 Papers, July 30-August 03, 2006, Boston, Massachusetts
• 12: ITK-thread 2007. Streaming large datasets with ITKVTK. http://public.kitware.com/pipermail/vtkusers/2007-January/089052.html.
• 13: Mark W. Jones , J. Andreas Baerentzen , Milos Sramek, 3D Distance Fields: A Survey of Techniques and Applications, IEEE Transactions on Visualization and Computer Graphics, v.12 n.4, p.581-599, July 2006 [doi>10.1109/TVCG.2006.56]
• 14: Arie Kaufman , Daniel Cohen , Roni Yagel, Volume Graphics, Computer, v.26 n.7, p.51-64, July 1993 [doi>10.1109/MC.1993.274942]
• 15: C. Charles Law , William J. Schroeder , Kenneth M. Martin , Joshua Temkin, A multi-threaded streaming pipeline architecture for large structured data sets, Proceedings of the conference on Visualization '99: celebrating ten years, p.225-232, October 1999, San Francisco, California, United States
• 16: William E. Lorensen , Harvey E. Cline, Marching cubes: A high resolution 3D surface construction algorithm, ACM SIGGRAPH Computer Graphics, v.21 n.4, p.163-169, July 1987
• 17: Claudio Montani , Roberto Scopigno, Rendering volumetric data using STICKS representation scheme, Proceedings of the 1990 workshop on Volume visualization, p.87-93, December 10-11, 1990, San Diego, California, United States
• 18: Schroeder, W. J., Martin, K. M., and Lorensen, W. E. 2004. The Visualization Toolkit, third ed. Kitware Inc.
• 19: SCIRun: A Scientific Computing Problem Solving Environment, Scientific Computing and Imaging Institute (SCI).
• 20: Milos Sramek , Arie E. Kaufman, Alias-Free Voxelization of Geometric Objects, IEEE Transactions on Visualization and Computer Graphics, v.5 n.3, p.251-267, July 1999 [doi>10.1109/2945.795216]
• 21: Stephens, R. 1997. A survey of stream processing. Acta Inf. 34, 7, 491--541.
• 22: Huy T. Vo , Steven P. Callahan , Peter Lindstrom , Valerio Pascucci , Claudio T. Silva, Streaming Simplification of Tetrahedral Meshes, IEEE Transactions on Visualization and Computer Graphics, v.13 n.1, p.145-155, January 2007 [doi>10.1109/TVCG.2007.21]

INDEX TERMS

Primary Classification:
  I. Computing Methodologies
  I.3 COMPUTER GRAPHICS
      I.3.6 Methodology and Techniques
          Subjects: Interaction techniques

Additional Classification:
  I. Computing Methodologies
  I.3 COMPUTER GRAPHICS
      I.3.4 Graphics Utilities
          Subjects: Application packages

Keywords:
streaming, volume visualization, volumetric data processing