A human's eye view: motion blur and frameless rendering

ABSTRACT

Frameless Rendering (FR) is a rendering paradigm which performs stochastic temporal filtering by updating pixels in a random order, based on most recent available input data, and displaying them to the screen immediately [1]. This is a departure from frame-based approaches commonly experienced in interactive graphics. A typical interactive graphics session uses a single input state to compute an entire frame. This constrains the state to be known at the time the first pixel's value is computed. Frameless Rendering samples inputs many times during the interval which begins at the start of the first pixel's computation and ends with the last pixel's computation. Thus, Frameless Rendering performs temporal supersampling - it uses more samples over time. This results in an approximation to motion blur, both theoretically and perceptually.This paper explores this motion blur and its relationship to: camera open shutter time, current computer graphics motion-blur implementations, temporally anti-aliased images, and the Human Visual System's (HVS) motion smear quality (see 'quality' footnote) [2].Finally, we integrate existing research results to conjecture how Frameless Rendering can use knowledge of the Human Visual System's blurred retinal image to direct spatiotemporal sampling. In other words, we suggest importance sampling (see 'sampling' footnote) by prioritizing pixels for computation based on their importance to the visual system in discerning what is occurring in an interactive image sequence.

REFERENCES

• 1: Gary Bishop , Henry Fuchs , Leonard McMillan , Ellen J. Scher Zagier, Frameless rendering: double buffering considered harmful, Proceedings of the 21st annual conference on Computer graphics and interactive techniques, p.175-176, July 1994 [doi>10.1145/192161.192195]
• 2: 2 David Burr. Visual processing of motion. In Trends in Neuro Sciences, volume 9, No. 7, July 1986.
• 3: Robert L. Cook , Thomas Porter , Loren Carpenter, Distributed ray tracing, Proceedings of the 11th annual conference on Computer graphics and interactive techniques, p.137-145, January 1984
• 4: Michael P. Eckert , Gershon Buchsbaum, The significance of eye movements and image acceleration for coding television image sequences, Digital images and human vision, MIT Press, Cambridge, MA, 1993
• 5: 5 Bernd Girod. Eye movements and coding of video sequences. In T. R. Hsing, editor, SPIE Visual Communications and Image Processing, pages 398-405, 1988.
• 6: Jonathan Korein , Norman Badler, Temporal anti-aliasing in computer generated animation, Proceedings of the 10th annual conference on Computer graphics and interactive techniques, p.377-388, July 25-29, 1983, Detroit, Michigan, United States
• 7: Michael Potmesil , Indranil Chakravarty, Modeling motion blur in computer-generated images, Proceedings of the 10th annual conference on Computer graphics and interactive techniques, p.389-399, July 25-29, 1983, Detroit, Michigan, United States
• 8: 8 Ellen J. Scher Zagier. Frameless antialiasing. Technical Report UNC-CS-TR-95-026, Department of Computer Science, University of North Carolina at Chapel Hill, 1995.
• 9: 9 Robert Sekuler and Randolph Blake. Perception. McGraw-Hill Publishing Company, New York, 1990.

INDEX TERMS

Primary Classification:
  I. Computing Methodologies
  I.2 ARTIFICIAL INTELLIGENCE
        I.2.10 Vision and Scene Understanding
            Subjects: Motion

Additional Classification:
  H. Information Systems
  H.1 MODELS AND PRINCIPLES

  I. Computing Methodologies
  I.4 IMAGE PROCESSING AND COMPUTER VISION
      I.4.8 Scene Analysis
          Subjects: Time-varying imagery

General Terms:
Design, Measurement, Performance, Theory