“3D Galatea: Entry of three-dimensional moving points from multiple perspective views” by MacKay, Sayre and Potel

We describe an interactive graphics system for the entry of three-dimensional moving points from multiple perspective views. This work represents a major extension of Galatea, our system for graphics-assisted 2D motion analysis. 3D Galatea permits reconstruction of 3D time-dependent positions from 2D entries in two or more perspective views. The system supports a general approach for calibrating perspective views. This method, based on work of Sutherland, uses a known 3D reference object to calibrate completely arbitrary perspective projections. A somewhat restricted class of perspective views may be calibrated without an explicit calibration object using another approach developed from photogrammety. In 2D Galatea, we have used an animated graphics overlay onto the source image to give the analyst feedback regarding current and previous data entries. This capability is extended in 3D Galatea by overlaying auxiliary lines, which are the backprojections of previous 2D entries from one view into other views. This concept amounts to a fourth interpretation of the well-known Roberts homogeneous matrix equation describing perspective projections of 3D space into a 2D image. The auxiliary line is useful in locating a point which is obscured in one of the images, or in determining the correspondence of projected points as seen in different views, which may be ambiguous or easily confused.

1. Aisen, A. M., Al-Sadir, J., MacKay, S. A., Potel, M. J., Rubin, J. M., and Sayre, R. E. Quantitative ventricular wall motion analysis from biplane coronary angiograms. Proc. IEEE Computers in Cardiology, (1980), 443-446.
2. Cullen, J. M., Shaw, E., and Baldwin, H. A. Methods for measuring the three-dimensional structure of fish schools. Animal Behaviour 13, (1965), 534-543.
3. Futrelle, R. P. and Potel, M. J. The system design for Galatea, an interactive real-time graphics system for movie and video analysis. Computers and Graphics 1, (1975), 115-121.
4. Graybill, F. A. Introducton to Matrices with Applications in Statistics. Belmont, CA.: Wadsworth Publishing Co. (1969).
5. Longuet-Higgins, H. C. A computer algorithm for reconstructing a scene from two projections. Nature (London) 293, (1981), 133-135.
6. MacKay, S. A. A system for graphics assisted entry of 3D points. Proc. IEEE 4th Int’l. Computer Software and Applications Conf, (COMPSAC’80), (1980), 128-134.
7. Merchant, J. Exact area registration of different views of a common object scene. Optical Engineering 20, (1981), 424-436.
8. Newman, W. M. and Sproull, R. F. Principles of Interactive Computer Graphics, (2nd edition). New York: McGraw-Hill, (1979).
9. Partridge, B. L. and Cullen, J. M. A low cost interactive coordinate plotter. Behavior Research Methods and Instrumentation 9, (1977), 473-479.
10. Potel, M. J. and Sayre, R. E. Interacting with the Galatea film analysis system. ACM Computer Graphics 10, (1976), 52-59.
11. Potel, M. J. and Sayre, R. E. Data environment for a laboratory film analysis system. Proc. IEEE 1st Int’l. Computer Software and Applications Conf. (COMPSAC ’77,) (1977), 800-806.
12. Potel, M. J., MacKay, S. A., and Sayre, R. E. Galatea, an interactive computer graphics system for movie and video analysis. Proc. 15th Int’l. Cong. on High Speed Photography and Photonics, in press, (1982).
13. Potel, M. J., Sayre, R. E., and MacKay, S. A. Graphics tools for interactive motion analysis. Comput. Graphics Imag. Proc. 14, (1980), 1-23.
14. Potel, M. J., Sayre, R. E., and Robertson, A. A system for interactive film analysis. Comput. Biol. Med. 9, (1979), 237-256.
15. Potel, M. J., Rubin, J. M., MacKay, S. A., Aisen, A. M., Al-Sadir, J., Sayre, R.E. Evaluation of heart wall motion in 3D using biplane coronary angiograms. Investigative Radiology 16, (1981), 5423.
16. Pratt, W. K. Digital Image Processing. New York: Wiley, (1978).
17. Roberts, L. G. Homogeneous matrix representation and manipulation of n-dimensional constructs. Document MS 1405, Lincoln Laboratory, MIT, Cambridge, MA., (1965).
18. Rogers, D. F. and Adams, J. A. Mathematical Elements for Computer Graphics. New York: McGraw-Hill, (1976).
19. Rubin, J. M. and Sayre, R. E. A computer-aided technique for overlaying cerebral angiograms onto computed tomograms. Investigative Radiology 13, (1978), 362-367.
20. Sayre, R. E., Rubin, J. M., Duda, E. E., and Patronas, N. J. Quantitative three-dimensional angiograms: application, including augmentation of computed tomograms. Proc. IEEE Conf. on Computer Applications in Radiology, (1979), 95-102.
21. Slama, C. C., Theurer, C., Henrikson, S. W., (eds). Manual of Photogrammetry. American Society of Photogrammetry, Falls Church, VA., (1980).
22. Sutherland, I. E. Three-dimensional data input by tablet. Proc. IEEE 62, (1974), 454-461.
23. Ullman, S. The Interpretation of Visual Motion. MIT Press: Cambridge and London, (1979).
24. Underwood, E. E. Quantitative Stereology. Reading, MA.: Addison-Wesley, (1970).