“Perceptually Optimized 3D Transmission Over Wireless Networks” by Cheng and Basu
Conference:
Type(s):
Title:
- Perceptually Optimized 3D Transmission Over Wireless Networks
Session/Category Title: Technical Track
Presenter(s)/Author(s):
Moderator(s):
Abstract:
Many protocols optimized for transmission over wireless networks have been proposed. However, these protocols do not consider human perception in deciding a transmission strategy for 3D objects. Many factors, such as the number of vertices and the resolution of texture, can affect the display quality of 3D objects. When the resources of a graphics system are not sufficient to render the ideal image, degradation is inevitable. It is therefore important to study how individual factors will affect the overall quality, and how the degradation can be controlled given limited bandwidth resources and possibility of data loss.
This paper reviews the essential factors that determine display quality. It provides an overview of our research on designing a 3D perceptual-quality metric integrating two important factors, resolution of texture and resolution of mesh, that control the transmission bandwidth. It then suggests alternative strategies for packet 3D transmission of both texture and mesh. These strategies are compared with respect to preserving 3D perceptual quality under packet loss.
References:
[1]
{Ayan95} E. Ayanoglu et al. “A link-layer protocol for wireless networks,” ACM/Baltzer Wierless Networks J., Vol. 1, pp. 47–60, Feb. 1995.]]
[2]
{BB95} Ajay Bakre and B. R. Badrinath, “I-TCP: Indirect TCP for mobile hosts,” in Proc. 15th Int. Conf. Distributed Computing Systems (ICDCS), May 1995, pp. 136–143.]]
[3]
{BKVP97} B. S. Bakshi, P. Krishna, N. H. Vaidya, D. K. Pradhan, “Improving Performance of TCP over Wireless Networks”, Int. Conf. on Distributed Computing Systems, 1997.]]
[4]
{BM98} M. R. Bolin and G. W. Meyer, “A Perceptually Based Adaptive Sampling Algorithm,” ACM SIGGRAPH, 299–309, 1998.]]
[5]
{BSK95a} H. Balakrishnan, S. Seshan, and R. H. Katz, “Improving reliable transport and handoff performance in cellular wireless networks,” ACM Wireless Networks, vol. 1, no. 4, pp. 469–481, December 1995.]]
[6]
{BSK95b} H. Balakrishnan, S. Seshan, and R. H. Katz, “Improving TCP/IP performance over wireless networks,” presented at the 1st ACM Int. Conf. Mobile Computing and Networking (Mobicom), Berkeley, CA, Nov. 1995.]]
[7]
{BS97} K. Brown and S. Singh, “M-TCP: TCP for mobile cellular networks,” Computer Communication Review, July, 1997, pp. 19–43.]]
[8]
{BSRV04} S. Bhandarkar, N. Sadry, A. L. N. Reddy and N. Vaidya, “TCP-DCR: A Novel Protocol for Tolerating Wireless Channel Errors,” IEEE Trans. on Mobile Computing, February, 2004.]]
[9]
{BTB02} L. Balmelli, G. Taubin and F. Bernardini, “Space-optimized texture maps,” Eurographics, 2002, pp. 411–420.]]
[10]
{BW98} A. Basu and K. J. Wiebe, “Enhancing Videoconferencing Using Spatially Varying Sensing,” IEEE Trans. on SMC, March 1998.]]
[11]
{CB05} I. Cheng and P. Boulanger, “Feature extraction on 3D TexMesh using Scale-space analysis and Perceptual Evaluation,” IEEE Transactions on Circuits and Systems for Video Technology, Special Issue on Scale-space Feature Extraction, May, 2005.]]
[12]
{CBB03} Z. Chen, B. Bodenheimer and J. F. Barnes, “Robust transmission of 3D geometry over wireless networks,” Web3D, pp: 161–172, 2003.]]
[13]
{CI95} R. Caceres and L. Iftode, “Improving the performance of reliable transport protocols in mobile computing environments,” IEEE J. Select. Areas Comm., vol. 13, pp. 850–857, June 1995.]]
[14]
{Cign97} P. Cignoni et al., “A comparison of mesh simplification algorithms,” In Computers & Graphics, Pergamon Press, 1997.]]
[15]
{Daly93} S. Daly, “The visible differences predictor: an algorithm for the assessment of image fidelity,” In Watson, A. B. (ed.). Digital Images and Human Vision. MIT Press, Cambridge, MA, 1993, 179–206.]]
[16]
{Deer95} M. Deering, “Geometry Compression,” SIGGRAPH, pp 13–19, 1995.]]
[17]
{DLV96} C. J. van Den, B. Lambrecht, O. Verscheure, “Perceptual Quality Measure using a Spatio-Temporal Model of the Human Visual System,” in Proceedings of the SPIE, 450–461, 1996.]]
[18]
{Elaa02} H. Elaarag, “Improving TCP Performance over Mobile Networks,” ACM Computing Surveys, September 2002, pp. 357–374.]]
[19]
{Ferw97} J. A. Ferwerda et al., “A Model of Visual Masking for Computer Graphics,” ACM SIGGRAPH, pp 143–152, 1997.]]
[20]
{FF96} K. Fall and S. Floyd, “Simulation-based comparisons of Tahoe, Reno, and SACK TCP,” Comput. Commun. Rev., pp. 5–21, 1996.]]
[21]
{FR01} F. H. P. Fitzek and M. Reisslein, “A Prefetching Protocol for Continuous Media Streaming in Wireless Environments,” IEEE Journal on Selected Areas in Communications, 19(6):2015–2028, October 2001.]]
[22]
{Guil36} J. P. Guilford, Psychometric Methods, MacGraw-Hill Book Company Inc., 1936.]]
[23]
{HFY03} J. Hu, G. Feng and K. L. Yeung, “Hierarchical Cache Design for Enhancing TCP Over Heterogeneous Networks with Wired and Wireless Links,” IEEE Trans. On Wireless Communication, vol. 2, no. 2, March 2003.]]
[24]
{Hoe96} J. C. Hoe, “Improving the start-up behavior of a congestion control scheme for TCP,” In Proc. ACM SIGCOMM, California, 1996.]]
[25]
{Hopp96} H. Hoppe, “Progressive meshes,” SIGGRPAH 1996, Los Angeles, USA.]]
[26]
{HG97} P. S. Heckbert and M. Garland, “Survey of Polygonal Surface Simplification Algorithms,” CMU, 1997.]]
[27]
{HS93} P. Haeberli and M. Segal, “Texture Mapping as a Fundamental Drawing Primitive,” June 1993, http://www.sgi.com/grafica/texmap.]]
[28]
{KSS00} A. Khodakovsky, P. Schroder and W. Sweldens, “Progressive geometry compression,” ACM Siggraph, 2000.]]
[29]
{LC02} K. V. Lee and S. T. Chanson, “Packet loss probability for real-time wireless communications,” IEEE Transactions on Vehicular Technology, vol. 51, No. 6, pp. 1569–1575, Nov. 2002.]]
[30]
{Limb79} J. O. Limb, “Distortion Criteria of the Human Viewer,” IEEE Transactions on SMC, Vol. 9, No. 12, pp. 778–793, December 1979.]]
[31]
{LOZ00} F. Liu, G. S. Owen and Y. Zhu, “Universal converter for platform independent procedural shaders in X3D,” Siggraph 2004, Webgraphics presentation and abstract.]]
[32]
{MS74} J. L. Mannos and D. J. Sakrison, “The Effects of a Visual Fidelity Criterion on the Encoding of Images,” IEEE Trans. on Information Theory, 1974.]]
[33]
{Naga84} S. Nagata, “How to reinforce perception of depth in single 2D pictures, -comparative study on various depth cues,” Proceedings of the SID, 1984.]]
[34]
{OHM*04} C. O’Sullivan, S. Howlett, R. McDonnell, Y. Morvan and K. O’Conor, “Perceptually adaptive graphics,” State of the Art Report, Eurographics, 2004.]]
[35]
{PCB05} Y. Pan, I. Cheng and A. Basu, “Quality metric for approximating subjective evaluation of 3D objects,” IEEE Transactions on Multimedia, April, 2005.]]
[36]
{PE02} F. Pereira and T. Ebrahimi, “The MPEG-4 book,” Prentice Hall, 2002.]]
[37]
{PNVSB02} P. Sinha, T. Nandagopal, N. Venkitaraman, R. Sivakumar and V. Bharghavan, “WTCP: A Reliable Transport Protocol for Wireless Wide-Area Networks, Wireless Networks, 2002, 301–316.]]
[38]
{RR01} B. Rogowitz and H. Rushmeier, “Are image quality metrics adequate to evaluate the quality of geometric objects?” In Proc. SPIE, Vol. 4299, 2001.]]
[39]
{RRP00} H. Rushmeier, B. Rogowitz, and C. Piatko, “Perceptual issues in substituting texture for geometry,” Proc. SPIE, vol. 3959, pp. 372–383, 2000.]]
[40]
{SN00} M. Siegel and S. Nagata, “Just Enough Reality: Comfortable 3D Viewing via Micro-Stereopsis,” IEEE Transactions on Circuits and Systems for Video Technology, Vol. 10, No. 3, 387–396, 2000.]]
[41]
{Stei89} C. S. Stein et al., “Psychophysical Rating of Image Compression Techniques,” SPIE, Vol. 1977, pp. 198–208, 1989.]]
[42]
{TH94} P. Teo and D. Heeger, “Perceptual Image Distortion, Human Vision,” Visual Processing, and Digital Display V, SPIE Proceedings, Vol. 2179, pp 127–141, February 1994.]]
[43]
{TK96} J. Torborg and J. T. Kajiya, “Talisman: Commodity realtime 3D graphics for the PC,” SIGGRAPH ’94 Proceedings, pages 353–363, 1996.]]
[44]
{WFM01} B. Watson, A. Friedman and A. McGaffey, “Measuring and predicting visual fidelity,” ACM SIGGRAPH, 213–220. 2001.]]
[45]
{WN02} D. Wu and R. Negi, “Effective Capacity: A Wireless Channel Model for Support of Quality of Service,” IEEE Transactions on Wireless Communications, vol. 2, pp. 630–643, Sept. 2002.]]
[46]
{WZ02} F. Wang and Y. Zhang, “Improving TCP Performance over Mobile Ad-hoc Networks with Out-of-Order Detection and Response,” in Proc. of ACM MOBIHOC, 2002.]]
[47]
{YB94} R. Yavatkar and N. Bhagwat, “Improving End-to-End Performance of TCP over Mobile Internetworks,” in Proc. of Workshop on Mobile Computing Systems and Applications, December 1994, pp, 146–152.]]
