“Sequential line search for efficient visual design optimization by crowds” by Koyama, Sato, Sakamoto and Igarashi

  • ©Yuki Koyama, Issei Sato, Daisuke Sakamoto, and Takeo Igarashi

Conference:


Type:


Session Title:

    People Power

Title:

    Sequential line search for efficient visual design optimization by crowds

Moderator(s):


Presenter(s)/Author(s):


Abstract:


    Parameter tweaking is a common task in various design scenarios. For example, in color enhancement of photographs, designers tweak multiple parameters such as “brightness” and “contrast” to obtain the best visual impression. Adjusting one parameter is easy; however, if there are multiple correlated parameters, the task becomes much more complex, requiring many trials and a large cognitive load. To address this problem, we present a novel extension of Bayesian optimization techniques, where the system decomposes the entire parameter tweaking task into a sequence of one-dimensional line search queries that are easy for human to perform by manipulating a single slider. In addition, we present a novel concept called crowd-powered visual design optimizer, which queries crowd workers, and provide a working implementation of this concept. Our single-slider manipulation microtask design for crowdsourcing accelerates the convergence of the optimization relative to existing comparison-based microtask designs. We applied our framework to two different design domains: photo color enhancement and material BRDF design, and thereby showed its applicability to various design domains.

References:


    1. Javad Azimi, Alan Fern, and Xiaoli Z. Fern. 2010. Batch Bayesian Optimization via Simulation Matching. In Proc. NIPS ’10. 109–117. http://papers.nips.cc/paper/4083-batch-bayesian-optimization-via-simulation-matching.pdfGoogle Scholar
    2. Michael S. Bernstein, Joel Brandt, Robert C. Miller, and David R. Karger. 2011. Crowds in Two Seconds: Enabling Realtime Crowd-powered Interfaces. In Proc. UIST ’11. 33–42. Google ScholarDigital Library
    3. Ralph Allan Bradley and Milton E. Terry. 1952. Rank Analysis of Incomplete Block Designs: I. The Method of Paired Comparisons. Biometrika 39, 3/4 (1952), 324–345. http://www.jstor.org/stable/2334029 Google ScholarCross Ref
    4. Eric Brochu, Tyson Brochu, and Nando de Freitas. 2010a. A Bayesian Interactive Optimization Approach to Procedural Animation Design. In Proc. SCA ’10. 103–112. Google ScholarCross Ref
    5. Eric Brochu, Vlad M. Cora, and Nando de Freitas. 2010b. A Tutorial on Bayesian Optimization of Expensive Cost Functions, with Application to Active User Modeling and Hierarchical Reinforcement Learning. (2010). arXiv:1012.2599.Google Scholar
    6. Eric Brochu, Nando de Freitas, and Abhijeet Ghosh. 2007. Active Preference Learning with Discrete Choice Data. In Proc. NIPS ’07. 409–416. http://papers.nips.cc/paper/3219-active-preference-learning-with-discrete-choice-data.pdfGoogle Scholar
    7. Vladimir Bychkovsky, Sylvain Paris, Eric Chan, and Frédo Durand. 2011. Learning Photographic Global Tonal Adjustment with a Database of Input/Output Image Pairs. In Proc. CVPR ’11. 97–104. Google ScholarDigital Library
    8. Siddhartha Chaudhuri, Evangelos Kalogerakis, Stephen Giguere, and Thomas Funkhouser. 2013. Attribit: Content Creation with Semantic Attributes. In Proc. UIST ’13. 193–202. Google ScholarDigital Library
    9. Jeff Clune and Hod Lipson. 2011. Evolving 3D Objects with a Generative Encoding Inspired by Developmental Biology. SIGEVOlution 5, 4 (Nov. 2011), 2–12. Google ScholarDigital Library
    10. Thomas Desautels, Andreas Krause, and Joel W. Burdick. 2014. Parallelizing Exploration-Exploitation Tradeoffs in Gaussian Process Bandit Optimization. Journal of Machine Learning Research 15 (2014), 4053–4103. http://jmlr.org/papers/v15/desautels14a.htmlGoogle Scholar
    11. Elena Garces, Aseem Agarwala, Diego Gutierrez, and Aaron Hertzmann. 2014. A Similarity Measure for Illustration Style. ACM Trans. Graph. 33, 4, Article 93 (July 2014), 9 pages. Google ScholarDigital Library
    12. Yotam Gingold, Ariel Shamir, and Daniel Cohen-Or. 2012. Micro Perceptual Human Computation for Visual Tasks. ACM Trans. Graph. 31, 5, Article 119 (Sept. 2012), 12 pages. Google ScholarDigital Library
    13. Yoav HaCohen, Eli Shechtman, Dan B. Goldman, and Dani Lischinski. 2011. Non-rigid Dense Correspondence with Applications for Image Enhancement. ACM Trans. Graph. 30, 4, Article 70 (July 2011), 10 pages. Google ScholarDigital Library
    14. Hiroshi Kajino, Yuta Tsuboi, and Hisashi Kashima. 2013. Clustering Crowds. In Proc. AAAI ’13. 1120–1127. http://dl.acm.org/citation.cfm?id=2891460.2891616Google Scholar
    15. Yuki Koyama, Daisuke Sakamoto, and Takeo Igarashi. 2014. Crowd-powered Parameter Analysis for Visual Design Exploration. In Proc. UIST ’14. 65–74. Google ScholarDigital Library
    16. Yuki Koyama, Daisuke Sakamoto, and Takeo Igarashi. 2016. SelPh: Progressive Learning and Support of Manual Photo Color Enhancement. In Proc. CHI ’16. 2520–2532. Google ScholarDigital Library
    17. Lasse Farnung Laursen, Yuki Koyama, Hsiang-Ting Chen, Elena Garces, Richard Harper Diego Gutierrez, and Takeo Igarashi. 2016. Icon Set Selection via Human Computation. In Proc. Pacific Graphics 2016 – Short Papers. 1–6. Google ScholarCross Ref
    18. Greg Little, Lydia B. Chilton, Max Goldman, and Robert C. Miller. 2010. TurKit: Human Computation Algorithms on Mechanical Turk. In Proc. UIST ’10. 57–66. Google ScholarDigital Library
    19. D. C. Liu and J. Nocedal. 1989. On the Limited Memory BFGS Method for Large Scale Optimization. Math. Program. 45, 3 (Dec. 1989), 503–528. Google ScholarDigital Library
    20. Tianqiang Liu, Aaron Hertzmann, Wilmot Li, and Thomas Funkhouser. 2015. Style Compatibility for 3D Furniture Models. ACM Trans. Graph. 34, 4, Article 85 (July 2015), 9 pages. Google ScholarDigital Library
    21. Zhaoliang Lun, Evangelos Kalogerakis, and Alla Sheffer. 2015. Elements of Style: Learning Perceptual Shape Style Similarity. ACM Trans. Graph. 34, 4, Article 84 (July 2015), 14 pages. Google ScholarDigital Library
    22. J. Marks, B. Andalman, P. A. Beardsley, W. Freeman, S. Gibson, J. Hodgins, T. Kang, B. Mirtich, H. Pfister, W. Ruml, K. Ryall, J. Seims, and S. Shieber. 1997. Design Galleries: A General Approach to Setting Parameters for Computer Graphics and Animation. In Proc. SIGGRAPH ’97. 389–400. Google ScholarDigital Library
    23. Stephen McAuley, Stephen Hill, Naty Hoffman, Yoshiharu Gotanda, Brian Smits, Brent Burley, and Adam Martinez. 2012. Practical Physically-based Shading in Film and Game Production. In ACM SIGGRAPH 2012 Courses. Article 10, 7 pages. Google ScholarDigital Library
    24. Addy Ngan, Frédo Durand, and Wojciech Matusik. 2006. Image-driven Navigation of Analytical BRDF Models. In Proc. EGSR ’06. 399–407. Google ScholarDigital Library
    25. Peter O’Donovan, Aseem Agarwala, and Aaron Hertzmann. 2011. Color Compatibility from Large Datasets. ACM Trans. Graph. 30, 4, Article 63 (July 2011), 12 pages. Google ScholarDigital Library
    26. Peter O’Donovan, Jānis Lībeks, Aseem Agarwala, and Aaron Hertzmann. 2014. Exploratory Font Selection Using Crowdsourced Attributes. ACM Trans. Graph. 33, 4, Article 92 (July 2014), 9 pages. Google ScholarDigital Library
    27. Alexander J. Quinn and Benjamin B. Bederson. 2011. Human Computation: A Survey and Taxonomy of a Growing Field. In Proc. CHI ’11. 1403–1412. Google ScholarDigital Library
    28. Katharina Reinecke and Krzysztof Z. Gajos. 2014. Quantifying Visual Preferences Around the World. In Proc. CHI ’14. 11–20. Google ScholarDigital Library
    29. Matthias Schonlau, William J. Welch, and Donald R. Jones. 1998. Global versus local search in constrained optimization of computer models. Lecture Notes-Monograph Series, Vol. 34. Institute of Mathematical Statistics, Hayward, CA, 11–25. Google ScholarCross Ref
    30. Adrian Secord, Jingwan Lu, Adam Finkelstein, Manish Singh, and Andrew Nealen. 2011. Perceptual Models of Viewpoint Preference. ACM Trans. Graph. 30, 5, Article 109 (Oct. 2011), 12 pages. Google ScholarDigital Library
    31. Ana Serrano, Diego Gutierrez, Karol Myszkowski, Hans-Peter Seidel, and Belen Masia. 2016. An Intuitive Control Space for Material Appearance. ACM Trans. Graph. 35, 6, Article 186 (Nov. 2016), 12 pages. Google ScholarDigital Library
    32. Bobak Shahriari, Kevin Swersky, Ziyu Wang, Ryan P. Adams, and Nando de Freitas. 2016. Taking the Human Out of the Loop: A Review of Bayesian Optimization. Proc. IEEE 104, 1 (Jan. 2016), 148–175. Google ScholarCross Ref
    33. Gaurav Sharma, Wencheng Wu, and Edul N. Dalal. 2005. The CIEDE2000 color-difference formula: Implementation notes, supplementary test data, and mathematical observations. Color Research & Application 30, 1 (2005), 21–30. Google ScholarCross Ref
    34. Karl Sims. 1991. Artificial Evolution for Computer Graphics. SIGGRAPH Comput. Graph. 25, 4 (July 1991), 319–328. Google ScholarDigital Library
    35. Jasper Snoek, Hugo Larochelle, and Ryan P Adams. 2012. Practical Bayesian Optimization of Machine Learning Algorithms. In Proc. NIPS ’12. 2951–2959. http://papers.nips.cc/paper/4522-practical-bayesian-optimization-of-machine-learning-algorithms.pdfGoogle Scholar
    36. Stephan Streuber, M. Alejandra Quiros-Ramirez, Matthew Q. Hill, Carina A. Hahn, Silvia Zuffi, Alice O’Toole, and Michael J. Black. 2016. Body Talk: Crowdshaping Realistic 3D Avatars with Words. ACM Trans. Graph. 35, 4, Article 54 (July 2016), 14 pages. Google ScholarDigital Library
    37. Kristi Tsukida and Maya R. Gupta. 2011. How to Analyze Paired Comparison Data. Technical Report. University of Washington. https://www2.ee.washington.edu/techsite/papers/refer/UWEETR-2011-0004.htmlGoogle Scholar
    38. Luis Von Ahn. 2005. Human Computation. Ph.D. Dissertation. Carnegie Mellon University, Pittsburgh, PA, USA. Advisor(s) Blum, Manuel. http://reports-archive.adm.cs.cmu.edu/anon/2005/abstracts/05-193.htmlGoogle Scholar
    39. Michael J. Wilber, Iljung S. Kwak, and Serge J. Belongie. 2014. Cost-Effective HITs for Relative Similarity Comparisons. In Proc. HCOMP ’14. http://www.aaai.org/ocs/index.php/HCOMP/HCOMP14/paper/view/8954Google Scholar
    40. Lixiu Yu and Jeffrey V. Nickerson. 2011. Cooks or Cobblers?: Crowd Creativity Through Combination. In Proc. CHI ’11. 1393–1402. Google ScholarDigital Library
    41. Mehmet Ersin Yumer, Siddhartha Chaudhuri, Jessica K. Hodgins, and Levent Burak Kara. 2015. Semantic Shape Editing Using Deformation Handles. ACM Trans. Graph. 34, 4, Article 86 (July 2015), 12 pages. Google ScholarDigital Library
    42. Jun-Yan Zhu, Aseem Agarwala, Alexei A. Efros, Eli Shechtman, and Jue Wang. 2014. Mirror Mirror: Crowdsourcing Better Portraits. ACM Trans. Graph. 33, 6, Article 234 (Nov. 2014), 12 pages. Google ScholarDigital Library

ACM Digital Library Publication: