“Sequential line search for efficient visual design optimization by crowds” by Koyama, Sato, Sakamoto and Igarashi
Conference:
Type:
Title:
- Sequential line search for efficient visual design optimization by crowds
Session/Category Title: People Power
Presenter(s)/Author(s):
Moderator(s):
Abstract:
Parameter tweaking is a common task in various design scenarios. For example, in color enhancement of photographs, designers tweak multiple parameters such as “brightness” and “contrast” to obtain the best visual impression. Adjusting one parameter is easy; however, if there are multiple correlated parameters, the task becomes much more complex, requiring many trials and a large cognitive load. To address this problem, we present a novel extension of Bayesian optimization techniques, where the system decomposes the entire parameter tweaking task into a sequence of one-dimensional line search queries that are easy for human to perform by manipulating a single slider. In addition, we present a novel concept called crowd-powered visual design optimizer, which queries crowd workers, and provide a working implementation of this concept. Our single-slider manipulation microtask design for crowdsourcing accelerates the convergence of the optimization relative to existing comparison-based microtask designs. We applied our framework to two different design domains: photo color enhancement and material BRDF design, and thereby showed its applicability to various design domains.
References:
1. Javad Azimi, Alan Fern, and Xiaoli Z. Fern. 2010. Batch Bayesian Optimization via Simulation Matching. In Proc. NIPS ’10. 109–117. http://papers.nips.cc/paper/4083-batch-bayesian-optimization-via-simulation-matching.pdfGoogle Scholar
2. Michael S. Bernstein, Joel Brandt, Robert C. Miller, and David R. Karger. 2011. Crowds in Two Seconds: Enabling Realtime Crowd-powered Interfaces. In Proc. UIST ’11. 33–42. Google ScholarDigital Library
3. Ralph Allan Bradley and Milton E. Terry. 1952. Rank Analysis of Incomplete Block Designs: I. The Method of Paired Comparisons. Biometrika 39, 3/4 (1952), 324–345. http://www.jstor.org/stable/2334029 Google ScholarCross Ref
4. Eric Brochu, Tyson Brochu, and Nando de Freitas. 2010a. A Bayesian Interactive Optimization Approach to Procedural Animation Design. In Proc. SCA ’10. 103–112. Google ScholarCross Ref
5. Eric Brochu, Vlad M. Cora, and Nando de Freitas. 2010b. A Tutorial on Bayesian Optimization of Expensive Cost Functions, with Application to Active User Modeling and Hierarchical Reinforcement Learning. (2010). arXiv:1012.2599.Google Scholar
6. Eric Brochu, Nando de Freitas, and Abhijeet Ghosh. 2007. Active Preference Learning with Discrete Choice Data. In Proc. NIPS ’07. 409–416. http://papers.nips.cc/paper/3219-active-preference-learning-with-discrete-choice-data.pdfGoogle Scholar
7. Vladimir Bychkovsky, Sylvain Paris, Eric Chan, and Frédo Durand. 2011. Learning Photographic Global Tonal Adjustment with a Database of Input/Output Image Pairs. In Proc. CVPR ’11. 97–104. Google ScholarDigital Library
8. Siddhartha Chaudhuri, Evangelos Kalogerakis, Stephen Giguere, and Thomas Funkhouser. 2013. Attribit: Content Creation with Semantic Attributes. In Proc. UIST ’13. 193–202. Google ScholarDigital Library
9. Jeff Clune and Hod Lipson. 2011. Evolving 3D Objects with a Generative Encoding Inspired by Developmental Biology. SIGEVOlution 5, 4 (Nov. 2011), 2–12. Google ScholarDigital Library
10. Thomas Desautels, Andreas Krause, and Joel W. Burdick. 2014. Parallelizing Exploration-Exploitation Tradeoffs in Gaussian Process Bandit Optimization. Journal of Machine Learning Research 15 (2014), 4053–4103. http://jmlr.org/papers/v15/desautels14a.htmlGoogle Scholar
11. Elena Garces, Aseem Agarwala, Diego Gutierrez, and Aaron Hertzmann. 2014. A Similarity Measure for Illustration Style. ACM Trans. Graph. 33, 4, Article 93 (July 2014), 9 pages. Google ScholarDigital Library
12. Yotam Gingold, Ariel Shamir, and Daniel Cohen-Or. 2012. Micro Perceptual Human Computation for Visual Tasks. ACM Trans. Graph. 31, 5, Article 119 (Sept. 2012), 12 pages. Google ScholarDigital Library
13. Yoav HaCohen, Eli Shechtman, Dan B. Goldman, and Dani Lischinski. 2011. Non-rigid Dense Correspondence with Applications for Image Enhancement. ACM Trans. Graph. 30, 4, Article 70 (July 2011), 10 pages. Google ScholarDigital Library
14. Hiroshi Kajino, Yuta Tsuboi, and Hisashi Kashima. 2013. Clustering Crowds. In Proc. AAAI ’13. 1120–1127. http://dl.acm.org/citation.cfm?id=2891460.2891616Google Scholar
15. Yuki Koyama, Daisuke Sakamoto, and Takeo Igarashi. 2014. Crowd-powered Parameter Analysis for Visual Design Exploration. In Proc. UIST ’14. 65–74. Google ScholarDigital Library
16. Yuki Koyama, Daisuke Sakamoto, and Takeo Igarashi. 2016. SelPh: Progressive Learning and Support of Manual Photo Color Enhancement. In Proc. CHI ’16. 2520–2532. Google ScholarDigital Library
17. Lasse Farnung Laursen, Yuki Koyama, Hsiang-Ting Chen, Elena Garces, Richard Harper Diego Gutierrez, and Takeo Igarashi. 2016. Icon Set Selection via Human Computation. In Proc. Pacific Graphics 2016 – Short Papers. 1–6. Google ScholarCross Ref
18. Greg Little, Lydia B. Chilton, Max Goldman, and Robert C. Miller. 2010. TurKit: Human Computation Algorithms on Mechanical Turk. In Proc. UIST ’10. 57–66. Google ScholarDigital Library
19. D. C. Liu and J. Nocedal. 1989. On the Limited Memory BFGS Method for Large Scale Optimization. Math. Program. 45, 3 (Dec. 1989), 503–528. Google ScholarDigital Library
20. Tianqiang Liu, Aaron Hertzmann, Wilmot Li, and Thomas Funkhouser. 2015. Style Compatibility for 3D Furniture Models. ACM Trans. Graph. 34, 4, Article 85 (July 2015), 9 pages. Google ScholarDigital Library
21. Zhaoliang Lun, Evangelos Kalogerakis, and Alla Sheffer. 2015. Elements of Style: Learning Perceptual Shape Style Similarity. ACM Trans. Graph. 34, 4, Article 84 (July 2015), 14 pages. Google ScholarDigital Library
22. J. Marks, B. Andalman, P. A. Beardsley, W. Freeman, S. Gibson, J. Hodgins, T. Kang, B. Mirtich, H. Pfister, W. Ruml, K. Ryall, J. Seims, and S. Shieber. 1997. Design Galleries: A General Approach to Setting Parameters for Computer Graphics and Animation. In Proc. SIGGRAPH ’97. 389–400. Google ScholarDigital Library
23. Stephen McAuley, Stephen Hill, Naty Hoffman, Yoshiharu Gotanda, Brian Smits, Brent Burley, and Adam Martinez. 2012. Practical Physically-based Shading in Film and Game Production. In ACM SIGGRAPH 2012 Courses. Article 10, 7 pages. Google ScholarDigital Library
24. Addy Ngan, Frédo Durand, and Wojciech Matusik. 2006. Image-driven Navigation of Analytical BRDF Models. In Proc. EGSR ’06. 399–407. Google ScholarDigital Library
25. Peter O’Donovan, Aseem Agarwala, and Aaron Hertzmann. 2011. Color Compatibility from Large Datasets. ACM Trans. Graph. 30, 4, Article 63 (July 2011), 12 pages. Google ScholarDigital Library
26. Peter O’Donovan, Jānis Lībeks, Aseem Agarwala, and Aaron Hertzmann. 2014. Exploratory Font Selection Using Crowdsourced Attributes. ACM Trans. Graph. 33, 4, Article 92 (July 2014), 9 pages. Google ScholarDigital Library
27. Alexander J. Quinn and Benjamin B. Bederson. 2011. Human Computation: A Survey and Taxonomy of a Growing Field. In Proc. CHI ’11. 1403–1412. Google ScholarDigital Library
28. Katharina Reinecke and Krzysztof Z. Gajos. 2014. Quantifying Visual Preferences Around the World. In Proc. CHI ’14. 11–20. Google ScholarDigital Library
29. Matthias Schonlau, William J. Welch, and Donald R. Jones. 1998. Global versus local search in constrained optimization of computer models. Lecture Notes-Monograph Series, Vol. 34. Institute of Mathematical Statistics, Hayward, CA, 11–25. Google ScholarCross Ref
30. Adrian Secord, Jingwan Lu, Adam Finkelstein, Manish Singh, and Andrew Nealen. 2011. Perceptual Models of Viewpoint Preference. ACM Trans. Graph. 30, 5, Article 109 (Oct. 2011), 12 pages. Google ScholarDigital Library
31. Ana Serrano, Diego Gutierrez, Karol Myszkowski, Hans-Peter Seidel, and Belen Masia. 2016. An Intuitive Control Space for Material Appearance. ACM Trans. Graph. 35, 6, Article 186 (Nov. 2016), 12 pages. Google ScholarDigital Library
32. Bobak Shahriari, Kevin Swersky, Ziyu Wang, Ryan P. Adams, and Nando de Freitas. 2016. Taking the Human Out of the Loop: A Review of Bayesian Optimization. Proc. IEEE 104, 1 (Jan. 2016), 148–175. Google ScholarCross Ref
33. Gaurav Sharma, Wencheng Wu, and Edul N. Dalal. 2005. The CIEDE2000 color-difference formula: Implementation notes, supplementary test data, and mathematical observations. Color Research & Application 30, 1 (2005), 21–30. Google ScholarCross Ref
34. Karl Sims. 1991. Artificial Evolution for Computer Graphics. SIGGRAPH Comput. Graph. 25, 4 (July 1991), 319–328. Google ScholarDigital Library
35. Jasper Snoek, Hugo Larochelle, and Ryan P Adams. 2012. Practical Bayesian Optimization of Machine Learning Algorithms. In Proc. NIPS ’12. 2951–2959. http://papers.nips.cc/paper/4522-practical-bayesian-optimization-of-machine-learning-algorithms.pdfGoogle Scholar
36. Stephan Streuber, M. Alejandra Quiros-Ramirez, Matthew Q. Hill, Carina A. Hahn, Silvia Zuffi, Alice O’Toole, and Michael J. Black. 2016. Body Talk: Crowdshaping Realistic 3D Avatars with Words. ACM Trans. Graph. 35, 4, Article 54 (July 2016), 14 pages. Google ScholarDigital Library
37. Kristi Tsukida and Maya R. Gupta. 2011. How to Analyze Paired Comparison Data. Technical Report. University of Washington. https://www2.ee.washington.edu/techsite/papers/refer/UWEETR-2011-0004.htmlGoogle Scholar
38. Luis Von Ahn. 2005. Human Computation. Ph.D. Dissertation. Carnegie Mellon University, Pittsburgh, PA, USA. Advisor(s) Blum, Manuel. http://reports-archive.adm.cs.cmu.edu/anon/2005/abstracts/05-193.htmlGoogle Scholar
39. Michael J. Wilber, Iljung S. Kwak, and Serge J. Belongie. 2014. Cost-Effective HITs for Relative Similarity Comparisons. In Proc. HCOMP ’14. http://www.aaai.org/ocs/index.php/HCOMP/HCOMP14/paper/view/8954Google Scholar
40. Lixiu Yu and Jeffrey V. Nickerson. 2011. Cooks or Cobblers?: Crowd Creativity Through Combination. In Proc. CHI ’11. 1393–1402. Google ScholarDigital Library
41. Mehmet Ersin Yumer, Siddhartha Chaudhuri, Jessica K. Hodgins, and Levent Burak Kara. 2015. Semantic Shape Editing Using Deformation Handles. ACM Trans. Graph. 34, 4, Article 86 (July 2015), 12 pages. Google ScholarDigital Library
42. Jun-Yan Zhu, Aseem Agarwala, Alexei A. Efros, Eli Shechtman, and Jue Wang. 2014. Mirror Mirror: Crowdsourcing Better Portraits. ACM Trans. Graph. 33, 6, Article 234 (Nov. 2014), 12 pages. Google ScholarDigital Library
