“User Interfaces for High-Dimensional Design ProblemsFrom Theories to Implementations” by Koyama, Sato and Igarashi
Conference:
Type:
Entry Number: 11
Title:
- User Interfaces for High-Dimensional Design ProblemsFrom Theories to Implementations
Course Organizer(s):
Presenter(s)/Author(s):
Abstract:
Abstract
We introduce techniques for effectively performing tasks encompassing manipulation or exploration in high-dimensional spaces by the user. Such tasks emerge from applications involving many parameters or high-dimensional latent variables, with examples ranging from image editing, material editing, and shape design, to sound generation, arising in both general design problems and those with generative models from machine learning. Mathematically, such a task can be formulated as an optimization problem, where the user wants to maximize his or her subjective goodness over candidates generated by a model that has way too many control parameters for the user to handle. The solution is to bypass direct manipulation in high-dimensional spaces by extracting much lower-dimensional meaningful subspaces, which in turn give rise to tractable user interfaces. We introduce two core techniques for extracting such subspaces: one based on Bayesian optimization and the other on differential subspace search. Bayesian optimization is useful when only point-sampling is possible for the relation between the goodness and the control parameters (thus, the user can treat the system as a black box), while differential subspace search is useful when differential information is further available for the given model. We introduce both theoretical and implementation aspects of these techniques, and show applications to image editing, material editing, shape design, and sound generation.ng the gap between taking a research neural model to deployment • Understand the challenges in development, training, deployment, and iteration of neural networks for rendering • Show practical use cases, tools, and networks to start your path toward neural rendering in production software
