I am a Postdoctoral Researcher at the Stanford Institute for Human-Centered AI, working with Sean Follmer and Hari Subramonyam. I received my Ph.D. from the Human-Computer Interaction Institute in Carnegie Mellon University's School of Computer Science, advised by Nik Martelaro. My research has been supported by Google, Toyota Research Institute, Adobe Research, Accenture Labs, NSF, and the Office of Naval Research.

My research designs interactive systems and models that make generative AI steerable. Today, people mostly steer AI with text prompts, describing what they want without seeing the range of what is possible. Instead, I build AI steering interfaces that turn a model's internal representations, such as its latent space and learned concepts, into controls people can see, explore, and directly manipulate. I study this through the lens of design, where goals are often ill-defined, take shape through exploration, and are hard to put into words.

Several questions I am exploring include:

  • Latent Manipulation. What would direct manipulation look like for the latent spaces of AI models, and can the same operations generalize across different models and modalities?
  • Steerable Models. How can we train models whose internal representations align with the abstractions people already use to think and create?
  • Generative User Interfaces. When AI can generate interfaces in real time, how should they adapt to people's tasks, goals, and expertise?
  • Steering Agents. When people delegate tasks to AI agents, how can they verify the agents' work, and when should agents surface decision points for human judgment?

Publications

GENErator

GENErator: Supporting Design Style Exploration with Generative AI through Genetic Mixing

David Chuan-En Lin, Yaqing Yang, Vikram Mohanty, Matthew K. Hong, Yan-Ying Chen, Aniket Kittur, Nikolas Martelaro

GENErator lets designers explore combinations of AI image styles by mixing them like genes.

Generative User Interfaces

Generative User Interfaces: A Definition and Design Space

Katja Pott, Eunhye Kim, Chenyang Wang, Thiemo Wambsganss, Juho Kim, …, David Chuan-En Lin, … (51 authors)

Generative User Interfaces defines GenUI and maps how systems vary across user, task, interaction, and technology.

Tracing Creativity

Tracing Creativity: A Design Space For Creative Activity Traces in HCI

Noor Hammad, David Chuan-En Lin, Amy Smith, Max Kreminski, Erik Harpstead, Jessica Hammer

ACM Conference on Human Factors in Computing Systems (CHI), 2026

Tracing Creativity reviews 133 creativity systems to map how traces of creative activity are captured and used.

Visual Lyrics: Generating Animated Text for Music Lyric Videos with an Augmented Text Editor

David Chuan-En Lin, Cuong Nguyen, Hijung Valentina Shin, Nikolas Martelaro

ACM Conference on Intelligent User Interfaces (IUI), 2026

Visual Lyrics generates animated text for music lyric videos, combining music analysis and LLM-generated animation code in an augmented text editor.

Gen4Gen: Generative Data Pipeline for Generative Multi-Concept Composition

Chun-Hsiao Yeh*, Ta-Ying Cheng*, He-Yen Hsieh*, David Chuan-En Lin, Yi Ma, Andrew Markham, Niki Trigoni, H. T. Kung, Yubei Chen(* = equal contribution)

British Machine Vision Conference (BMVC), 2025

Gen4Gen builds a dataset and benchmark for personalizing text-to-image diffusion models with several concepts at once.

Inkspire: Supporting Design Exploration with Generative AI through Analogical Sketching

David Chuan-En Lin, Hyeonsu B. Kang, Nikolas Martelaro, Aniket Kittur, Yan-Ying Chen, Matthew K. Hong

ACM Conference on Human Factors in Computing Systems (CHI), 2025

Inkspire helps product designers explore ideas by sketching with AI, using analogies for inspiration and AI designs turned back into sketches.

Biospark

BioSpark: Beyond Analogical Inspiration to LLM-augmented Transfer

Hyeonsu B. Kang, David Chuan-En Lin, Yan-Ying Chen, Matthew K. Hong, Nikolas Martelaro, Aniket Kittur

ACM Conference on Human Factors in Computing Systems (CHI), 2025

BioSpark helps designers find inspiration in biology and transfer it to their own design problems.

NoTeeline

NoTeeline: Supporting Real-Time, Personalized Notetaking with LLM-Enhanced Micronotes

Faria Huq, Abdus Samee, David Chuan-En Lin, Alice Xiaodi Tang, Jeffrey P. Bigham

ACM Conference on Intelligent User Interfaces (IUI), 2025

NoTeeline lets people write quick keypoints while watching educational videos, then expands them into full notes.

VideoMap: Supporting Video Exploration, Brainstorming, and Prototyping in the Latent Space

David Chuan-En Lin, Fabian Caba Heilbron, Joon-Young Lee, Oliver Wang, Nikolas Martelaro

ACM Creativity and Cognition (C&C), 2024

NeurIPS Machine Learning for Creativity and Design, 2022

VideoMap helps video editors organize footage, find transitions, and prototype rough cuts by exploring video frames on a visual map.

Videogenic: Identifying Highlight Moments in Videos with Professional Photographs as a Prior

David Chuan-En Lin, Fabian Caba Heilbron, Joon-Young Lee, Oliver Wang, Nikolas Martelaro

ACM Creativity and Cognition (C&C), 2024

NeurIPS Machine Learning for Creativity and Design, 2022

Videogenic finds highlight moments in videos by learning from professional photographs.

Jigsaw: Supporting Designers to Prototype Multimodal Applications by Chaining AI Foundation Models

David Chuan-En Lin, Nikolas Martelaro

ACM Conference on Human Factors in Computing Systems (CHI), 2024

Jigsaw lets designers build AI workflows by snapping together models for different tasks and media like puzzle pieces.

Soundify: Matching Sound Effects to Video

David Chuan-En Lin, Anastasis Germanidis, Cristóbal Valenzuela, Yining Shi, Nikolas Martelaro

ACM Symposium on User Interface Software and Technology (UIST), 2023

NeurIPS Machine Learning for Creativity and Design, 2021

Soundify matches sound effects to video, synchronizes them with the action, and adjusts panning and volume to create spatial audio.

Learning Personal Style from Few Examples

David Chuan-En Lin, Nikolas Martelaro

ACM Conference on Designing Interactive Systems (DIS), 2021

PseudoClient learns personal graphic design preferences from a handful of examples to help designers understand a client’s visual style.

SeqDynamics: Visual Analytics for Evaluating Online Problem-solving Dynamics

Meng Xia, Min Xu, Chuan-En Lin, Ta Ying Cheng, Huamin Qu, Xiaojuan Ma

Eurographics Conference on Visualization (EuroVis), 2020

SeqDynamics helps instructors see how students solve problems over time through interactive visual analytics.

ARchitect: Building Interactive Virtual Experiences from Physical Affordances by Bringing Human-in-the-Loop

Chuan-En Lin*, Ta Ying Cheng*, Xiaojuan Ma(* = equal contribution)

ACM Conference on Human Factors in Computing Systems (CHI), 2020

ARchitect lets an assistant map physical objects to virtual ones in augmented reality, so a VR player can interact with their real surroundings.

Learning to Film from Professional Human Motion Videos

Chong Huang, Chuan-En Lin, Zhenyu Yang, Yan Kong, Peng Chen, Xin Yang, Kwang-Ting Cheng

IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2019

Learning to Film teaches a drone to film automatically by learning from cinematic drone videos shot by professionals.