About Me

I am a 3rd year Ph.D. student at UNC Chapel Hill (MURGe-Lab), advised by Prof. Mohit Bansal, and have interned at Adobe Research and Meta Superintelligence Labs, joining Google XR in Dec 2026.

Research Direction

  • Video (Multimodal) Reasoning, Generation, and Understanding, with RL and post-training.
  • Embodied AI with Diverse Sensor Modalities, including gaze, audio, 3D LiDAR, HD maps, and other multimodal signals.

AI that thinks and acts according to what it senses.

How can we expand what AI can sense, and how should its intelligence adapt to what it senses?

drag to rotate ↻

β˜€οΈ πŸ’Š πŸ«– 🍲 πŸͺ΄ β˜• πŸ•ΆοΈ AR glassesπŸ“· egocentric camera 🎧 boiling sound πŸ‘οΈ gaze πŸ§β€β™€οΈ πŸ€– ❓ bottle is hiddenβ†’ not enough evidenceshe keeps looking at the potβ†’ about to pour the waterkettle is boilingβ†’ she may not notice βœ‹moved for a clearer viewβœ‹ touch confirms the right bottle βœ“πŸ”” β€œYour kettle is boiling!”proactive AR alert

The physical world never reveals itself through one modality. Cameras see part of the kitchen; gaze shows where her attention is, audio hears the kettle, LiDAR maps 3D space.

Toggle the sensors to see what each one adds.

The agent fuses this evidence and adapts how it reasons to it, and also recognizes when perception is not enough: the medicine bottle is hidden.

So it acts to get the evidence it needs: it moves for a clearer view, confirms the bottle by touch, and proactively alerts her. Each action reshapes what it perceives next.

News

2026
Oct Will join Google XR as a Student Researcher starting Dec 2026!
Sep StreamGaze is (re)accepted to NeurIPS 2026 πŸ‡¦πŸ‡Ί
Jun VisionCoach is accepted to ECCV 2026 πŸ‡ΈπŸ‡ͺ
May Join Meta Superintelligence Labs for 2026 Summer Research Intern!
Apr VideoRepair is accepted to ACL 2026 Findings 🌊
Mar New preprint is out: check out VisionCoach
Feb StreamGaze is accepted to CVPR 2026 πŸŒ…
2025
Dec New preprint is out: check out StreamGaze and IndustryNav
Aug Video-Skill-CoT is accepted to EMNLP 2025 Findings πŸ‡¨πŸ‡³
Jun New preprint is out: check out Video-Skill-CoT
May Join Adobe Research for 2025 Summer Research Intern!
Jan Invited talk at Cisco
2024
Nov New preprint is out: check out VideoRepair
Aug Started PhD journey at the UNC Chapel Hill MURGe-Lab πŸŽ“
May BECoTTA is accepted to ICML 2024 πŸ‡¦πŸ‡Ή
Apr One paper is accepted to CVPRW 2024 πŸ‡ΊπŸ‡Έ
2023
Jan One paper is oral-presented at WACV 2023 🏝️
2022
Dec I finished my first research internship at NAVER LABS!

Publications

  1. industrynav teaser preprint
    πŸ”Ž Can robots reason about space in dynamic industrial environments?
    Yifan Li, Lichi Li, Anh Dao, Xinyu Zhou, Yicheng Qiao, Zheda Mai, Daeun Lee, Zichen Chen, Zhen Tan, Mohit Bansal, Yu Kong
    preprint
  2. streamgaze teaser NeurIPS
    πŸ”Ž How far current streaming video understanding to AR glasses?
    Daeun Lee, Subhojyoti Mukherjee, Branislav Kveton, Ryan A. Rossi, Viet Dac Lai, Seunghyun Yoon, Trung Bui, Franck Dernoncourt, Mohit Bansal
    The 40th Neural Information Processing Systems, Evaluations and Datasets Track (NeurIPS), 2026.
    Also accepted to CVPR 2026 with strong scores (5/5/5) but desk-rejected after camera-ready because of coauthor's reviewing issue.
  3. visioncoach teaser ECCV
    πŸ”Ž Can grounded video reasoning models self-improve via visual prompting?
    Daeun Lee, Shoubin Yu, Yue Zhang, Mohit Bansal
    European Conference on Computer Vision (ECCV), 2026.
  4. videorepair teaser ACL Findings
    πŸ”Ž Can text-to-video models detect and self-repair their own errors?
    Daeun Lee, Jaehong Yoon, Jaemin Cho, Mohit Bansal
    The 64th Annual Meeting of the Association for Computational Linguistics (ACL) Findings, 2026.
  5. videoskillcot teaser EMNLP Findings
    πŸ”Ž Can skill-based reasoning help video models adapt across domains?
    Daeun Lee*, Jaehong Yoon*, Jaemin Cho, Mohit Bansal
    Empirical Methods in Natural Language Processing (EMNLP) Findings, 2025.
  6. becotta teaser ICML
    πŸ”Ž Let's use mixture-of-domain experts for efficient continual test-time adaptation!
    Daeun Lee*, Jaehong Yoon*, Sung Ju Hwang
    International Conference on Machine Learning (ICML), 2024.
  7. hdmaps teaser CVPRW
    πŸ”Ž Can HD maps teach lane detectors to generalize across domains?
    Daeun Lee, Minhyeok Heo, Jiwon Kim
    CVPR Data-Driven Autonomous Driving Simulation Workshop (CVPRW), 2024.
  8. lidar teaser WACV
    πŸ”Ž How to detect rare objects in LiDAR point clouds?
    Daeun Lee, Jinkyu Kim
    IEEE/CVF Winter Conference on Applications of Computer Vision (WACV), 2023.
  9. colorization teaser ECCV
    πŸ”Ž Can automatic colorization generalize beyond its training domain?
    Hyejin Lee, Daehee Kim, Daeun Lee, Jinkyu Kim, Jaekoo Lee
    European Conference on Computer Vision (ECCV), 2022.

Services

  • Conference Reviewer:
    • CVPR/ECCV/ICCV 2022-2026
    • AAAI 2025
    • NeurIPS 2025-2026
  • Invited Talks:
    • Sep 2025. SKKU (Sungkyunkwan University) Google Developer Groups
    • Jan 2025. Cisco. β€˜Reliable Text-to-Video Generation’

Misc

  • I am a big fan of Sanrio (Hello Kitty, Mymelody, Kuromi), all teddy bears, and K-POP!
  • I know my name Daeun (닀은) can be a little tricky to pronounce! It sounds somewhat like β€œdown” β€” you can hear it here. Or just call me Dana!