Lee Hyun

hyunlee@postech.ac.kr

I am an AI researcher at Samsung Advanced Institute of Technology (SAIT). I received an M.S. in EE from POSTECH advised by Prof. Tae-Hyun Oh.

My primary research focuses on generative models with multimodal LLM, spanning areas such as music generation, video reasoning, and speech-to-3D talking head generation.
Recently, I have been expanding my expertise toward LLM agents for materials discovery, focusing on LLM post-training and on how to build a reasoning trace from the materials design space to the target property space—and vice versa.

Publications

Aligning Reasoning LLMs for Materials Discovery with Physics-aware Rejection Sampling
Lee Hyun, Sohee Yoon, Jinwoo Park, Sue In Chae, Seongeon Park, Jooyeon Ahn, Yebin Jung, Youjung Chung, Hogeun Chang, Myeonginn Kang, Jina Kim, Ho-Gyeong Kim, Myeonghun Jeong  |  Preprint 2025
VLM’s Eye Examination: Instruct and Inspect Visual Competency of Vision Language Models
Nam Hyeon-Woo, Moon Ye-Bin, Wonseok Choi, Lee Hyun, Tae-Hyun Oh  |  Transactions on Machine Learning Research (TMLR) 2025
A Large-Scale 3D Face Mesh Video Dataset Via Neural Re-Parameterized Optimization
Kim Youwang, Lee Hyun*, Kim Sung-Bin*, Suekyeong Nam, Janghoon Joo, Tae-Hyun Oh  |  ICLR 2025 (Invited from TMLR)
SMILE: Multimodal Dataset for Understanding Laughter in Video with Language Models
Lee Hyun*, Kim Sung-Bin*, Seungju Han, Youngjae Yu, Tae-Hyun Oh  |  NAACL 2024
LaughTalk: Expressing 3D Talking Head Generation with Laughter
Kim Sung-Bin, Lee Hyun, Dahye Hong, Suekyeong Nam, Janghoon Ju, Tae-Hyun Oh  |  WACV 2024
Multimodal Laughter Reasoning with Textual Audio-Visual Representation
Lee Hyun, Kim Sung-Bin, Suengju Han, Youngjae Yu, Tae-Hyun Oh  |  AV4D workshop @ ICCV 2023
ComMU: Dataset for Combinatorial Music Generation
Lee Hyun, Teahyun Kim, Hyolim Kang, Minjoo Ki, Hyeonchan Hwang,.., SeonJoo Kim  |  NeurIPS 2022

Work Experiences

  • AI Researcher, SAIT, 3.2024 - present
  • Graduate Researcher, POSTECH AMI lab, 2.2022 - 1.2024
  • Machine Learning Engineer, POZAlabs, 2.2021 - 1.2022
  • Military Service, discharged as sergeant, Vanguard Unit, Republic of Korea Army, 3.2017 - 12.2018

Academic Services

  • Conference Reviewer: CVPR, ICLR, NeurIPS, ACL