Sanghyeok Lee

CV

Download CV (PDF)Full publication list

Education

Mar 2016 - Sep 2020

B.S., Computer Science and Engineering

Korea University

  • GPA: 4.02 / 4.50 (94.5 / 100)

Experience

Sep 2026 - Present

Research Scientist

TwelveLabs · Team Pegasus

Sep 2025 - Aug 2026

Postdoctoral Researcher

KAIST · Machine Learning & Vision Lab · Hosted by Hyunwoo J. Kim

Selected projects

  • InnoCORE LLM Innovation Research Center (Sep 2025 - Aug 2026). MSIT-funded fellowship; developed efficient video MLLMs for long-video understanding.
  • Media Content Summarization through Video Understanding (Oct 2025 - Aug 2026). Project lead; funded by KT in collaboration with KT Gen AI Lab, Vision AI Team. Developed an audio-guided video temporal grounding model.
  • Learning Strategies and Data Augmentation to Mitigate Dataset Bias (Sep 2025 - Aug 2026). Funded by ETRI. Developed lightweight video LLMs for egocentric video understanding.
  • Training and Compression of MoE-Based Large Multimodal Models for Tiered and Personalized Services (Sep 2025 - Aug 2026). Funded by Samsung Device Solutions (DS). Developed robust training and model acceleration methods for MoE-based large multimodal models.
Sep 2020 - Aug 2025

Graduate Student Researcher

Korea University · Machine Learning & Vision Lab

Selected projects

  • Media Content Summarization through Video Understanding (Aug 2024 - Jul 2025). Project lead; funded by KT. Developed video temporal grounding and LLM-based end-to-end video summarization models.
  • Blood Image Analysis for Infectious Diseases and Blood Cancers (Jul 2022 - Dec 2024). Project lead; funded by KHIDI. Developed classification and detection models across bright-field, Giemsa-stained, fluorescence, and LAMP-MS assay images.
  • Deep Learning Program for Tooth Axis Identification and Automated Orthodontic Set-Ups (Feb 2020 - Nov 2021). Project lead; funded by TIPA. Developed 3D teeth classification, object detection, and automated alignment systems.
May - Dec 2021

Initial Team Member

Drone Laps

  • Early-stage startup for drone-based autonomous maintenance services.
  • Sponsored by the Korea Ministry of Science and ICT ($70,000).
  • Market research and business model design.

Patents & copyright

P7

Method for Progressive Question Conditioning and Token Focusing and Apparatus for Same

Hyunwoo J. Kim, Minseong Bae, Sanghyeok Lee, Jongha Kim

Korean Patent 10-2025-0210451, filed Dec 26, 2025.

P6

Method, System, and Kit for Nucleic Acid Detection Using Morphological Analysis of Magnesium Pyrophosphate Microparticles

Chaeseung Lim, Woongsik Jang, Minkyeong Choi, Seoyeon Park, Hyunwoo J. Kim, Sanghyeok Lee, Injae Kim

Korean Patent 10-2025-0176226, filed Nov 19, 2025. PCT/KR2025/019390, filed Nov 21, 2025.

C1

EfficientViM (Efficient Vision Mamba for Computer Vision)

Sanghyeok Lee, Joonmyung Choi, Hyunwoo J. Kim

Korean Computer Program Copyright C-2024-055621, registered Dec 26, 2024.

P5

Biosensor for LAMP Product Detection in LAMP Analysis

Chaeseung Lim, Woongsik Jang, Minkyeong Choi, Seoyeon Park, Hyunwoo J. Kim, Sanghyeok Lee, Injae Kim

Korean Patent 10-2024-0168968, filed Nov 22, 2024.

P4

3D Data Augmentation Method Using Weighted Local Transformation and Apparatus Therefor

Hyunwoo J. Kim, Sihyeon Kim, Sanghyeok Lee, Jinyoung Park

Korean Patent 10-2636217, registered Feb 7, 2024. U.S. Patent 18/634,813, filed Apr 12, 2024.

P3

Method for Generating High Quality Video with Professional Filming Techniques through Deep Learning Technology Based 3D Space Modeling and Point-of-View Synthesis

Hyunwoo J. Kim, Sihyeon Kim, Jooyeon Kim, Sanghyeok Lee

Korean Patent 10-2593135, registered Oct 19, 2023.

P2

Method and Apparatus for Read-only Prompt Learning

Hyunwoo J. Kim, Jinyoung Park, Joonmyung Choi, Sanghyeok Lee, Dongjun Lee, Seokwon Song, Jihee Suh

Korean Patent 10-2563550, registered Aug 7, 2023.

P1

Apparatus for Generating Videos with Enhanced Camera Movements through 3D Modeling and View Synthesis Based on Deep Learning Techniques

Hyunwoo J. Kim, Sihyeon Kim, Sanghyeok Lee, Jooyeon Kim

Korean Patent 10-2022-006232, filed May 20, 2022.

Presentations & talks

Mar 2024

Token Reductions for Efficient Vision Transformers

Invited talk · Naver AI Lab, Naver 1784

Feb 2023

3D Point Cloud and Transformer

Invited talk / tutorial · Korean Computer Vision Society Workshop

Honors & awards

  • InnoCORE Postdoctoral Fellowship, MSIT (2025, 2026)
  • Outstanding Paper Award, Korea University (2024)
  • Travel Award, CVPR (2024)
  • Travel Award, NeurIPS (2022)
  • Research Grants, Brain Korea 21 (2021, 2022)
  • Future Research Fellowship, Brain Korea 21 (2021, 2022)
  • Teaching Assistantship, Korea University (2021, 2022)
  • Teaching Fellowship, Korea University (2020)
  • Scholarship, Korea University (2016-2020)

Academic service

Program committee

2024-2026 MICCAI 2nd-4th International Workshop on Foundation Models for General Medical AI (MedAGI)

Reviewer

Conferences

  • CVPR, 2023-Present
  • NeurIPS, 2023-Present
  • ECCV, 2024-Present
  • ICCV, 2025-Present
  • ACL ARR, 2026-Present
  • WACV, 2025-Present
  • ACM MM, 2025-Present

Journals

  • IEEE TPAMI, 2026
  • IEEE TNNLS, 2024
  • IEEE TIP, 2024
  • IEEE TMM, 2024-2025
  • PR, 2025-2026