Victor Shea-Jay Huang

Do the right thing, the right way, right now.

Hi, I'm Victor Shea-Jay Huang. I will join the Multimedia Laboratory at the Chinese University of Hong Kong in Fall 2026, supervised by Prof. Hongsheng Li. My work spans Multimodal Generative AI, Foundation Models, Reinforcement Learning, Physical AI, and Trustworthy AI.

Multimodal Generative AI Foundation Models Reinforcement Learning Physical AI Trustworthy AI

Selected work Blog Contact

Timeline / News

Fall 2026

CUHK

Incoming Ph.D. student at MMLab, CUHK

Joining the Multimedia Laboratory, supervised by Prof. Hongsheng Li.

May 2026

Research release

Mind-Omni series released

Physical intelligence series spanning MindVLA-U1, Streaming Intent, DIAL, MindSim, and MindLabel. Project hub.

Apr. 2026

ACL 2026

Three papers accepted to ACL 2026

Nov. 2025

AAAI 2026

TIDE accepted to AAAI 2026

Jun. 2025

ACM MM 2025 / ISMIR 2025

JPS and Vision-to-Music Generation: A Survey accepted

Apr. 2025

Open source

Lumina-mGPT-2.0 repo released

Open-source Multimodal Generative AI project.

Mar. 2025

Open source

Awesome Vision-to-Music repo released

Feb. 2025

CVPR 2025

Beyond Sight and Scaling Laws for Video DiT accepted

Jan. 2025

Open source

AISafetyLab repo released

Open-source AI safety evaluation and improvement framework.

Dec. 2024

Award

AAAI-25 Student Scholarship

Dec. 2024

AAAI 2025

Medical MLLM is Vulnerable and AGFSync accepted

Research Timeline

2026 May Build Mind-Omni Physical AI series

2026 May Blog VLA / WAM Digest Reading list

2026 May Blog MindRL Interface Reward as interface

2026 Jan Blog Why the Blog Public notebook

2025 Apr Build Lumina-mGPT Unified generation

2025 Jan Build AISafetyLab Safety evaluation

Publications

10 selected publications from the current homepage.

arXiv

Driving Intents Amplify Planning-Oriented Reinforcement Learning

Hengtong Lu*, Victor Shea-Jay Huang*, Chengmin Yang, Pengfei Jing, Jifeng Dai, Yan Xie, Benjin Zhu*

arXiv Preprint

PDF arXiv Preprint

arXiv

Action Emergence from Streaming Intent

Pengfei Jing*, Victor Shea-Jay Huang, Hengtong Lu, Jifeng Dai, Yan Xie, Benjin Zhu*

arXiv Preprint

PDF arXiv Preprint

AAAI

TIDE : Temporal-Aware Sparse Autoencoders for Interpretable Diffusion Transformers in Image Generation

Victor Shea-Jay Huang, Le Zhuo, Yi Xin, Zhaokai Wang, Fu-Yun Wang, Yuchi Wang, Renrui Zhang, Peng Gao, Hongsheng Li

AAAI 2026

PDF arXiv BibTex Published

AAAI

Medical MLLM is Vulnerable: Cross-Modality Jailbreak and Mismatched Attacks on Medical Multimodal Large Language Models

Victor Shea-Jay Huang, Xinyuan Wang, Hantao Zhang, Yinghao Zhu, Jiawen Xi, Jingkun An, Hao Wang, Hao Liang, Chengwei Pan

AAAI 2025

PDF arXiv Code Stars BibTex Published

ICML

BlackDAN: A Black-Box Multi-Objective Approach for Effective and Contextual Jailbreaking of Large Language Models

Victor Shea-Jay Huang*, Xinyuan Wang*, Renmiao Chen, Hao Wang, Chengwei Pan, Lei Sha, Minlie Huang

ICML 2025 NewInML Workshop

PDF arXiv Code Stars BibTex Published

arXiv

AISafetyLab: A Comprehensive Framework for AI Safety Evaluation and Improvement

Zhexin Zhang*, Leqi Lei*, Junxiao Yang*, Victor Shea-Jay Huang*, Yida Lu, Shiyao Cui, Renmiao Chen, Qinglin Zhang, Xinyuan Wang, Hao Wang, Hao Li, Xianqi Lei, Chengwei Pan, Lei Sha, Hongning Wang, Minlie Huang

arXiv Preprint

PDF arXiv Code Stars Preprint

arXiv

MindVLA-U1: VLA Beats VA with Unified Streaming Architecture for Autonomous Driving

Yuzhou Huang*, Benjin Zhu*, Hengtong Lu, Victor Shea-Jay Huang, Haiming Zhang, Wei Chen, Jifeng Dai, Yan Xie, Hongsheng Li

arXiv Preprint

PDF arXiv Preprint

ACL

How Should We Enhance the Safety of Large Reasoning Models: An Empirical Study

Zhexin Zhang*, Xian Qi Loye*, Victor Shea-Jay Huang, Junxiao Yang, Qi Zhu, Shiyao Cui, Fei Mi, Lifeng Shang, Yingkang Wang, Hongning Wang, Minlie Huang

ACL 2026

PDF arXiv Code Stars Published

CVPR

Beyond Sight: Towards Cognitive Alignment in LVLM via Enriched Visual Knowledge

Yaqi Zhao, Yuanyang Yin, Lin Li, Mingan Lin, Victor Shea-Jay Huang, Siwei Chen, Weipeng Chen, Baoqun Yin, Zenan Zhou, Wentao Zhang

CVPR 2025

PDF arXiv BibTex Published.

CVPR

Towards Precise Scaling Laws for Video Diffusion Transformers

Yuanyang Yin, Yaqi Zhao, Mingwu Zheng, Ke Lin, Jiarong Ou, Rui Chen, Victor Shea-Jay Huang, Jiahao Wang, Xin Tao, Pengfei Wan, Di ZHANG, Baoqun Yin, Wentao Zhang, Kun Gai

CVPR 2025

PDF arXiv BibTex Published.

AAAI

TIDE : Temporal-Aware Sparse Autoencoders for Interpretable Diffusion Transformers in Image Generation

Victor Shea-Jay Huang, Le Zhuo, Yi Xin, Zhaokai Wang, Fu-Yun Wang, Yuchi Wang, Renrui Zhang, Peng Gao, Hongsheng Li

AAAI 2026

PDF arXiv BibTex Published

AAAI

Medical MLLM is Vulnerable: Cross-Modality Jailbreak and Mismatched Attacks on Medical Multimodal Large Language Models

Victor Shea-Jay Huang, Xinyuan Wang, Hantao Zhang, Yinghao Zhu, Jiawen Xi, Jingkun An, Hao Wang, Hao Liang, Chengwei Pan

AAAI 2025

PDF arXiv Code Stars BibTex Published

CVPR

Beyond Sight: Towards Cognitive Alignment in LVLM via Enriched Visual Knowledge

Yaqi Zhao, Yuanyang Yin, Lin Li, Mingan Lin, Victor Shea-Jay Huang, Siwei Chen, Weipeng Chen, Baoqun Yin, Zenan Zhou, Wentao Zhang

CVPR 2025

PDF arXiv BibTex Published.

CVPR

Towards Precise Scaling Laws for Video Diffusion Transformers

Yuanyang Yin, Yaqi Zhao, Mingwu Zheng, Ke Lin, Jiarong Ou, Rui Chen, Victor Shea-Jay Huang, Jiahao Wang, Xin Tao, Pengfei Wan, Di ZHANG, Baoqun Yin, Wentao Zhang, Kun Gai

CVPR 2025

PDF arXiv BibTex Published.

AAAI

AGFSync: Leveraging AI Feedback for Preference Optimization in Text-to-Image Generation

Jingkun An, Yinghao Zhu, Zongjian Li, Haoran Feng, Victor Shea-Jay Huang, Bohua Chen,Yemin Shi, Chengwei Pan

AAAI 2025

PDF arXiv BibTex Published

Arxiv

Document Parsing Unveiled: Techniques, Challenges, and Prospects for Structured Information Extraction

Qintong Zhang*, Victor Shea-Jay Huang*, Bin Wang, Junyuan Zhang, Zhengren Wang, Hao Liang, Shawn Wang, Matthieu Lin, Conghui He, Wentao Zhang

Arxiv Preprint

PDF arXiv BibTex Preprint

Arxiv

Vision-to-Music Generation: A Survey

Zhaokai Wang, Chenxi Bao, Le Zhuo, Jingrui Han, Yang Yue, Yihong Tang, Victor Shea-Jay Huang, Yue Liao

Arxiv Preprint

PDF arXiv Code Stars Under review.

Arxiv

Trans4D: Realistic Geometry-Aware Transition for Compositional Text-to-4D Synthesis

Bohan Zeng, Ling Yang, Siyu Li, Jiaming Liu, Zixiang Zhang, Victor Shea-Jay Huang, Juanxi Tian, Kaixin Zhu, yongzhen.gyz, Fu-Yun Wang, Minkai Xu, Stefano Ermon, Wentao Zhang

Arxiv Preprint

PDF arXiv BibTex Under review.

Arxiv

SynthVLM: High-Efficiency and High-Quality Synthetic Data for Vision Language Models

Zheng Liu, Hao Liang, Victor Shea-Jay Huang, Wentao Xiong, Qinhan Yu, Linzhuang Sun, Chong Chen, Conghui He, Bin Cui, Wentao Zhang

Arxiv Preprint

PDF arXiv Code Stars BibTex Under review.

Arxiv

KeyVideoLLM: Towards Large-scale Video Keyframe Selection

Zheng Liu, Hao Liang, Victor Shea-Jay Huang, Wentao Xiong, Qinhan Yu, Linzhuang Sun, Chong Chen, Conghui He, Bin Cui, Wentao Zhang

Arxiv Preprint

PDF arXiv BibTex Under review.

Arxiv

AISafetyLab: A Comprehensive Framework for AI Safety Evaluation and Improvement

Arxiv Preprint

PDF arXiv Code Stars Preprint

Arxiv

How Should We Enhance the Safety of Large Reasoning Models: An Empirical Study

Zhexin Zhang*, Xian Qi Loye*, Victor Shea-Jay Huang, Junxiao Yang, Qi Zhu, Shiyao Cui, Fei Mi, Lifeng Shang, Yingkang Wang, Hongning Wang, Minlie Huang

Arxiv Preprint

PDF arXiv Code Stars Preprint

ICML

BlackDAN: A Black-Box Multi-Objective Approach for Effective and Contextual Jailbreaking of Large Language Models

Victor Shea-Jay Huang*, Xinyuan Wang*, Renmiao Chen, Hao Wang, Chengwei Pan, Lei Sha, Minlie Huang

ICML 2025 Workshop

PDF arXiv Code Stars BibTex Published

Arxiv

Synth-Empathy: Towards High-Quality Synthetic Empathy Data

Hao Liang, Linzhuang Sun, Jingxuan Wei, Victor Shea-Jay Huang, Linkun Sun, Bihui Yu, Conghui He, Wentao Zhang

Arxiv Preprint

PDF arXiv Code Stars BibTex Under review.

arXiv

MindVLA-U1: VLA Beats VA with Unified Streaming Architecture for Autonomous Driving

Yuzhou Huang*, Benjin Zhu*, Hengtong Lu, Victor Shea-Jay Huang, Haiming Zhang, Wei Chen, Jifeng Dai, Yan Xie, Hongsheng Li

arXiv Preprint

PDF arXiv Preprint

arXiv

Driving Intents Amplify Planning-Oriented Reinforcement Learning

Hengtong Lu*, Victor Shea-Jay Huang*, Chengmin Yang, Pengfei Jing, Jifeng Dai, Yan Xie, Benjin Zhu*

arXiv Preprint

PDF arXiv Preprint

arXiv

Action Emergence from Streaming Intent

Pengfei Jing*, Victor Shea-Jay Huang, Hengtong Lu, Jifeng Dai, Yan Xie, Benjin Zhu*

arXiv Preprint

PDF arXiv Preprint

AAAI

TIDE : Temporal-Aware Sparse Autoencoders for Interpretable Diffusion Transformers in Image Generation

Victor Shea-Jay Huang, Le Zhuo, Yi Xin, Zhaokai Wang, Fu-Yun Wang, Yuchi Wang, Renrui Zhang, Peng Gao, Hongsheng Li

AAAI 2026

PDF arXiv BibTex Published

AAAI

Medical MLLM is Vulnerable: Cross-Modality Jailbreak and Mismatched Attacks on Medical Multimodal Large Language Models

Victor Shea-Jay Huang, Xinyuan Wang, Hantao Zhang, Yinghao Zhu, Jiawen Xi, Jingkun An, Hao Wang, Hao Liang, Chengwei Pan

AAAI 2025

PDF arXiv Code Stars BibTex Published

Arxiv

AISafetyLab: A Comprehensive Framework for AI Safety Evaluation and Improvement

Arxiv Preprint

PDF arXiv Code Stars Preprint

ACL

How Should We Enhance the Safety of Large Reasoning Models: An Empirical Study

Zhexin Zhang*, Xian Qi Loye*, Victor Shea-Jay Huang, Junxiao Yang, Qi Zhu, Shiyao Cui, Fei Mi, Lifeng Shang, Yingkang Wang, Hongning Wang, Minlie Huang

ACL 2026

PDF arXiv Code Stars Published

Arxiv

BlackDAN: A Black-Box Multi-Objective Approach for Effective and Contextual Jailbreaking of Large Language Models

Xinyuan Wang*, Victor Shea-Jay Huang*, Renmiao Chen, Hao Wang, Chengwei Pan, Lei Sha, Minlie Huang

Arxiv Preprint

PDF arXiv Code Stars BibTex Under review.

Contact

For project ideas, research collaboration, or joining related efforts, reach out by email.

jeix782@gmail.com

Academic Service

Conference Reviewers

International Conference on Machine Learning (ICML) 2026
Conference on Neural Information Processing Systems (NeurIPS) 2025, 2026
The IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) 2026
International Conference on Computer Vision (ICCV) 2025
Association for Computational Linguistics (ACL) 2025
The Association for the Advancement of Artificial Intelligence (AAAI) 2025, 2026
ACM International Conference on Multimedia (ACM MM) 2024, 2025, 2026
ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD) 2025, 2026