Shijia Huang

I am currently a second-year PhD student at Computer Science & Engineering Department, The Chinese University of Hong Kong (CUHK). I am fortunate to work with Prof. Liwei Wang.

Before that, I received my B.Eng. degree in School of Computer Science and Engineering from South China University of Technology (SCUT) in 2020.

My research interests lie primarily in multi-modal and deep learning, particularly focusing on Visual Grounding in 2D/3D Worlds, Large Language Models, and Embodied AI.

Email / Github

Aug. 2020 - Present , The Chinese University of Hong Kong ,

Ph.D. Student, Computer Science & Engineering

Aug. 2016 - July. 2020 , South China University of Technology ,

Bachelor Degree, Computer Science & Technology

Multi-View Transformer for 3D Visual Grounding
Shijia Huang, Yilun Chen, Jiaya Jia, Liwei Wang
IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2022
[PDF] [Code]

Learning Preference Model for LLMs via Automatic Preference Data Generation
Shijia Huang, Jianqiao Zhao, Yanyang Li, Liwei Wang
The 2023 Conference on Empirical Methods in Natural Language Processing (EMNLP), 2023
[PDF]

DSGN++: Exploiting Visual-Spatial Relation for Stereo-based 3D Detectors
Yilun Chen, Shijia Huang, Shu Liu, Bei Yu, Jiaya Jia
IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI), 2022
Ranked 1st place among all camera-based approaches on KITTI 3D detection leaderboard (All categories, Nov. 2021).
[PDF] [Code]

A Unified Mutual Supervision Framework for Referring Expression Segmentation and Generation
Shijia Huang, Feng Li, Hao Zhang, Shilong Liu, Lei Zhang, Liwei Wang
Arxiv Preprint
[PDF]

Towards Learning a Generalist Model for Embodied Navigation
*Duo Zheng, *Shijia Huang, Lin Zhao, Yiwu Zhong, Liwei Wang
Arxiv Preprint
[PDF]

CLEVA: Chinese Language Models EVAluation Platform
Yanyang Li, Jianqiao Zhao, Duo Zheng, Zi-Yuan Hu, Zhi Chen, Xiaohui Su, Yongfeng Huang, Shijia Huang, Dahua Lin, Michael R. Lyu, Liwei Wang
The 2023 Conference on Empirical Methods in Natural Language Processing (EMNLP), 2023
[PDF]

DQ-DETR: Dual Query Detection Transformer for Phrase Extraction and Grounding
Shilong Liu, Yaoyuan Liang, Feng Li, Shijia Huang, Hao Zhang, Hang Su, Jun Zhu, Lei Zhang
Proceedings of the AAAI Conference on Artificial Intelligence (AAAI), 2023
[PDF]

MP-Former: Mask-Piloted Transformer for Image Segmentation
Hao Zhang, Feng Li, Hu-Sheng Xu, Shijia Huang, Shilong Liu, L. Ni, Lei Zhang
IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2023
[PDF]