I am a Ph.D. student of Zhejiang University, supervised by Prof. Siliang Tang（汤斯亮） and Prof. Zhou Zhao（赵洲） . I obtained my B.S. degree at Central South University. I also collaborate with Xu Tan (谭旭) from Microsoft Research Asia closely.

My research interest includes Video Generation, Sign Language Processing, Speech Translation, and Neural Machine Translation. I have published 10+ papers includes NeurIPS, CVPR, ACL, et.al.

I am expected to graduate in June 2025 and seeking job opportunities. Please feel free to contact me if you are interested!

🔥 News

• 2024.05: 🎉 Two papers are accepted by ACL 2024
• 2024.01: 🎉 One papers are accepted by ICASSP Oral 2024
• 2023.01: 🎉 One papers are accepted by CVPR 2023
• 2022.01: 🎉 One papers are accepted by CVPR 2022
• 2021.07: 🎉 One papers are accepted by ACM-MM 2021

📝 Publications

ACL 2024

T2S-GPT: Dynamic Vector Quantization for Autoregressive Sign Language Production from Text
Aoxiong Yin, Haoyuan Li, Kai Shen, Siliang Tang, Yueting Zhuang

ICASSP 2024 (Oral)

Language Model is a Branch Predictor for Simultaneous Machine Translation
Aoxiong Yin*, Tianyun Zhong*, Haoyuan Li, Siliang Tang, Zhou Zhao

CVPR 2023

Gloss attention for gloss-free sign language translation
Aoxiong Yin*, Tianyun Zhong*, Li Tang, Weike Jin, Tao Jin, Zhou Zhao

CVPR 2022

Mlslt: Towards multilingual sign language translation
Aoxiong Yin, Zhou Zhao, Weike Jin, Meng Zhang, Xingshan Zeng, Xiaofei He

ACM-MM 2021

Simulslt: End-to-end simultaneous sign language translation
Aoxiong Yin, Zhou Zhao, Jinglin Liu, Weike Jin, Meng Zhang, Xingshan Zeng, Xiaofei He

Full Publication List

Sign Language Processing

• ACL 2024 T2S-GPT: Dynamic Vector Quantization for Autoregressive Sign Language Production from Text, Aoxiong Yin, Haoyuan Li, Kai Shen, Siliang Tang, Yueting Zhuang

• CVPR 2023 Gloss attention for gloss-free sign language translation, Aoxiong Yin*, Tianyun Zhong*, Li Tang, Weike Jin, Tao Jin, Zhou Zhao

• CVPR 2022 Mlslt: Towards multilingual sign language translation, Aoxiong Yin, Zhou Zhao, Weike Jin, Meng Zhang, Xingshan Zeng, Xiaofei He

• ACM-MM 2021 Simulslt: End-to-end simultaneous sign language translation, Aoxiong Yin, Zhou Zhao, Jinglin Liu, Weike Jin, Meng Zhang, Xingshan Zeng, Xiaofei He

Machine Translation

• ACL 2024 Findings TransFace: Unit-Based Audio-Visual Speech Synthesizer for Talking Head Translation, Xize Cheng, Rongjie Huang, Linjun Li, Tao Jin, Zehan Wang, Aoxiong Yin, Minglei Li, Xinyu Duan, Zhou Zhao

• ICASSP 2024 Oral Language Model is a Branch Predictor for Simultaneous Machine Translation, Aoxiong Yin*, Tianyun Zhong*, Haoyuan Li, Siliang Tang, Zhou Zhao

• ICCV 2023 Mixspeech: Cross-modality self-learning with audio-visual stream mixup for visual speech translation and recognition, Xize Cheng, Tao Jin, Rongjie Huang, Linjun Li, Wang Lin, Zehan Wang, Ye Wang, Huadai Liu, Aoxiong Yin, Zhou Zhao

Multi-modality

• NeurIPS 2023 Connecting multi-modal contrastive representations, Zehan Wang, Yang Zhao, Haifeng Huang, Jiageng Liu, Aoxiong Yin, Li Tang, Linjun Li, Yongqi Wang, Ziang Zhang, Zhou Zhao
• EMNLP 2023 3drp-net: 3d relative position-aware network for 3d visual grounding, Zehan Wang, Haifeng Huang, Yang Zhao, Linjun Li, Xize Cheng, Yichen Zhu, Aoxiong Yin, Zhou Zhao
• ICCV 2023 Distilling coarse-to-fine semantic matching knowledge for weakly supervised 3d visual grounding, Zehan Wang, Haifeng Huang, Yang Zhao, Linjun Li, Xize Cheng, Yichen Zhu, Aoxiong Yin, Zhou Zhao

Others

• Preprint TrainerAgent: Customizable and Efficient Model Training through LLM-Powered Multi-Agent System, Haoyuan Li, Hao Jiang, Tianke Zhang, Zhelun Yu, Aoxiong Yin, Hao Cheng, Siming Fu, Yuhao Zhang, Wanggui He

🎖 Honors and Awards

• 2020-2021 National Scholarship (Top 1%)
• 2020-2021 Outstanding Graduate of Central South University (Top 15%)
• 2019 Mittal Scholarship of Central South University (Top 1%)
• 2017.11 First Prize in the National Undergraduate Mathematical Modeling Competition (Top 1%)
• 2017 Second Prize in the American Undergraduate Mathematical Contest in Modeling (Top 20%)

📖 Educations

• 2020.09 - 2025.06, Ph.D., Zhejiang University, Hangzhou.
• 2016.09 - 2020.06, Undergraduate, Computer Science, Central South University, Changsha.
• 2013.09 - 2016.06, Hunan Youxian No.1 Middle School.

💻 Internships

• 2024.03 - to date, MSRA, machine learning Group, Beijing.
• 2022.10 - 2023.02, Huawei, Noah’s Ark Lab, Shenzhen.
• 2022.06 - 202.09, Shopee, machine translation Group, Shanghai.