Bio

Yulei Niu is a Postdoctoral Research Scientist at DVMM Lab, Columbia University from 2022, working with Prof. Shih-Fu Chang. He was a Postdoctoral Research Fellow at Nanyang Technological University working with Prof. Hanwang Zhang. He obtained his Ph.D. at Renmin University of China in 2020, advised by Prof. Ji-Rong Wen and Prof. Zhiwu Lu. Prior to the Ph.D. study, Yulei received B.E. degree in Computer Science from Renmin University of China in 2015.
His research interests include vision and language, visual reasoning, and causal inference.

News

[01/2024] I serve as Area Chair for ACM MM 2024.
[12/2023] I serve as Senior PC Member for IJCAI 2024.
[06/2023] I serve as Senior PC Member for AAAI 2024.
[03/2023] I serve as Area Chair for BMVC 2023.
[10/2022] I was recognized as a top reviewer for NeurIPS 2022.
[07/2022] I serve as Area Chair for BMVC 2022 and Senior PC Member for AAAI 2023.
[04/2022] We are co-organizing the workshop on 2nd Causality in Vision at ECCV 2022 and calling for papers!
[01/2022] I was honored to be awarded the China Computer Federation (CCF) Outstanding Doctoral Dissertation Award.
[09/2021] I was recognized as an outstanding reviewer for ICCV 2021.
[03/2021] I was recognized as an outstanding reviewer for ICLR 2021.
[12/2020] We are co-organizing the workshop on Causality in Vision at CVPR 2021.
[11/2020] I serve as Senior PC Member for IJCAI 2021.
-->

Publications [Google Scholar]


ICLR 2024 SCHEMA: State CHangEs MAtter for Procedure Planning in Instructional Videos
Yulei Niu, Wenliang Guo, Long Chen, Xudong Lin, Shih-Fu Chang
[Paper] [Code]
AAAI 2024 Beyond Grounding: Extracting Fine-Grained Event Hierarchies Across Modalities
Hammad A. Ayyubi, Christopher Thomas, Lovish Chum, Rahul Lokesh, Long Chen, Yulei Niu, Xudong Lin, Xuande Feng, Jaywon Koo, Sounak Ray, Shih-Fu Chang,
[Paper]
ICCV 2023 Prompt-aligned Gradient for Prompt Tuning
Beier Zhu, Yulei Niu, Yucheng Han, Yue Wu, Hanwang Zhang
[Paper] [Code]
TPAMI Counterfactual samples synthesizing and training for robust visual question answering
Long Chen, Yuhang Zheng, Yulei Niu, Hanwang Zhang, Jun Xiao
[Paper]
CVPR 2023 DiGeo: Discriminative Geometry-Aware Learning for Generalized Few-Shot Object Detection
Jiawei Ma, Yulei Niu, Jincheng Xu, Shiyuan Huang, Guangxing Han, Shih-Fu Chang
[Paper] [Code]
AAAI 2023 Debiased Fine-Tuning for Vision-language Models by Prompt Regularization
Beier Zhu, Yulei Niu, Saeil Lee, Minhoe Hur, Hanwang Zhang
Oral Presentation
[Paper] [Code]
EMNLP 2022 Weakly-Supervised Temporal Article Grounding
Long Chen, Yulei Niu, Brian Chen, Xudong Lin, Guangxing Han, Christopher Thomas, Hammad Ayyubi, Heng Ji, Shih-Fu Chang
[Paper] [Code]
EMNLP 2022 Interventional Training for Out-Of-Distribution Natural Language Understanding
Sicheng Yu, Jing Jiang, Hao Zhang, Yulei Niu, Qianru Sun, Lidong Bing
[Paper] [Code]
NeurIPS 2022 Respecting Transfer Gap in Knowledge Distillation
Yulei Niu, Long Chen, Chang Zhou, Hanwang Zhang
[Paper] [Code]
ECCV 2022 Explicit Image Caption Editing
Zhen Wang, Long Chen, Wenbo Ma, Guangxing Han, Yulei Niu, Jian Shao, Jun Xiao
[Paper] [Code]
CVPR 2022 Classification-Then-Grounding: Reformulating Video Scene Graphs as Temporal Bipartite Graphs
Kaifeng Gao, Long Chen, Yulei Niu, Jian Shao, Jun Xiao
[Paper] [Code]
ICLR 2022 On Non-Random Missing Labels in Semi-Supervised Learning
Xinting Hu, Yulei Niu, Chunyan Miao, Xian-Sheng Hua, Hanwang Zhang
[Paper] [Code]
AAAI 2022 Cross-Domain Empirical Risk Minimization for Unbiased Long-tailed Classification
Beier Zhu, Yulei Niu, Xian-Sheng Hua, Hanwang Zhang
Oral Presentation
[Paper] [Code]
NeurIPS 2021 Introspective Distillation for Robust Question Answering
Yulei Niu, Hanwang Zhang
[Paper] [Code]
ACL 2021 COSY: COunterfactual SYntax for Cross-Lingual Understanding
Sicheng Yu, Hao Zhang, Yulei Niu, Qianru Sun, Jing Jiang
[Paper] [Code]
CVPR 2021 Counterfactual VQA: A Cause-Effect Look at Language Bias
Yulei Niu, Kaihua Tang, Hanwang Zhang, Zhiwu Lu, Xian-Sheng Hua, Ji-Rong Wen
[Paper] [Code]
WACV 2021 Domain-Adaptive Few-Shot Learning
An Zhao, Mingyu Ding, Zhiwu Lu, Tao Xiang, Yulei Niu, Jiechao Guan, Ji-Rong Wen, Ping Luo
[Paper] [Code]
CVPR 2020 Unbiased Scene Graph Generation from Biased Training
Kaihua Tang, Yulei Niu, Jianqiang Huang, Jiaxin Shi, Hanwang Zhang
Oral Presentation
[Paper] [Code]
CVPR 2020 Two Causal Principles for Improving Visual Dialog
Jiaxin Qi*, Yulei Niu*, Jianqiang Huang, Hanwang Zhang
Visual Dialog Challenge 2019 Winner
[Paper] [Code]
TPAMI Variational Context: Exploiting Visual and Textual Context for Grounding Referring Expressions
Yulei Niu, Hanwang Zhang, Zhiwu Lu, Shih-Fu Chang
[Paper]
SIGIR 2019 Coarse-to-Fine Grained Classification
Yuqi Huo, Yao Lu, Yulei Niu, Zhiwu Lu, Ji-Rong Wen
Short Paper
[Paper]
CVPR 2019 Recursive Visual Attention in Visual Dialog
Yulei Niu, Hanwang Zhang, Manli Zhang, Jianhong Zhang, Zhiwu Lu, Ji-Rong Wen
Oral Presentation
[Paper] [Code] [Talk]
TIP Multi-Modal Multi-Scale Deep Learning for Large-Scale Image Annotation
Yulei Niu, Zhiwu Lu, Ji-Rong Wen, Tao Xiang, Shih-Fu Chang
[Paper]
CVPR 2018 Grounding Referring Expressions in Images by Variational Context
Hanwang Zhang, Yulei Niu, Shih-Fu Chang
[Paper] [Code]
AAAI 2017 FeaBoost: Joint Feature and Label Refinement for Semantic Segmentation
Yulei Niu, Zhiwu Lu, Songfang Huang, Xin Gao, Ji-Rong Wen
Oral Presentation
[Paper]
IJCAI 2015 Weakly Supervised Matrix Factorization for Noisily Tagged Image Parsing
Yulei Niu*, Zhiwu Lu*, Songfang Huang, Peng Han, Ji-Rong Wen
[Paper]

Activities

Co-organizer Workshop on 2nd Causality in Vision, ECCV 2022
Workshop on 1st Causality in Vision, CVPR 2021
Area Chair ACM MM'24, BMVC'23, BMVC'22, ACM MM Asia'20
Senior PC Member AAAI'24, IJCAI'24, AAAI'23, IJCAI'23, IJCAI'21
Journal Reviewer IEEE TPAMI, IEEE TIP, IEEE TNNLS, IEEE TMM, ACM TOIS, ACM CSUR, Neurocomputing
PC Member CVPR (2020-), ICCV (2021-), ECCV (2022-),
ICML (2020-), NeurIPS (2020-), ICLR (2021-),
ACL (2023-), EMNLP (2021-),
AAAI (2020-), IJCAI (2021-), ACMMM (2020-), WACV (2021), BMVC (2019-2020)

Last updated: Jan 16, 2023.