Xuming He

Associate Professor PLUS Lab School of Information Science and Technology (SIST) ShanghaiTech University Address Room 1A-221, SIST Building 393 Middle Huaxia Road Pudong, Shanghai, 201210, China Contact Phone: +86 21 20685378 Email: hexm at shanghaitech dot edu dot cn or xmhe dot pluslab at google mail

Prospective students

• We are looking for prospective graduate students for 2025. You must contact me via email if you are interested in joining in my lab. 学科方向: 计算机科学与技术.

• We also have multiple research projects (minimal 6 months) for undergrad students in SIST.

• We are looking for a long-term research assistant (科研助理). Contact us via email if interested.

News

• [12/2024] One paper on open-vocabulary scene graph generation accepted in AAAI 2025.

• [11/2024] One paper on object grasping accepted in 3DV 2025.

• [09/2024] One paper on OOD semantic segmentation accepted in NeurIPS 2024.

• [07/2024] One paper on novel class discovery accepted in ECCV 2024.

Research Interest

• Open-world scene understanding

• Multi-modal learning and reasoning

• Continual learning and knowledge discovery

• Explainable artificial intelligence

Selected Recent Publications

• Yu Wu, Yana Wei, Haozhe Wang, Yongfei Liu, Sibei Yang, Xuming He. Grounded Image Text Matching with Mismatched Relation Reasoning, International Conference on Computer Vision (ICCV), 2023

• Shan Ning*, Longtian Qiu*, Yongfei Liu, Xuming He. HOICLIP: Efficient Knowledge Transfer for HOI Detection with Visual Linguistic Model, IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2023

• Zhitong Gao, Yucong Chen, Chuyu Zhang, Xuming He. Modeling Multimodal Aleatoric Uncertainty in Segmentation with Mixture of Stochastic Experts, International Conference on Learning Representation (ICLR), 2023

• Shipeng Yan, Lanqing Hong, Hang Xu, Jianhua Han, Tinne Tuytelaars, Zhenguo Li, Xuming He. Generative Negative Text Replay for Continual Vision-Language Pretraining, European Conference of Computer Vision (ECCV), 2022

• Jiangwei Xie, Shipeng Yan, Xuming He. General Incremental Learning with Domain-aware Categorical Representations, IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2022

• Rongjie Li, Songyang Zhang, Xuming He. SGTR: End-to-end Scene Graph Generation with Transformer, IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2022

• Shipeng Yan, Jiangwei Xie, Xuming He. DER: Dynamically Expandable Representation for Class Incremental Learning, IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2021

• Yongfei Liu, Xiangyi Zhang, Songyang Zhang, Xuming He. Part-aware prototype Network for Few-shot Semantic Segmentation, European Conference of Computer Vision (ECCV), 2020

• Haozhe Wang, Jiale Zhou, Xuming He. Learning Context-aware Task Reasoning for Efficient Meta-reinforcement Learning, International Conference on Autonomous Agents and Multiagent Systems (AAMAS), 2020

• Bo Wan*, Desen Zhou*, Yongfei Liu, Rongjie Li, Xuming He. Pose-aware Multi-level Feature Network for Human Object Interaction Detection, International Conference on Computer Vision (ICCV), 2019

• Songyang Zhang, Shipeng Yan, Xuming He. LatentGNN: Learning Efficient Non-local Relations for Visual Recognition, International Conference on Machine Learning (ICML),2019