Xuming He

Associate Professor PLUS Lab School of Information Science and Technology (SIST) ShanghaiTech University Address Room 1A-221, SIST Building 393 Middle Huaxia Road Pudong, Shanghai, 201210, China Contact Phone: +86 21 20685378 Email: hexm at shanghaitech dot edu dot cn

News

• [02/2024] Three papers on SGG and VLMs accepted in CVPR 2024.

• [02/2024] One paper on Multi-modal fusion accepted in IEEE TMI.

• [01/2024] One paper on imbalanced clustering accepted in ICLR 2024.

• [12/2023] One paper on zero-shot caption generation accepted in AAAI 2024.

• [11/2023] One paper on one-stage SGG accepted in IEEE TPAMI.

• [09/2023] One paper on out-of-distribution detection accepted in NeurIPS 2023.

• [08/2023] One paper on interactive segmentation accepted in BMVC 2023.

• [08/2023] One paper on long-tailed NCD accepted in TMLR.

Research Interest

• Weakly-supervised/Few-shot learning

• Continual learning/Knowledge discovery

• Semantic segmentation and Scene parsing

• Vision and language representations

• Interpretable machine learning and reasoning

Prospective students

• Prospective graduate students: please check admission website. 学科方向: 计算机科学与技术.

• We also have multiple research projects (minimal 6 months) for undergrad students in SIST.

Selected Recent Publications

• Yu Wu, Yana Wei, Haozhe Wang, Yongfei Liu, Sibei Yang, Xuming He. Grounded Image Text Matching with Mismatched Relation Reasoning, International Conference on Computer Vision (ICCV), 2023

• Shan Ning*, Longtian Qiu*, Yongfei Liu, Xuming He. HOICLIP: Efficient Knowledge Transfer for HOI Detection with Visual Linguistic Model, IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2023

• Zhitong Gao, Yucong Chen, Chuyu Zhang, Xuming He. Modeling Multimodal Aleatoric Uncertainty in Segmentation with Mixture of Stochastic Experts, International Conference on Learning Representation (ICLR), 2023

• Shipeng Yan, Lanqing Hong, Hang Xu, Jianhua Han, Tinne Tuytelaars, Zhenguo Li, Xuming He. Generative Negative Text Replay for Continual Vision-Language Pretraining, European Conference of Computer Vision (ECCV), 2022

• Jiangwei Xie, Shipeng Yan, Xuming He. General Incremental Learning with Domain-aware Categorical Representations, IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2022

• Rongjie Li, Songyang Zhang, Xuming He. SGTR: End-to-end Scene Graph Generation with Transformer, IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2022

• Shipeng Yan, Jiangwei Xie, Xuming He. DER: Dynamically Expandable Representation for Class Incremental Learning, IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2021

• Yongfei Liu, Xiangyi Zhang, Songyang Zhang, Xuming He. Part-aware prototype Network for Few-shot Semantic Segmentation, European Conference of Computer Vision (ECCV), 2020

• Haozhe Wang, Jiale Zhou, Xuming He. Learning Context-aware Task Reasoning for Efficient Meta-reinforcement Learning, International Conference on Autonomous Agents and Multiagent Systems (AAMAS), 2020

• Bo Wan*, Desen Zhou*, Yongfei Liu, Rongjie Li, Xuming He. Pose-aware Multi-level Feature Network for Human Object Interaction Detection, International Conference on Computer Vision (ICCV), 2019

• Songyang Zhang, Shipeng Yan, Xuming He. LatentGNN: Learning Efficient Non-local Relations for Visual Recognition, International Conference on Machine Learning (ICML),2019