Rui Yao, Ph.D., Professor, and Ph.D. Supervisor.

Dr. Yao was selected for the Jiangsu Province  "Six Talent Peaks" High-Level Talent Program and recognized as an Outstanding Young and Key Teacher at China University of Mining and Technology (CUMT). His research interests include computer vision, pattern recognition, deep learning, and artificial intelligence, focusing on both theoretical and applied aspects. He conducted collaborative research at the University of Adelaide, Australia, from September 2011 to October 2012 and September 2016 to September 2017.

Dr. Yao has presided over three projects funded by the National Natural Science Foundation of China (NSFC)—including two General Programs and one Young Scientists Fund—as well as one project funded by the Natural Science Foundation of Jiangsu Province and two projects funded by the China Postdoctoral Science Foundation (including one Special Grant). He has also participated in five NSFC General Programs and two Young Scientists Fund projects. He has published over 100 research papers in top-tier international journals and conferences, including CVPR, ICCV, ECCV, IEEE TIP, IEEE TMM, IEEE TCSVT, and Pattern Recognition, and authored two academic monographs. He holds five invention patents and six software copyrights.

Dr. Yao has received one Ministry of Education Award for Outstanding Scientific Research Achievements in Higher Education, two Second Prizes of the China Coal Industry Science and Technology Award, and one Second Prize of the Jiangsu Province Educational Science Research Achievement Award (Science and Technology Category). Several of his master's students have received the Excellent Master’s Thesis Award from CUMT. Under his supervision, students won 5th place in the NVIDIA AI City Challenge, a prestigious competition hosted by the IEEE Conference on Computer Vision and Pattern Recognition (CVPR) and often referred to as the “ImageNet Challenge of Intelligent Traffic Video Analysis.”

Dr. Yao is a Distinguished Member of the China Computer Federation (CCF), a Director of the Chinese Society of Stereology, a Member of the CCF Technical Committee on Computer Vision, Secretary-General of the Intelligent Systems and Applications Committee of the Jiangsu Association for Artificial Intelligence, and a Member of the Imaging Detection and Perception Committee of the Chinese Society of Image and Graphics. He serves as a reviewer for IEEE TIP, IEEE TMM, IEEE TGRS, IEEE TVT, IEEE SPL, Pattern Recognition, among others, and as a Program Committee Member for major international conferences including CVPR, ICCV, ECCV, AAAI, IJCAI, ACCV, etc.

He teaches several undergraduate and graduate courses, including Introduction to Information Science, Intelligent Optimization Methods, Image Understanding and Visual Perception, and Image Processing and Applications. He has led three university-level teaching reform projects, published three teaching-related papers, and received the Outstanding Undergraduate Thesis Advisor Award. He has supervised multiple National, Provincial, and University Innovation and Entrepreneurship Training Programs for College Students.

Contact: ruiyao@cumt.edu.cn

Research Projects Led:

1. National Natural Science Foundation of China (General Program), 2022.1–2025.12, Principal Investigator.

2. National Natural Science Foundation of China (General Program), 2018.1–2021.12, Principal Investigator.

3. National Natural Science Foundation of China (Young Scientists Fund), 2015.1–2017.12, Principal Investigator.

4. Natural Science Foundation of Jiangsu Province (General Program), 2017.7–2020.6, Principal Investigator.

5. China Postdoctoral Science Foundation (Special Grant):** 2016.7–2018.6, Principal Investigator.

6. China Postdoctoral Science Foundation (General Grant):** 2014.7–2016.7, Principal Investigator.

Selected Journal Publications (*Corresponding Author)

[24] Minghao Zhang (本科生), Zhibin Zhang (本科生), Rui Yao*, Yifan Mu, Cross-stage Language-guided Fusion with Feature Enhanced for Multimodal Sentiment Analysis, ACM Transactions on Multimedia Computing, Communications and Applications (Major revisions), 2025. (CCF B)

[23] Jinshi Kang (本科生), Rui Yao*, Hancheng Zhu, Kunyang Sun, Xixi Li, Jiagi Zhao,  Yong Zhou, Dual-Lens Super-Resolution with Semantic-Enhanced Feature Matching and Adaptive TextureTransfer, International Conference on Intelligent Systems and Robotics (CISR), 2025.

[22] Lu Zhang, Rui Yao*, Yuhong Zhang, Yong Zhou, Fuyuan Hu, Jiaqi Zhao, Zhiwen Shao, Historical Object-Aware Prompt Learning for Universal Hyperspectral Object Tracking, ACM Transactions on Multimedia Computing, Communications and Applications, 21(7), 209:1-20, 2025. (SCI, CCF B) [Code] 

[21] Rui Yao, Anqi Zhang, Yong Zhou, Jiaqi Zhao, Bing Liu, Abdulmotaleb El Saddik, Adversarial Geometric Attacks for 3D Point Cloud Object Tracking, IEEE Transactions on Multimedia, 27: 3144 - 3157, 2025. (SCI, CCF B)

[20] Rui Yao, Lu Zhang, Yong Zhou, Hancheng Zhu, Jiaqi Zhao, Zhiwen Shao，Hyperspectral Object Tracking with Dual-Stream Prompt, IEEE Transactions on Geoscience and Remote Sensing, 63(5500612): 1-12, 2025. (SCI, CCF B) [Code]

[19] Wenbo Hu (本科生), Kuixuan Jiao (本科生), Kaijian Xia, Rui Yao*, DSCANet: Dynamic Snake Convolution with Attention for Crack Segmentation, International Conference on Intelligent Computing (ICIC), 2024. (CCF Ｃ) 

[18] Rui Yao, Wenxin Li, Yong Zhou, Jinqiu Sun, Zihang Yin, Jiaqi Zhao, Dual-Stream Edge-Target Learning Network for Infrared Small Target Detection, IEEE Transactions on Geoscience and Remote Sensing, 62(5007314): 1-14, 2024. (SCI, CCF B) [Code]

[17] Shenglan Li, Rui Yao*, Yong Zhou, Hancheng Zhu, Jiaqi Zhao, Zhiwen Shao, and Abdulmotaleb El Saddik, Motion-Aware Self-Supervised RGBT Tracking with Multi-Modality Hierarchical Transformers, ACM Transactions on Multimedia Computing, Communications and Applications, 20(12), 39:1-23, 2024. (SCI, CCF B) [Code] 

[16] Ying Chen, Rui Yao*, Yong Zhou, Jiaqi Zhao, Bing Liu, and Abdulmotaleb EL Saddik. Black-box Attack against Self-supervised Video Object Segmentation Models with Contrastive Loss, ACM Transactions on Multimedia Computing, Communications, and Applications, 20(2), 57:1-21, 2023. (SCI, CCF B)

[15] Rui Yao, Ying Chen, Yong Zhou, Fuyuan Hu, Jiaqi Zhao, Bing Liu, and Zhiwen Shao. Attention-guided Adversarial Attack for Video Object Segmentation, ACM Transactions on Intelligent Systems and Technology, 14(6), 102:1-22, 2023. (SCI)

[14] Jiazhu Qiu, Rui Yao*, Yong Zhou, Peng Wang, Yanning Zhang, Hancheng Zhu, Visible and Infrared Object Tracking via Convolution-Transformer Network with Joint Multimodal Feature Learning, IEEE Geoscience and Remote Sensing Letters, 20: 1-5, 2023. (SCI, JCR 1区)

[13] Guanyu Zhu, Yong Zhou, Rui Yao, Hancheng Zhu, Information Gap Narrowing for Point Cloud Few-Shot Segmentation[J]. IEEE Transactions on Circuits and Systems for Video Technology, 34(6): 4421-4433, 2023. (SCI, CCF B)

[12] Guanyu Zhu, Yong Zhou, Rui Yao, Hancheng Zhu, Cross-class Bias Rectification for Point Cloud Few-shot Segmentation, IEEE Transactions on Multimedia, 25: 9175-9188, 2023. (SCI, CCF B)

[11] 姚睿, 朱享彬, 周勇, 王鹏, 张艳宁, 赵佳琦, 基于重要特征的视觉目标跟踪可迁移黑盒攻击方法, 电子学报, 51(4): 826-834, 2023. (CCF A)

[10] Yong Zhou, Silin Chen, Jiaqi Zhao, Rui Yao, Yong Xue, Abdulmotaleb El Saddik, CLT-Det: Correlation Learning Based on Transformer for Detecting Dense Objects in Remote Sensing Images, IEEE Transactions on Geoscience and Remote Sensing, 60: 1-15, 2022. (SCI, JCR 1区)

[9] Guanyu Zhu, Yong Zhou, Rui Yao, Hancheng Zhu, Jiaqi Zhao, Cyclic Self-attention for Point Cloud Recognition, ACM Transactions on Multimedia Computing, Communications and Applications, 19: 1-19, 2022. (SCI, JCR 1区)

[8] Chongyu Liu, Rui Yao*, S. Hamid Rezatofighi, Ian Reid, Qinfeng Shi, Model-Free Tracker for Multiple Objects Using Joint Appearance and Motion Inference, IEEE Transactions on Image Processing, 29: 277-288, 2020. (SCI, JCR 1区)

[7] Rui Yao, Guosheng Lin, Shixiong Xia, Jiaqi Zhao, Yong Zhou, Video Object Segmentation and Tracking: A Survey, ACM Transactions on Intelligent Systems and Technology, 2020. (SCI, JCR 2区)

[6] Rui Yao, Cunyuan Gao, Shixiong Xia, Jiaqi Zhao, Yong Zhou, Fuyuan Hu, GAN-based Person Search via Deep Complementary Classifier with Center-constrained Triplet Loss, Pattern Recognition, 2020. (SCI, JCR 1区)

[5] Rui Yao, Guosheng Lin, Chunhua Shen, Yanning Zhang, Qinfeng Shi, Semantics-Aware Visual Object Tracking, IEEE Transactions on Circuits and Systems for Video Technology, 29(6), 1687-1700, 2018. (SCI, JCR 1区) [Code]

[4] Rui Yao, Guosheng Lin, Qinfeng Shi, Damith C. Ranasinghe, Efficient Dense Labelling of Human Activity Sequences from Wearables using Fully Convolutional Networks, Pattern Recognition, 78: 252-266, 2018. (SCI, JCR 1区) [Code]

[3] Rui Yao, Shixiong Xia, Zhen Zhang, and Yanning Zhang, Real-time Correlation Filter Tracking by Efficient Dense Belief Propagation with Structure Preserving, IEEE Transactions on Multimedia, 19(4): 772-784, 2017. (SCI, JCR 1区)

[2] Rui Yao, Qinfeng Shi, Chunhua Shen, Yanning Zhang, and Anton van den hengel, Part-based Robust Tracking using Online Latent Structured Learning, IEEE Transactions on Circuits and Systems for Video Technology, 27(6): 1235-1248, 2017. (SCI, JCR 1区) [Code]

[1] Chi Zhang, Guankai Li, Guosheng Lin, Qingyao Wu, and Rui Yao, CycleSegNet: Object Co-Segmentation With Cycle Refinement and Region Correspondence, IEEE Transactions on Image Processing, 2021. (SCI, JCR 1区)

Selected Conference Publications (*Corresponding Author)

[13] Shenglan Li, Rui Yao*, Yong Zhou, Hancheng Zhu, Kunyang Sun, Bing Liu, Zhiwen Shao, Jiaqi Zhao, Modality-Guided Dynamic Graph Fusion and Temporal Diffusion for Self-Supervised RGB-T Tracking, International Joint Conference on Artificial Intelligence (IJCAI), 2025. (CCF A) [Code]

[12] Xixi Li, Zhuo Gu, Rui Yao*, Yong Zhou, Hancheng Zhu, Jiaqi Zhao, Wen-liang Du, Beyond Individual and Point: Next POI Recommendation via Region-aware Dynamic Hypergraph with Dual-level Modeling, International Joint Conference on Artificial Intelligence (IJCAI), 2025. (CCF A)

[11] Zeyu Ding, Jiaqi Zhao, Yong Zhou, Wen-liang Du, Hancheng Zhu, Rui Yao, GSDet: Gaussian Splatting for Oriented Object Detection, International Joint Conference on Artificial Intelligence (IJCAI), 2025. (CCF A)

[10] Yao Li, Yong Zhou, Jiaqi Zhao, Yong Zhou, Wen-liang Du, Rui Yao,Bing Liu, Counterfactual Knowledge Maintenance for Unsupervised Domain Adaptation, International Joint Conference on Artificial Intelligence (IJCAI), 2025. (CCF A)

[9] Jiaqi Zhao, Zeyu Ding, Yong Zhou, Hancheng Zhu, Wen-Liang Du, Rui Yao. ReDiffDet: Rotation-equivariant Diffusion Model for Oriented Object Detection, The IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2025. (CCF A)

[8] Chenggong Ni, Fan Lyu, Jiayao Tan, Fuyuan Hu, Rui Yao, Tao Zhou, Maintaining consistent inter-class topology in continual test-time adaptation, The IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2025. (CCF A) 

[7] Hancheng Zhu, Ju Shi, Zhiwen Shao, Rui Yao, Yong Zhou, Jiaqi Zhao, and Leida Li, “Attribute-driven multimodal hierarchical prompts for image aesthetic quality assessment,” in Proceedings of the ACM International Conference on Multimedia (ACM MM), pp. 2399–2408, 2024. (CCF A) 

[6] Chi Zhang, Guosheng Lin, Fayao Liu, Rui Yao, Chunhua Shen, Canet: Class-agnostic segmentation networks with iterative refinement and attentive few-shot learning, IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp 5217-5226, 2019. (CCF A)

[5] Chi Zhang, Guosheng Lin, Fayao Liu, Jiushuang Guo, Qingyao Wu, Rui Yao, Pyramid Graph Networks with Connection Attentions for Region-Based One-Shot Semantic Segmentation, Proceedings of the IEEE International Conference on Computer Vision (ICCV), pp 9587-9595, 2019. (CCF A)

[4] Zhen Zhang, Qinfeng Shi, Julian McAuley, Wei Wei, Yanning Zhang, Rui Yao, Anton van den Hengel, Solving Constrained Combinatorial Optimisation Problems via MAP Inference without High-Order Penalties, Thirty-First AAAI Conference on Artificial Intelligence (AAAI), 2017. (CCF A)

[3] Rui Yao, Qinfeng Shi, Chunhua Shen, Yanning Zhang, and Anton van den Hengel, Part-based Visual Tracking with Online Latent Structural Learning, IEEE Conference on Computer Vision and Pattern Recognition (CVPR), June 25-27, pp 2363–2370, USA, 2013. (CCF Ａ) [Code]

[2] Rui Yao, Qinfeng Shi, Chunhua Shen, Yanning Zhang, and Anton van den Hengel, Robust Tracking with Weighted Online Structured Learning, Proceedings of the 12th European Conference on Computer Vision (ECCV), Oct. 7-13, pp158-172, Italy, 2012. (CCF B) [Code]

[1] Cunyuan Gao, Yi Hu, Yi Zhang, Rui Yao*, Yong Zhou, Jiaqi Zhao, Vehicle Re-Identification Based on Complementary Features, 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), 2021.