Professor Yi-Zhe Song
Professor of Computer Vision and Machine Learning; Programme Lead of MSc in Artificial Intelligence
Bsc (Bath), Msc (Cantab), PhD (Bath), FHEA, SMIEEE
Academic and research departments
Faculty of Engineering and Physical Sciences, Centre for Vision, Speech and Signal Processing (CVSSP), Department of Electrical and Electronic Engineering.Biography
Please visit SketchX Lab page for recent updates.
Yi-Zhe Song is a Professor of Computer Vision and Machine Learning, at the Centre for Vision Speech and Signal Processing (CVSSP).
He leads the SketchX Lab within CVSSP - a large research group of 3 academics, 2 postdocs, and 14 full-time PhD students. His vision for SketchX is understanding how seeing can be explained by drawing. In other words, how better understanding of human sketch data can be translated to insights of how human visual systems operate, and in turn how such insights can benefit computer vision and cognitive science at large.
He is an Associate Editor of the IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI), the world's top-ranked journal in computer vision and machine learning in terms of impact factor (16.389), and a Programme Chair for British Machine Vision Conference (BMVC) 2021. He is also an Associate Editor of Frontiers in Computer Science – Computer Vision, and regularly serves as Area Chair (AC) for flagship computer vision and machine learning conferences, most recently as AC for CVPR'22, and ICCV'21.
SketchX publishes consistently in top-tier conferences* (CVPR, ICCV, ECCV, SIGGRAPH Asia, ICML, BMVC) and journals (IJCV, TIP, TVCG, TCSVT), including a Best Paper Award at British Machine Vision Conference 2015. (*21 x CVPR, 11 x ICCV, 4 x ECCV, 2 x SIGGRAPH Asia, 1 x ICML, as of July 2021)
He founded, and currently leads the MSc in AI programme at Surrey, having previously established an MSc in AI programme at Queen Mary University of London.
He obtained a PhD in 2008 on Computer Vision and Machine Learning from the University of Bath, a MSc (with Best Dissertation Award) in 2004 from the University of Cambridge, and a Bachelor's Degree (First Class Honours) in 2003 from the University of Bath.
He is a Senior Member of IEEE, a Fellow of the Higher Education Academy (HEA), as well as full member of the EPSRC review college. He also reviews for other international funding bodies, such as Czech Science Foundation, and São Paulo Research Foundation of Brazil.
News
My publications
Highlights
For full publication list please refer to Google Scholar, and CSRankings.
2021
- Jiun Tian Hoe*, Kam Woh Ng*, Tianyu Zhang, Chee Seng Chan, Yi-Zhe Song, Tao Xiang. One Loss for All: Deep Hashing with a Single Cosine Similarity based Learning Objective, NeurIPS 2021
- Ling Luo, Yulia Gryaditskaya, Yongxin Yang, Tao Xiang, Yi-Zhe Song, Fine-Grained VR Sketching: Dataset and Insights, 3DV 2021
- Lan Yang, Kaiyue Pang, Honggang Zhang, Yi-Zhe Song, SketchAA: Abstract Representation for Abstract Sketches, ICCV 2021
- Yonggang Qi, Guoyao Su, Pinaki Nath Chowdhury, Mingkang Li, Yi-Zhe Song, SketchLattice: Latticed Representation for Sketch Manipulation, ICCV 2021
- Ayan Kumar Bhunia, Aneeshan Sain, Pinaki Nath Chowdhury, Yi-Zhe Song, Text is Text, No Matter What: Unifying Text Recognition using Knowledge Distillation, ICCV 2021
- Ayan Kumar Bhunia, Pinaki Nath Chowdhury, Aneeshan Sain, Yi-Zhe Song, Towards the Unseen: Iterative Text Recognition by Distilling from Errors, ICCV 2021
- Ayan Kumar Bhunia, Aneeshan Sain, Amandeep Kumar, Shuvozit Ghose, Pinaki Nath Chowdhury, Yi-Zhe Song, Joint Visual Semantic Reasoning: Multi-Stage Decoder for Text Recognition, ICCV 2021
- Sen He, Wentong Liao, Michael Ying Yang, Yi-Zhe Song, Bodo Rosenhahn, Tao Xiang, Disentangled Lifespan Face Synthesis, ICCV 2021
- Zhihe Lu, Sen He, Xiatian Zhu, Li Zhang, Yi-Zhe Song, Tao Xiang, Simpler is Better: Few-shot Semantic Segmentation with Classifier Weight Transformer, ICCV 2021
- Dongliang Chang, Kaiyue Pang, Yixiao Zheng, Zhanyu Ma, Yi-Zhe Song, Jun Guo, Your “Flamingo” is My “Bird”: Fine-Grained, or Not, CVPR 2021 Oral
- Ayan Kumar Bhunia, Pinaki Nath Chowdhury, Yongxin Yang, Timothy Hospedales, Tao Xiang, Yi-Zhe Song, Vectorization and Rasterization: Self-Supervised Learning for Sketch and Handwriting, CVPR 2021
- Ayan Das, Yongxin Yang, Timothy Hospedales, Tao Xiang, Yi-Zhe Song, Cloud2Curve: Generation and Vectorization of Parametric Sketches, CVPR 2021
- Aneeshan Sain, Ayan Kumar Bhunia, Yongxin Yang, Tao Xiang, Yi-Zhe Song, StyleMeUp: Towards Style-Agnostic Sketch-Based Image Retrieval, CVPR 2021
- Yonggang Qi, Kai Zhang, Aneeshan Sain, Yi-Zhe Song, PQA: Perceptual Question Answering, CVPR 2021
- Sen He, Wentong Liao, Michael Ying Yang, Yongxin Yang, Yi-Zhe Song, Bodo Rosenhahn, Tao Xiang, Context-Aware Layout to Image Generation with Enhanced Object Appearance, CVPR 2021
- Ayan Kumar Bhunia, Pinaki Nath Chowdhury, Aneeshan Sain, Yongxin Yang, Tao Xiang, Yi-Zhe Song, More Photos are All You Need: Semi-Supervised Learning for Fine-Grained Sketch-Based Image Retrieval, CVPR 2021
- Ayan Kumar Bhunia, Shuvozit Ghose, Amandeep Kumar, Pinaki Nath Chowdhury, Aneeshan Sain, Yi-Zhe Song, MetaHTR: Towards Writer-Adaptive Handwritten Text Recognition, CVPR 2021
- Anran Qi, Yulia Gryaditskaya, Jifei Song, Yongxin Yang, Yonggang Qi, Timothy M. Hospedales, Tao Xiang, Yi-Zhe Song, Towards Fine-Grained Sketch-Based 3D Shape Retrieval, IEEE Transactions on Image Processing (IEEE TIP), 2021
2020
- Ling Luo, Yulia Gryaditskaya, Yongxin Yang, Tao Xiang, Yi-Zhe Song, Towards 3D VR-Sketch to 3D Shape Retrieval, 3DV 2020 (Oral)
- Yue Zhong, Yulia Gryaditskaya, Honggang Zhang, Yi-Zhe Song, Deep Sketch-Based Modelling: Tips and Tricks, 3DV 2020
- Guoyao Su, Yonggang Qi, Kaiyue Pang , Jie Yang, Yi-Zhe Song, SketchHealer: A Graph-to-Sequence Network for Recreating Partial Human Sketches, BMVC 2020 (Oral)
- Aneeshan Sain, Ayan Kumar Bhunia, Yongxin Yang, Tao Xiang, Yi-Zhe Song, Cross-Modal Hierarchical Modelling for Fine-Grained Sketch Based Image Retrieval, BMVC 2020 (Oral).
- Ayan Kumar Bhunia*, Ayan Das*, Umar Riaz Muhammad*, Yongxin Yang, Timothy M. Hospedalis, Tao Xiang, Yulia Gryaditskaya, Yi-Zhe Song . Pixelor: A Competitive Sketching AI Agent. So you think you can beat me? SIGGRAPH Asia 2020.
- Ayan Das, Yongxin Yang, Timothy Hospedales, Tao Xiang, Yi-Zhe Song, BézierSketch: A generative model for scalable vector sketches, ECCV 2020
- Jianshu Zhang, Jun Du, Yongxin Yang, Yi-Zhe Song, Si Wei, Lirong Dai, A Tree-Structured Decoder for Image-to-Markup Generation, ICML 2020
- Kaiyue Pang, Yongxin Yang, Timothy Hospedales, Tao Xiang, Yi-Zhe Song, Solving Mixed-modal Jigsaw Puzzle for Fine-Grained Sketch-Based Image Retrieval, CVPR 2020
- Ayan Kumar Bhunia, Yongxin Yang, Timothy Hospedales, Tao Xiang, Yi-Zhe Song, Sketch Less for More: On-the-Fly Fine-Grained Sketch Based Image Retrieval, CVPR 2020 (Oral)
- Z. Lu, Y. Yang, X. Zhu, C. Liu, Y. Song and T. Xiang, "Stochastic Classifiers for Unsupervised Domain Adaptation", CVPR 2020
- Yu, Qian, Song, Jifei, Song, Yi-Zhe, Xiang, Tao and Hospedales, Timothy M. (2020) Fine-Grained Instance-Level Sketch-Based Image Retrieval, International Journal of Computer Vision.
- Dongliang Chang, Yifeng Ding, Jiyang Xie, Ayan Kumar Bhunia, Xiaoxu Li, Zhanyu Ma, Ming Wu, Jun Guo, Yi-Zhe Song, The Devil is in the Channels: Mutual-Channel Loss for Fine-grained Image Classification, IEEE Transactions on Image Processing
- Conghui Hu, Da Li, Yongxin Yang, Timothy M. Hospedales, Yi-Zhe Song, Sketch-a-Segmenter: Sketch-Based Photo Segmenter Generation. IEEE Transactions on Image Processing
- Yue Zhong, Yonggang Qi, Yulia Gryaditskaya, Honggang Zhang and Yi-Zhe Song,Towards Practical Sketch-based 3D ShapeGeneration: The Role of Professional Sketches IEEE Transactions on Circuits and Systems for Video Technology.
- Yu, Deng, Li, Lei, Zheng, Youyi, Lau, Manfred, Song, Yi-Zhe, Tai, Chiew-Lan and Fu, Hongbo (2020) SketchDesc: Learning Local Sketch Descriptors for Multi-view Correspondence IEEE Transactions on Circuits and Systems for Video Technology.
- Xu, Peng, Liu, Kun, Xiang, Tao, Hospedales, Timothy M., Ma, Zhanyu, Guo, Jun and Song, Yi-Zhe (2020) Fine-Grained Instance-Level Sketch-Based Video Retrieval IEEE Transactions on Circuits and Systems for Video Technology.
- Xu, Peng, Song, Zeyu, Yin, Qiyue, Song, Yi-Zhe and Wang, Liang (2020) Deep Self-Supervised Representation Learning for Free-Hand Sketch IEEE Transactions on Circuits and Systems for Video Technology.
- Jianjun Lei, Yuxin Song, Bo Peng, Zhanyu Ma, Ling Shao, Yi-Zhe Song, Semi-Heterogeneous Three-Way Joint Embedding Network for Sketch-Based Image Retrieval, IEEE Transactions on Circuits and Systems for Video Technology
- Peng Xu, Yongye Huang, Tongtong Yuan, Tao Xiang, Timothy M. Hospedales, Yi-Zhe Song and Liang Wang, On Learning Semantic Representations for Large-Scale Abstract Sketches, IEEE Transactions on Circuits and Systems for Video Technology
- Jianshu Zhang, Jun Du, Yongxin Yang, Yi-Zhe Song, Lirong Dai, SRD: A Tree Structure Based Decoder for Online Handwritten Mathematical Expression Recognition, IEEE Transactions on Multimedia
2019
- Da Li, Jianshu Zhang, Yongxin Yang, Cong Liu, Yi-Zhe Song, Timothy Hospedales, Episodic Training for Domain Generalization, International Conference on Computer Vision (ICCV 2019, Oral)
- Umar Riaz Muhammad, Yongxin Yang, Timothy Hospedales, Tao Xiang, Yi-Zhe Song, Goal-Driven Sequential Data Abstraction, International Conference on Computer Vision (ICCV 2019)
- Kaiyue Pang, Ke Li, Yongxin Yang, Timothy Hospedales, Tao Xiang, Yi-Zhe Song, Generalising Fine-Grained Sketch-Based Image Retrieval, IEEE Conference on Computer Vision and Pattern Recognition (CVPR 2019)
- Jifei Song, Yongxin Yang, Yi-Zhe Song, Tao Xiang, Timothy Hospedales, Generalizable Person Re-identification by Domain-Invariant Mapping Network, IEEE Conference on Computer Vision and Pattern Recognition (CVPR 2019)
- Sounak Dey, Pau Riba, Anjan Dutta, Josep Llados, Yi-Zhe Song, Doodle to Search: Practical Zero-Shot Sketch-based Image Retrieval, IEEE Conference on Computer Vision and Pattern Recognition (CVPR 2019, Oral)
- K. Li, K. Pang, Y. Song, T. Xiang, T. M. Hospedales, H. Zhang, Towards A Deep Universal Sketch Perceptual Grouper, IEEE Transactions on Image Processing IEEE Transactions on Image Processing
- Zhanyu Ma, Yuping Lai, W. Bastiaan Kleijn, Yi-Zhe Song, Liang Wang, Jun Guo, Variational Bayesian Learning for Dirichlet Process Mixture of Inverted Dirichlet Distributions in Non-Gaussian Image Feature Modeling, IEEE Transactions on Neural Networks Learning Systems
- Yonggang Qi, Yi-Zhe Song, Sketch Fewer to Recognize More by Learning A Co-regularized Sparse Representation, IEEE Transactions on Circuits and Systems for Video Technology
2018
- Kaiyue Pang, Da Li, Jifei Song, Yi-Zhe Song, Tao Xiang, Timothy Hospedales, Deep Factorised Inverse-Sketching, European Conference on Computer Vision (ECCV 2018)
- Changqing Zou*, Qian Yu*, Ruofei Du, Haoran Mo, Yi-Zhe Song, Tao Xiang, Chengying Gao, Baoquan Chen, and Hao Zhang, SketchyScene: Richly-Annotated Scene Sketches, European Conference on Computer Vision (ECCV 2018)
- Ke Li, Kaiyue Pang, Jifei Song, Yi-Zhe Song, Tao Xiang, Timothy Hospedales, Universal Sketch Perceptual Grouping, European Conference on Computer Vision (ECCV 2018)
- Jifei Song, Kaiyue Pang, Yi-Zhe Song, Tao Xiang, Tim Hospedales, Learning to Sketch with Shortcut Cycle Consistency, IEEE Conference on Computer Vision and Pattern Recognition (CVPR 2018)
- Conghui Hu, Da Li, Yi-Zhe Song, Tao Xiang, Tim Hospedales, Sketch-a-Classifier: Sketch-based Photo Classifier Generation, IEEE Conference on Computer Vision and Pattern Recognition (CVPR 2018)
- Umar Muhammad, Yongxin Yang, Yi-Zhe Song, Tao Xiang, Tim Hospedales, Learning Deep Sketch Abstraction, IEEE Conference on Computer Vision and Pattern Recognition (CVPR 2018)
- Peng Xu, Yongye Huang, Tongtong Yuan, Kaiyue Pang, Yi-Zhe Song, Tao Xiang, Tim Hospedales, Zhanyu Ma, Jun Guo, SketchMate: Deep Hashing for Million-Scale Human Sketch Retrieval, IEEE Conference on Computer Vision and Pattern Recognition (CVPR 2018)
- Da Li, Yongxin Yang, Yi-Zhe Song and Timothy M. Hospedales, Learning to Generalize: Meta-Learning for Domain Generalization, AAAI Conference on Artificial Intelligence (AAAI 2018)
L Pang, Y Wang, YZ Song, T Huang, Y Tian, Cross-Domain Adversarial Feature Learning for Sketch Re-identification, ACM Multimedia Conference on Multimedia (ACM MM 2018)
2017
- Da Li, Yongxin Yang, Yi-Zhe Song and Timothy M. Hospedales, Deeper, Broader and Artier Domain Generalization, International Conference on Computer Vision (ICCV 2017)
- Jifei Song∗, Qian Yu∗, Yi-Zhe Song, Tao Xiang and Timothy M. Hospedales, Deep Spatial-Semantic Attention for Fine-Grained Sketch-Based Image Retrieval, International Conference on Computer Vision (ICCV 2017) (* Equal Contribution)
- Kaiyue Pang, Yi-Zhe Song, Tao Xiang and Timothy M. Hospedales, Cross-domain Generative Learning for Fine-Grained Sketch-Based Image Retrieval, British Machine Vision Conference (BMVC 2017), Poster
- Conghui Hu, Da Li, Yi-Zhe Song and Timothy M. Hospedales, Now You See Me: Deep Face Hallucination for Unviewed Sketches, British Machine Vision Conference (BMVC 2017), Oral
- Jifei Song, Yi-Zhe Song, Tao Xiang and Timothy M. Hospedales, Fine-Grained Image Retrieval: the Text/Sketch Input Dilemma, British Machine Vision Conference (BMVC 2017), Poster
- Ke Li, Kaiyue Pang, Yi-Zhe Song, Timothy M. Hospedales, Tao Xiang, Honggang Zhang, Synergistic Instance-Level Subspace Alignment for Fine-Grained Sketch-based Image Retrieval, IEEE Transactions on Image Processing (IEEE TIP)
2016
- S Ouyang, T Hospedales, YZ Song, X Li, CC Loy, X Wang, A survey on heterogeneous face recognition: Sketch, infra-red, 3D and low-resolution, Image and Vision Computing
- Y. Li, Y-Z. Song, T. Hospedales and S. Gong, Free-hand sketch synthesis with deformable stroke models, International Journal of Computer Vision (IJCV)
- Qian Yu, Feng Liu, Yi-Zhe Song, Tao Xiang, Timothy M. Hospedales, Chen Change Loy, Sketch Me That Shoe, IEEE Conference on Computer Vision and Pattern Recognition (CVPR 2016, Oral)
- Shuxin Ouyang, Timothy M. Hospedales, Yi-Zhe Song and Xueming Li, ForgetMeNot: Memory-Aware Forensic Facial Sketch Matching, IEEE Conference on Computer Vision and Pattern Recognition (CVPR 2016, Spotlight)
- J. Song, Y-Z. Song, T. Xiang, T. Hospedales and X. Ruan, Deep Multi-task Attribute-driven Ranking for Fine-grained Sketch-based Image Retrieval, British Machine Vision Conference (BMVC 2016, Oral)
- Q. Yu, Y. Yang, F. Liu, Y-Z. Song, T. Xiang and T. Hospedales, Sketch-a-Net: a Deep Neural Network that Beats Humans, International Journal of Computer Vision (IJCV)
- Ke Li, Kaiyue Pang, Yi-Zhe Song, Timothy Hospedales, Honggang Zhang and Yichuan Hu, Fine-Grained Sketch-Based Image Retrieval: The Role of Part-Aware Attributes, IEEE Winter Conference on Applications of Computer Vision (WACV 2016)
- Yonggang Qi, Yi-Zhe Song, Honggang Zhang, Jun Liu, Sketch-Based Image Retrieval via Siamese Convolutional Neural Network, IEEE International Conference on Image Processing (ICIP 2016)
2015
- Q. Yu, Y. Yang, Y-Z. Song, T. Xiang and T. Hospedales, Sketch-a-Net that Beats Humans, British Machine Vision Conference (BMVC 2015, Best Paper Award)
- Yonggang Qi, Yi-Zhe Song, Tao Xiang, Honggang Zhang, Timothy Hospedales, Yi Li and Jun Guo, Making Better Use of Edges via Perceptual Grouping, IEEE Conference on Computer Vision and Pattern Recognition (CVPR 2015)
- Yi Li, Timothy M. Hospedales, Yi-Zhe Song and Shaogang Gong, Free-hand Sketch Recognition by Multi-Kernel Feature Learning, Computer Vision and Image Understanding (CVIU)
- Yonggang Qi, Jun Guo, Yi-Zhe Song, Tao Xiang, Honggang Zhang, Zheng-Hua Tan, Im2Sketch: Sketch generation by unconflicted perceptual grouping, Neurocomputing
2014
- S. Ouyang, T. Hospedales, Y.-Z. Song and X. Li, Cross-Modal Face Matching: Beyond Viewed Sketches, Asian Conference on Computer Vision (ACCV 2014)
- S. Ouyang, T. Hospedales, Y.-Z. Song and X. Li, A Survey on Heterogeneous Face Recognition: Sketch, Infra-red, 3D and Low-resolution, Image and Vision Computing (IVC)
- Y. Li, T. Hospedales, Y.-Z. Song and S. Gong, Fine-grained sketch-based image retrieval by matching deformable part models, British Machine Vision Conference (BMVC 2014)
2013
- Yonggang Qi, Jun Guo, Yi Li, Honggang Zhang, Tao Xiang, Yi-Zhe Song, Sketching by perceptual grouping, IEEE International Conference on Image Processing (ICIP 2013)
- Yi Li, T. Hospedales, Yi-Zhe Song, Shaogang Gong, Sketch Recognition by Ensemble Matching of Structured Features, British Machine Vision Conference (BMVC 2013)
- Yi-Zhe Song, David Pickup, Chuan Li, Paul Rosin, Peter S Hall, Abstract art by shape classification, IEEE Transactions on Visualization and Computer Graphics (IEEE TVCG)