Tui Bui

Tu Bui


Postgraduate Research Student

Academic and research departments

Centre for Vision, Speech and Signal Processing (CVSSP).

My publications

Publications

Bui Tu, Ribeiro L, Ponti M, Collomosse John (2017) Compact Descriptors for Sketch-based Image Retrieval using a Triplet loss Convolutional Neural Network, Computer Vision and Image Understanding 164 pp. 27-37 Elsevier
We present an efficient representation for sketch based image retrieval (SBIR) derived from a triplet loss convolutional neural network (CNN). We treat SBIR as a cross-domain modelling problem, in which a depiction invariant embedding of sketch and photo data is learned by regression over a siamese CNN architecture with half-shared weights and modified triplet loss function. Uniquely, we demonstrate the ability of our learned image descriptor to generalise beyond the categories of object present in our training data, forming a basis for general cross-category SBIR. We explore appropriate strategies for training, and for deriving a compact image descriptor from the learned representation suitable for indexing data on resource constrained e. g. mobile devices. We show the learned descriptors to outperform state of the art SBIR on the defacto standard Flickr15k dataset using a significantly more compact (56 bits per image, i. e. H 105KB total) search index than previous methods.