Professor Adrian Hilton

Head of the Centre for Vision, Speech and Signal Processing (CVSSP)

Email:
Phone: Work: 01483 68 3956
Room no: 33 AB 05

Further information

Biography

Further details can be found on my personal web page.

Publications

Highlights

  • Budd C, Huang P, Klaudiny M, Hilton A. (2013) 'Global non-rigid alignment of surface sequences'. International Journal of Computer Vision, 102 (1-3), pp. 256-270.
    doi: 10.1007/s11263-012-0553-4
  • Kim H, Hilton A. (2013) '3D Scene Reconstruction from Multiple Spherical Stereo Pairs'. International Journal of Computer Vision, , pp. 1-23.
    doi: 10.1007/s11263-013-0616-1
  • Budd C, Huang P, Klaudiny M, Hilton A. (2012) 'Global Non-rigid Alignment of Surface Sequences'. International Journal of Computer Vision, , pp. 1-15.
    doi: 10.1007/s11263-012-0553-4
    Full text is available at: http://epubs.surrey.ac.uk/754122/

    Abstract

    This paper presents a general approach based on the shape similarity tree for non-sequential alignment across databases of multiple unstructured mesh sequences from non-rigid surface capture. The optimal shape similarity tree for non-rigid alignment is defined as the minimum spanning tree in shape similarity space. Non-sequential alignment based on the shape similarity tree minimises the total non-rigid deformation required to register all frames in a database into a consistent mesh structure with surfaces in correspondence. This allows alignment across multiple sequences of different motions, reduces drift in sequential alignment and is robust to rapid non-rigid motion. Evaluation is performed on three benchmark databases of 3D mesh sequences with a variety of complex human and cloth motion. Comparison with sequential alignment demonstrates reduced errors due to drift and improved robustness to large non-rigid deformation, together with global alignment across multiple sequences which is not possible with previous sequential approaches. © 2012 The Author(s).

  • Moeslund TB, Hilton A, Krüger V, Sigal L. (2011) Visual Analysis of Humans: Looking at People. Springer-Verlag New York Inc
  • Hilton ADM, Guillemaut J-Y, Kilner JJ, Grau O, Thomas G. (2011) '3D-TV Production from Conventional Cameras for Sports Broadcast'. IEEE IEEE Transactions Broadcasting, 57 (2), pp. 462-476.
    doi: 10.1109/TBC.2011.2131870
  • Guillemaut J-Y, Hilton A. (2011) 'Joint Multi-Layer Segmentation and Reconstruction for Free-Viewpoint Video Applications'. Springer International Journal of Computer Vision, 93 (1), pp. 73-100.
    doi: 10.1007/s11263-010-0413-z
    Full text is available at: http://epubs.surrey.ac.uk/110829/
  • Huang P, Hilton A, Starck J. (2010) 'Shape Similarity for 3D Video Sequences of People'. Springer International Journal of Computer Vision, 89 (2-3), pp. 362-381.
    doi: 10.1007/s11263-010-0319-9
  • Hilton A, Guillemaut J, Kilner J, Grau O, Thomas G. (2010) Free-Viewpoint Video for TV Sport Production. in Ronfard R, Taubin G (eds.) Image and Geometry Processing for 3-D Cinematography Springer 5
    doi: 10.1007/978-3-642-12392-4_4

Journal articles

  • Budd C, Huang P, Klaudiny M, Hilton A. (2013) 'Global non-rigid alignment of surface sequences'. International Journal of Computer Vision, 102 (1-3), pp. 256-270.
    doi: 10.1007/s11263-012-0553-4
  • Kim H, Hilton A. (2013) '3D Scene Reconstruction from Multiple Spherical Stereo Pairs'. International Journal of Computer Vision, , pp. 1-23.
    doi: 10.1007/s11263-013-0616-1
  • Kim H, Guillemaut J-Y, Takai T, Sarim M, Hilton A. (2012) 'Outdoor Dynamic 3D Scene Reconstruction'. IEEE IEEE Transactions on Circuits and Systems for Video Technology, 22 (11), pp. 1611-1622.
    doi: 10.1109/TCSVT.2012.2202185
  • Budd C, Huang P, Klaudiny M, Hilton A. (2012) 'Global Non-rigid Alignment of Surface Sequences'. International Journal of Computer Vision, , pp. 1-15.
    doi: 10.1007/s11263-012-0553-4
    Full text is available at: http://epubs.surrey.ac.uk/754122/

    Abstract

    This paper presents a general approach based on the shape similarity tree for non-sequential alignment across databases of multiple unstructured mesh sequences from non-rigid surface capture. The optimal shape similarity tree for non-rigid alignment is defined as the minimum spanning tree in shape similarity space. Non-sequential alignment based on the shape similarity tree minimises the total non-rigid deformation required to register all frames in a database into a consistent mesh structure with surfaces in correspondence. This allows alignment across multiple sequences of different motions, reduces drift in sequential alignment and is robust to rapid non-rigid motion. Evaluation is performed on three benchmark databases of 3D mesh sequences with a variety of complex human and cloth motion. Comparison with sequential alignment demonstrates reduced errors due to drift and improved robustness to large non-rigid deformation, together with global alignment across multiple sequences which is not possible with previous sequential approaches. © 2012 The Author(s).

  • Klaudiny M, Hilton A. (2012) 'High-detail 3D capture and non-sequential alignment of facial performance'. Proceedings - 2nd Joint 3DIM/3DPVT Conference: 3D Imaging, Modeling, Processing, Visualization and Transmission, 3DIMPVT 2012, , pp. 17-24.
    doi: 10.1109/3DIMPVT.2012.67
  • Hilton ADM, Guillemaut J-Y, Kilner JJ, Grau O, Thomas G. (2011) '3D-TV Production from Conventional Cameras for Sports Broadcast'. IEEE IEEE Transactions Broadcasting, 57 (2), pp. 462-476.
    doi: 10.1109/TBC.2011.2131870
  • Hilton A, Godin G, Shu C, Masuda T. (2011) 'Special issue on 3D imaging and modelling'. ACADEMIC PRESS INC ELSEVIER SCIENCE COMPUTER VISION AND IMAGE UNDERSTANDING, 115 (5), pp. 559-560.
    doi: 10.1016/j.cviu.2011.02.005
  • Sarim M, Hilton A, Guillemaut J-Y. (2011) 'Temporal trimap propagation for video matting using inferential statistics'. Proceedings - International Conference on Image Processing, ICIP, , pp. 1745-1748.
    doi: 10.1109/ICIP.2011.6115797
  • Guillemaut J-Y, Hilton A. (2011) 'Joint Multi-Layer Segmentation and Reconstruction for Free-Viewpoint Video Applications'. Springer International Journal of Computer Vision, 93 (1), pp. 73-100.
    doi: 10.1007/s11263-010-0413-z
    Full text is available at: http://epubs.surrey.ac.uk/110829/
  • Huang P, Hilton A, Starck J. (2010) 'Shape Similarity for 3D Video Sequences of People'. Springer International Journal of Computer Vision, 89 (2-3), pp. 362-381.
    doi: 10.1007/s11263-010-0319-9
  • Edge JD, Hilton A, Jackson PJB. (2009) 'Model-based synthesis of visual speech movements from 3D video'. Hindawi Publishing Corporation EURASIP Journal on Audio, Speech, and Music Processing, 2009 Article number 597267 , pp. 12-12.
    doi: 10.1155/2009/597267
    Full text is available at: http://epubs.surrey.ac.uk/7693/

    Abstract

    In this paper we describe a method for the synthesis of visual speech movements using a hybrid unit selection/model-based approach. Speech lip movements are captured using a 3D stereo face capture system, and split up into phonetic units. A dynamic parameterisation of this data is constructed which maintains the relationship between lip shapes and velocities; within this parameterisation a model of how lips move is built and is used in the animation of visual speech movements from speech audio input. The mapping from audio parameters to lip movements is disambiguated by selecting only the most similar stored phonetic units to the target utterance during synthesis. By combining properties of model-based synthesis (e.g. HMMs, neural nets) with unit selection we improve the quality of our speech synthesis.

  • Starck J, Maki A, Nobuhara S, Hilton A, Matsuyama T. (2009) 'The Multiple-Camera 3-D Production Studio'. IEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC IEEE TRANSACTIONS ON CIRCUITS AND SYSTEMS FOR VIDEO TECHNOLOGY, 19 (6), pp. 856-869.
    doi: 10.1109/TCSVT.2009.2017406
    Full text is available at: http://epubs.surrey.ac.uk/111057/
  • Kilner J, Starck J, Guillemaut JY, Hilton A. (2009) 'Objective Quality Assessment in Free-viewpoint Video Production'. Elsevier Signal Processing: Image Communication, 24 (1-2), pp. 3-16.
    doi: 10.1109/3DTV.2008.4547849
    Full text is available at: http://epubs.surrey.ac.uk/111022/
  • Starck J, Kilner J, Hilton A. (2009) 'Free-viewpoint Video Render'. Journal of Graphics Tools,
    doi: 10.1080/2151237X.2009.10129284
  • Starck J, Hilton A. (2008) 'Model-based human shape reconstruction from multiple views'. Elsevier Computer Vision and Image Understanding, 111 (2), pp. 179-194.
    doi: 10.1016/j.cviu.2007.10.001
    Full text is available at: http://epubs.surrey.ac.uk/111012/

    Abstract

    Image-based modelling allows the reconstruction of highly realistic digital models from real-world objects. This paper presents a model-based approach to recover animated models of people from multipleview video images. Two contributions are made, a multiple resolution model-based framework is introduced that combines multiple visual cues in reconstruction. Second, a novel mesh parameterisation is presented to preserve the vertex parameterisation in the model for animation. A prior humanoid surface model is first decomposed into multiple levels of detail and represented as a hierarchical deformable model for image fitting. A novel mesh parameterisation is presented that allows propagation of deformation in the model hierarchy and regularisation of surface deformation to preserve vertex parameterisation and animation structure. The hierarchical model is then used to fuse multipleshape cues from silhouette, stereo and sparse feature data in a coarse-to-fine strategy to recover a model that reproduces the appearance in the images. The framework is compared to physics-based deformable surface fitting at a single resolution, demonstrating an improved reconstruction accuracy against ground-truth data with a reduced model distortion. Results demonstrate realistic modelling of real people with accurate shape and appearance while preserving model structure for use in animation.

  • Starck J, Hilton A. (2007) 'Surface Capture for Performance-Based Animation'. IEEE IEEE Computer Graphics and Applications, 27 (3), pp. 21-31.
    doi: 10.1109/MCG.2007.68
    Full text is available at: http://epubs.surrey.ac.uk/111050/
  • Grau O, Hilton A, Kilner J, Miller G, Sargeant T, Starck J. (2007) 'A Free-Viewpoint Video System for Visualisation of Sports Scenes'. SMPTE Motion Imaging Journal, 116 Article number 5-6 , pp. 213-219-213-219.
  • Ong E-J, Hilton A. (2006) 'Learnt Inverse Kinematics for Animation Synthesis'. Elsevier Graphical Models, 68 Article number 5-6 , pp. 472-483.
    doi: 10.1016/j.gmod.2006.07.004
  • Moeslund T, Hilton A, Kruger V. (2006) 'A Survey of Advances in Vision-Based Human Motion Capture and Analysis'. Computer Vision and Image Understanding, 104 Article number 2-3 , pp. 90---127-90---127.
  • Kilner JJ, Starck JR, Hilton A. (2006) 'A Comparative Study of Free Viewpoint Video Techniques for Sports Events'. IET IET European Conference on Visual Media Production, , pp. 87-96.
    Full text is available at: http://epubs.surrey.ac.uk/110192/
  • Hilton A, Fua P, Ronfard R. (2006) 'Vision-based Understanding of a Person�s Shape, Appearance, Movement and Behaviour'. Computer Vision and Image Understanding - Special Issue on Modelling People, 104 Article number 2-3 , pp. 87---90-87---90.
  • Grau O, Hilton A, Kilner J, Miller G, Sargeant T, Starck J. (2006) 'A Free-Viewpoint Video System for Visualisation of Sports Scenes'. International Broadcast Convention, September
    Full text is available at: http://epubs.surrey.ac.uk/110194/
  • Csakany P, Hilton A. (2006) 'Relighting of Dynamic Video'. Academy Publisher Journal of Multimedia, 1 (3), pp. 23-30.
    Full text is available at: http://epubs.surrey.ac.uk/111039/
  • Starck J, Hilton A. (2005) 'Virtual View Synthesis of People from Multiple View Video'. Elsevier Graphical Models, 67 (6), pp. 600-620.
    doi: 10.1016/j.gmod.2005.01.008
    Full text is available at: http://epubs.surrey.ac.uk/111065/

    Abstract

    This paper addresses the synthesis of virtual views of people from multiple view image sequences. We consider the target area of the multiple camera “3D Virtual Studio” with the ultimate goal of capturing video-realistic dynamic human appearance. A mesh based reconstruction framework is introduced to initialise and optimise the shape of a dynamic scene for view-dependent rendering, making use of silhouette and stereo data as complementary shape cues. The technique addresses two key problems: (1) robust shape reconstruction; and (2) accurate image correspondence for view dependent rendering in the presence of camera calibration error. We present results against ground truth data in synthetic test cases and for captured sequences of people in a studio. The framework demonstrates a higher resolution in rendering compared to shape from silhouette and multiple view stereo.

  • Hilton A, Kalkavouras K, Collins G. (2005) '3D Studio Production of Animated Actor Models'. Institution of Engineering and Technology IEE Proceedings of Vision, Image and Signal Processing, 152 Article number 4 , pp. 481-490.
    doi: 10.1049/ip-vis:20045114
    Full text is available at: http://epubs.surrey.ac.uk/754125/

    Abstract

    A framework for construction of detailed animated models of an actor's shape and appearance from multiple view images is presented. Multiple views of an actor are captured in a studio with controlled illumination and background. An initial low-resolution approximation of the person's shape is reconstructed by deformation of a generic humanoid model to fit the visual hull using shape constrained optimisation to preserve the surface parameterisation for animation. Stereo reconstruction with multiple view constraints is then used to reconstruct the detailed surface shape. High-resolution shape detail from stereo is represented in a structured format for animation by displacement mapping from the low-resolution model surface. A novel integration algorithm using displacement maps is introduced to combine overlapping stereo surface measurements from multiple views into a single displacement map representation of the high-resolution surface detail. Results of 3-D actor modelling in a 14 camera studio demonstrate improved representation of detailed surface shape such as creases in clothing compared to previous model fitting approaches. Actor models can be animated and rendered from arbitrary views under different illumination to produce free-viewpoint video sequences. The proposed framework enables rapid transformation of captured multiple view images into a structured representation suitable for realistic animation.

  • Manessis A, Hilton A. (2005) 'Scene Modelling from Sparse 3D Data'. Journal of Image and Vision Computing, 23 Article number 10 , pp. 900---920-900---920.
  • Starck J, Collins G, Smith R, Hilton A, Illingworth J. (2003) 'Animated Statues'. Springer Journal of Machine Vision Applications, 14 (4), pp. 248-259.
    doi: 10.1007/s00138-002-0080-3
    Full text is available at: http://epubs.surrey.ac.uk/110201/
  • Hilton A. (2003) 'Computer Vision for Human Modelling and Analysis'. Journal of Machine Vision Applications, 14 Article number 4 , pp. 206---209-206---209.
  • Li Y, Hilton A, Illingworth J. (2002) 'A relaxation algorithm for real-time multiple view 3D-tracking'. ELSEVIER SCIENCE BV IMAGE AND VISION COMPUTING, 20 (12) Article number PII S0262-8856(02)00094-X , pp. 841-859.
    doi: 10.1016/S0262-8856(02)00094-X
    Full text is available at: http://epubs.surrey.ac.uk/110195/
  • Roberts JB, Hilton ADM. (2001) 'A direct transform method for the analysis of laser Doppler anemometry engine data'. PROFESSIONAL ENGINEERING PUBLISHING LTD PROCEEDINGS OF THE INSTITUTION OF MECHANICAL ENGINEERS PART D-JOURNAL OF AUTOMOBILE ENGINEERING, 215 (D6), pp. 725-738.
    doi: 10.1243/0954407011528301
  • Collins G, Hilton A. (2001) 'Modelling for Character Animation'. Software Focus, Wiley, 2 Article number 2 , pp. 44-51-44-51.
  • Sun W, Hilton A, Smith R, Illingworth J. (2001) 'Layered Animation of Captured Data'. Springer Visual Computer: International Journal of Computer Graphics, 17 (8), pp. 457-474.
    doi: 10.1007/s003710100121458
    Full text is available at: http://epubs.surrey.ac.uk/110857/
  • Roberts JB, Hilton A. (2001) 'A Direct Transform Method for the Analysis of LDA Engine Data'. I.Mech.E. Journal of Automotive Engineering, 251 Article number D , pp. 725---738-725---738.
  • Hilton A, Fua P. (2001) 'Modeling people toward vision-based understanding of a person's shape, appearance, and movement'. Computer Vision and Image Understanding, 81 (3), pp. 227-230.
    doi: 10.1006/cviu.2001.0907
  • Hilton A, Beresford D, Gentils T, Smith R, Sun W, Illingworth J. (2000) 'Whole-body modelling of people from multi-view images to populate virtual worlds'. SPRINGER Visual Computer: International Journal of Computer Graphics, 16 (7), pp. 411-436.
    doi: 10.1007/PL00013395
    Full text is available at: http://epubs.surrey.ac.uk/111069/

    Abstract

    In this paper a new technique is introduced for automatically building recognisable, moving 3D models of individual people. A set of multiview colour images of a person is captured from the front, sides and back by one or more cameras. Model-based reconstruction of shape from silhouettes is used to transform a standard 3D generic humanoid model to approximate a person’s shape and anatomical structure. Realistic appearance is achieved by colour texture mapping from the multiview images. The results show the reconstruction of a realistic 3D facsimile of the person suitable for animation in a virtual world. The system is inexpensive and is reliable for large variations in shape, size and clothing. This is the first approach to achieve realistic model capture for clothed people and automatic reconstruction of animated models. A commercial system based on this approach has recently been used to capture thousands of models of the general public.

  • Hilton A, Illingworth J. (2000) 'Geometric Fusion for a Hand-held 3D Sensor'. Springer Machine Vision and Applications, 12 (1), pp. 44-51.
    doi: 10.1007/s001380050123
    Full text is available at: http://epubs.surrey.ac.uk/110650/
  • Hilton A, Stoddart AJ, Illingworth J, Windeatt T. (1998) 'Implicit Surface based Geometric Fusion'. Inderscience International Journal of Computer Vision and Image Understanding, 69 (3), pp. 273-291.
    Full text is available at: http://epubs.surrey.ac.uk/110765/
  • Stoddart AJ, Lemke S, Hilton A, Renn T. (1998) 'Estimating pose uncertainty for surface registration'. ELSEVIER SCIENCE BV IMAGE AND VISION COMPUTING, 16 (2), pp. 111-120.
    doi: 10.1016/S0262-8856(97)00059-0
  • Illingworth J, Hilton A. (1998) 'Looking to Build a Model World: Automatic Construction of Static Object Models using Computer Vision'. IEE Journal Electronics and Communications Engineering, 10 Article number 3 , pp. 103---113-103---113.
  • HILTON A, ILLINGWORTH J, WINDEATT T. (1995) 'STATISTICS OF SURFACE CURVATURE ESTIMATES'. PERGAMON-ELSEVIER SCIENCE LTD PATTERN RECOGNITION, 28 (8), pp. 1201-1221.
    doi: 10.1016/0031-3203(95)00002-H
  • Hilton A, Roberts JB, Hadded O. (1991) 'Autocorrelation Based Analysis of Ensemble Averaged LDA Engine Data for Bias-Free Turbulence Estimates: A Unified Approach'. Journal of the Society of Automotive Engineering SAE, 91 Article number 0479 , pp. 1---21-1---21.

Conference papers

  • Imre E, Guillemaut J-Y, Hilton A. (2012) 'Through-the-lens multi-camera synchronisation and frame-drop detection for 3D reconstruction'. Proceedings - 2nd Joint 3DIM/3DPVT Conference: 3D Imaging, Modeling, Processing, Visualization and Transmission, 3DIMPVT 2012, , pp. 395-402.
    doi: 10.1109/3DIMPVT.2012.31
  • Casas D, Tejera M, Guillemaut J-Y, Hilton A. (2012) '4D parametric motion graphs for interactive animation'. ACM I3D '12 Proceedings of the ACM SIGGRAPH Symposium on Interactive 3D Graphics and Games, Orange County, USA: I3D: Symposium on Interactive 3D Graphics and Games, pp. 103-110.
    doi: 10.1145/2159616.2159633
  • Budd C, Huang P, Hilton A. (2011) 'Hierarchical shape matching for temporally consistent 3D video'. Proceedings of International Conference on 3D Imaging, Modeling, Processing, Visualization and Transmission, Hangzhou, China: 3DIMPVT 2011, pp. 172-179.
    doi: 10.1109/3DIMPVT.2011.29
  • Huang P, Budd C, Hilton A. (2011) 'Global temporal registration of multiple non-rigid surface sequences'. IEEE Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition, Providence, RI: IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2011, pp. 3473-3480.
    doi: 10.1109/CVPR.2011.5995438
    Full text is available at: http://epubs.surrey.ac.uk/29209/

    Abstract

    In this paper we consider the problem of aligning multiple non-rigid surface mesh sequences into a single temporally consistent representation of the shape and motion. A global alignment graph structure is introduced which uses shape similarity to identify frames for inter-sequence registration. Graph optimisation is performed to minimise the total non-rigid deformation required to register the input sequences into a common structure. The resulting global alignment ensures that all input sequences are resampled with a common mesh structure which preserves the shape and temporal correspondence. Results demonstrate temporally consistent representation of several public databases of mesh sequences for multiple people performing a variety of motions with loose clothing and hair.

  • Imre E, Guillemaut J-Y, Hilton A. (2011) 'Calibration of nodal and free-moving cameras in dynamic scenes for post-production'. IEEE Proceedings - 2011 International Conference on 3D Imaging, Modeling, Processing, Visualization and Transmission, 3DIMPVT 2011, Hangzhou: International Conference on 3D Imaging, Modeling, Processing, Visualization and Transmission (3DIMPVT), pp. 260-267.
    doi: 10.1109/3DIMPVT.2011.40
    Full text is available at: http://epubs.surrey.ac.uk/110185/

    Abstract

    In film production, many post-production tasks require the availability of accurate camera calibration information. This paper presents an algorithm for through-the-lens calibration of a moving camera for a common scenario in film production and broadcasting: The camera views a dynamic scene, which is also viewed by a set of static cameras with known calibration. The proposed method involves the construction of a sparse scene model from the static cameras, with respect to which the moving camera is registered, by applying the appropriate perspective-n-point (PnP) solver. In addition to the general motion case, the algorithm can handle the nodal cameras with unknown focal length via a novel P2P algorithm. The approach can identify a subset of static cameras that are more likely to generate a high number of scene-image correspondences, and can robustly deal with dynamic scenes. Our target applications include dense 3D reconstruction, stereoscopic 3D rendering and 3D scene augmentation, through which the success of the algorithm is demonstrated experimentally.

  • Guillemaut J, Sarim M, Hilton A. (2010) 'Stereoscopic Content Production of Complex Dynamic Scenes Using a Wide-Baseline Monoscopic Camera Set-Up'. Hong Kong: Proc. International Conference on Image Processing (ICIP 2010), Special Session on Image Processing for Stereo Digital Cinema Production, pp. 9-12.
    doi: 10.1109/ICIP.2010.5652901
    Full text is available at: http://epubs.surrey.ac.uk/111048/

    Abstract

    Conventional stereoscopic video content production requires use of dedicated stereo camera rigs which is both costly and lacking video editing flexibility. In this paper, we propose a novel approach which only requires a small number of standard cameras sparsely located around a scene to automatically convert the monocular inputs into stereoscopic streams. The approach combines a probabilistic spatio-temporal segmentation framework with a state-of-the-art multi-view graph-cut reconstruction algorithm, thus providing full control of the stereoscopic settings at render time. Results with studio sequences of complex human motion demonstrate the suitability of the method for high quality stereoscopic content generation with minimum user interaction.

  • Imre HE, Guillemaut J-Y, Hilton ADM. (2010) 'Moving Camera Registration for Multiple Camera Setups in Dynamic Scenes'. Proceedings of the 21st British Machine Vision Conference, Aberystwyth, UK: BMVC 2010
    doi: 10.5244/C.24.38
    Full text is available at: http://epubs.surrey.ac.uk/111014/

    Abstract

    Many practical applications require an accurate knowledge of the extrinsic calibration (\ie, pose) of a moving camera. The existing SLAM and structure-from-motion solutions are not robust to scenes with large dynamic objects, and do not fully utilize the available information in the presence of static cameras, a common practical scenario. In this paper, we propose an algorithm that addresses both of these issues for a hybrid static-moving camera setup. The algorithm uses the static cameras to build a sparse 3D model of the scene, with respect to which the pose of the moving camera is estimated at each time instant. The performance of the algorithm is studied through extensive experiments that cover a wide range of applications, and is shown to be satisfactory.

  • Cosker D, Krumhuber E, Hilton A. (2010) 'Perception of Linear and Nonlinear Motion Properties using a FACS Validated 3D Facial Model'. ACM In Proc. of ACM Symposium on Applied Perception in Graphics and Visualisation (APGV), Los Angeles: ACM 7th Symposium on Applied Perception in Graphics and Visualization, pp. 101-108.
    doi: 10.1145/1836248.1836268
    Full text is available at: http://epubs.surrey.ac.uk/111024/

    Abstract

    In this paper we present the first Facial Action Coding System (FACS) valid model to be based on dynamic 3D scans of human faces for use in graphics and psychological research. The model consists of FACS Action Unit (AU) based parameters and has been independently validated by FACS experts. Using this model, we explore the perceptual differences between linear facial motions – represented by a linear blend shape approach – and real facial motions that have been synthesized through the 3D facial model. Through numerical measures and visualizations, we show that this latter type of motion is geometrically nonlinear in terms of its vertices. In experiments, we explore the perceptual benefits of nonlinear motion for different AUs. Our results are insightful for designers of animation systems both in the entertainment industry and in scientific research. They reveal a significant overall benefit to using captured nonlinear geometric vertex motion over linear blend shape motion. However, our findings suggest that not all motions need to be animated nonlinearly. The advantage may depend on the type of facial action being produced and the phase of the movement.

  • Kim H, Sarim M, Takai T, Guillemaut J-Y, Hilton A. (2010) 'Dynamic 3D Scene Reconstruction in Outdoor Environments'. IEEE In Proc. IEEE Symp. on 3D Data Processing and Visualization, France: 3DPVT
  • Sarim M, Hilton A, Guillemaut J, Kim H, Takai T. (2010) 'Multiple view wide-baseline trimap propagation for natural video matting'. IEEE Proc. European Conference on Visual Media Production (CVMP 2010), London, UK: European Conference on Visual Media Production (CVMP 2010), pp. 82-91.
    doi: 10.1109/CVMP.2010.18
  • Sarim M, Hilton A, Guillemaut J-Y, Kim H, Takai T. (2010) 'Wide-Baseline Multi-View Video Segmentation For 3D Reconstruction'. ACM Proceedings of the 1st international workshop on 3D video processing, Firenze, Italy: 3DVP 2010 Workshop: MM '10 ACM Multimedia Conference, pp. 13-16.
  • Sarim M, Hilton A, Guillemaut J-Y, Takai T, Kim H. (2010) 'NATURAL IMAGE MATTING FOR MULTIPLE WIDE-BASELINE VIEWS'. IEEE 2010 IEEE INTERNATIONAL CONFERENCE ON IMAGE PROCESSING, Hong Kong, PEOPLES R CHINA: IEEE International Conference on Image Processing, pp. 2233-2236.
    doi: 10.1109/ICIP.2010.5651610
  • Sarim M, Hilton A, Guillemaut J-Y. (2009) 'Wide-baseline matte propagation for indoor scenes'. CVMP 2009 - The 6th European Conference for Visual Media Production, , pp. 195-204.
    doi: 10.1109/CVMP.2009.6
  • Huang P, Hilton A, Starck J. (2009) 'Human Motion Synthesis from 3D Video'. IEEE Proceedings of IEEE Conference on Computer Vision and Pattern Recognition, Miami, USA: CVPR 2009, pp. 1478-1485.
    doi: 10.1109/CVPRW.2009.5206626
    Full text is available at: http://epubs.surrey.ac.uk/110720/

    Abstract

    Multiple view 3D video reconstruction of actor performance captures a level-of-detail for body and clothing movement which is time-consuming to produce using existing animation tools. In this paper we present a framework for concatenative synthesis from multiple 3D video sequences according to user constraints on movement, position and timing. Multiple 3D video sequences of an actor performing different movements are automatically constructed into a surface motion graph which represents the possible transitions with similar shape and motion between sequences without unnatural movement artifacts. Shape similarity over an adaptive temporal window is used to identify transitions between 3D video sequences. Novel 3D video sequences are synthesized by finding the optimal path in the surface motion graph between user specified key-frames for control of movement, location and timing. The optimal path which satisfies the user constraints whilst minimizing the total transition cost between 3D video sequences is found using integer linear programming. Results demonstrate that this framework allows flexible production of novel 3D video sequences which preserve the detailed dynamics of the captured movement for an actress with loose clothing and long hair without visible artifacts.

  • Sarim M, Guillemaut JY, Kim H, Hilton A. (2009) 'Wide-baseline Image Matting'. European Conference on Visual Media Production(CVMP),
  • Budd C, Hilton A. (2009) 'Skeleton Driven Volumetric Deformation'. ACM Symposium on Computer Animation,
  • Kim H, Hilton A. (2009) 'Environment Modelling using Spherical Stereo Imaging'. IEEE Symposium on 3D Imaging (3DIM),
  • Kilner JJ, Guillemaut J-Y, Hilton A. (2009) '3D Action Matching with Key-Pose Detection'. IEEE IEEE 12th International Conference on Computer Vision Workshops (ICCV Workshops), Kyoto, Japan: ICCV 2009, pp. 1-8.
    doi: 10.1109/ICCVW.2009.5457724
    Full text is available at: http://epubs.surrey.ac.uk/712564/

    Abstract

    This paper addresses the problem of human action matching in outdoor sports broadcast environments, by analysing 3D data from a recorded human activity and retrieving the most appropriate proxy action from a motion capture library. Typically pose recognition is carried out using images from a single camera, however this approach is sensitive to occlusions and restricted fields of view, both of which are common in the outdoor sports environment. This paper presents a novel technique for the automatic matching of human activities which operates on the 3D data available in a multi-camera broadcast environment. Shape is retrieved using multi-camera techniques to generate a 3D representation of the scene. Use of 3D data renders the system camera-pose-invariant and allows it to work while cameras are moving and zooming. By comparing the reconstructions to an appropriate 3D library, action matching can be achieved in the presence of significant calibration and matting errors which cause traditional pose detection schemes to fail. An appropriate feature descriptor and distance metric are presented as well as a technique to use these features for key-pose detection and action matching. The technique is then applied to real footage captured at an outdoor sporting event

  • Guillemaut J-Y, Kilner J, Hilton A. (2009) 'Robust Graph-Cut Scene Segmentation and Reconstruction for Free-Viewpoint Video of Complex Dynamic Scenes'. IEEE IEEE Int.Conf. on Computer Vision, ICCV, 12th International Conference on Computer Vision, 2009 IEEE, pp. 809-816.
    doi: 10.1109/ICCV.2009.5459299
    Full text is available at: http://epubs.surrey.ac.uk/111041/
  • Kim H, Hilton A. (2009) 'Graph-based Foreground Extraction in Extended Colour Space'. Int.Conf.Image Processing (ICIP),
  • Kilner JJ, Guillemaut J-Y, Hilton A. (2009) 'Summarised Hierarchical Markov Models for Speed Invariant Action Matching.'. ICCV Workshop on Tracking Humans for the Evaluation of their Motion in Image Sequences, , pp. 1065-1072.
    doi: 10.1109/ICCVW.2009.5457584
    Full text is available at: http://epubs.surrey.ac.uk/111049/

    Abstract

    Action matching, where a recorded sequence is matched against, and synchronised with, a suitable proxy from a library of animations, is a technique for generating a synthetic representation of a recorded human activity. This proxy can then be used to represent the action in a virtual environment or as a prior on further processing of the sequence. In this paper we present a novel technique for performing action matching in outdoor sports environments. Outdoor sports broadcasts are typically multi-camera environments and as such reconstruction techniques can be applied to the footage to generate a 3D model of the scene. However due to poor calibration and matting this reconstruction is of a very low quality. Our technique matches the 3D reconstruction sequence against a predefined library of actions to select an appropriate high quality synthetic representation. A hierarchical Markov model combined with 3D summarisation of the data allows a large number of different actions to be matched successfully to the sequence in a rate-invariant manner without prior segmentation of the sequence into discrete units. The technique is applied to data captured at rugby and soccer games.

  • Gkalelis N, Kim H, Hilton A, Nikolaidis N, Pitas I. (2009) 'The i3DPost multi-view and 3D human action/interaction'. London: CVMP (Conference for Visual Media Production)
  • Sarim M, Hilton A, Guillemaut J. (2009) 'Non-parametric patch based video matting'. British Machine Vision Association London, UK: Proc. British Machine Vision Conference (BMVC 2009)
    Full text is available at: http://epubs.surrey.ac.uk/111020/

    Abstract

    In computer vision, matting is the process of accurate foreground estimation in images and videos. In this paper we presents a novel patch based approach to video matting relying on non-parametric statistics to represent image variations in appearance. This overcomes the limitation of parametric algorithms which only rely on strong colour correlation between the nearby pixels. Initially we construct a clean background by utilising the foreground object’s movement across the background. For a given frame, a trimap is constructed using the background and the last frame’s trimap. A patch-based approach is used to estimate the foreground colour for every unknown pixel and finally the alpha matte is extracted. Quantitative evaluation shows that the technique performs better, in terms of the accuracy and the required user interaction, than the current state-of-the-art parametric approaches.

  • Budd C, Hilton A. (2009) 'Skeleton Driven Volumetric Laplacian Deformation'. European Conference on Visual Media Production,
  • Huang P, Hilton A. (2009) 'Surface Motion Graphs for Animation from 3D Video'. ACM ACM SIGGRAPH (Talk), New Orleans: ACM SIGGRAPH 2009
    doi: 10.1145/1597990.1598046
    Full text is available at: http://epubs.surrey.ac.uk/111052/
  • Edge J, Hilton A, Jackson P. (2008) 'Parameterisation of Speech Lip Movements'. Proceedings of International Conference on Auditory-visual Speech Processing, Tangalooma, Australia: AVSP
  • Stroia-Williams P, Hilton A. (2008) 'Example-based Reflectance Estimation for Capturing Relightable Models of People'. IEEE European Conference on Visual Media Production, , pp. 1-10.
    Full text is available at: http://epubs.surrey.ac.uk/110281/

    Abstract

    We present a new approach to reflectance estimation for dynamic scenes. Non-parametric image statistics are used to transfer reflectance properties from a static example set to a dynamic image sequence. The approach allows reflectance estimation for surface materials with inhomogeneous appearance, such as those which commonly occur with patterned or textured clothing. Material reflectance properties are initially estimated from static images of the subject under multiple directional illuminations using photometric stereo. The estimated reflectance together with the corresponding image under uniform ambient illumination form a prior set of reference material observations. Material reflectance properties are then estimated for video sequences of a moving person captured under uniform ambient illumination by matching the observed local image statistics to the reference observations. Results demonstrate that the transfer of reflectance properties enables estimation of the dynamic surface normals and subsequent relighting. This approach overcomes limitations of previous work on material transfer and relighting of dynamic scenes which was limited to surfaces with regions of homogeneous reflectance. We evaluate for relighting 3D model sequences reconstructed from multiple view video. Comparison to previous model relighting demonstrates improved reproduction of detailed texture and shape dynamics.

  • Kim H, Hilton A. (2008) 'Region-based Foreground Extraction'. Curran Associates European Conference on Visual Media Production, London: European Conference on Visual Media Production
    Full text is available at: http://epubs.surrey.ac.uk/111036/

    Abstract

    We propose a region-based method to extract foreground regions from colour video sequences. The foreground region is decided by voting with scores from background subtraction to the sub-regions by graph- based segmentation. Experiments show that the proposed algorithm improves on conventional approaches especially in strong shadow regions.

  • Huang P, Hilton A, Starck J. (2008) 'Automatic 3D Video Summarization: Key Frame Extraction from Self-Similarity'. Proceedings of 3DPVT'08 - the Fourth International Symposium on 3D Data Processing, Visualization and Transmission, Georgia Institute of Technology, Atlanta, GA, USA: Fourth International Symposium on 3D Data Processing, Visualization and Transmission, pp. 1-8.
    Full text is available at: http://epubs.surrey.ac.uk/29341/

    Abstract

    In this paper we present an automatic key frame selection method to summarise 3D video sequences. Key-frame selection is based on optimisation for the set of frames which give the best representation of the sequence according to a rate-distortion trade-off. Distortion of the summarization from the original sequence is based on measurement of self-similarity using volume histograms. The method evaluates the globally optimal set of key-frames to represent the entire sequence without requiring pre-segmentation of the sequence into shots or temporal correspondence. Results demonstrate that for 3D video sequences of people wearing a variety of clothing the summarization automatically selects a set of key-frames which represent the dynamics. Comparative evaluation of rate-distortion characteristics with previous 3D video summarization demonstrates improved performance.

  • Edge J, Hilton A. (2008) 'Parameterising Visual Speech Movements'. ACM SIGGRAPH/Eurographics Symposium on Computer Animation,
    Full text is available at: http://epubs.surrey.ac.uk/111023/
  • Doshi A, Hilton A, Starck J. (2008) 'An Empirical Study of Non-rigid Surface Feature Matching'. European Conference on Visual Media Production,
  • Starck J, Kilner J, Hilton A. (2008) 'Objective Quality Assessment in Free-viewpoint Video Production'. IEEE Conference on 3DTV, , pp. 1---8-1---8.
  • Csakany P, Vajda F, Hilton A. (2007) 'Recovering Refined Surface Normals for Relighting Clothing in Dynamic Scenes'. IET IET European Conference on Visual Media Production, , pp. 1---8-1---8.
    Full text is available at: http://epubs.surrey.ac.uk/111035/

    Abstract

    In this paper we present a method to relight captured 3D video sequences of non-rigid, dynamic scenes, such as clothing of real actors, reconstructed from multiple view video. A view-dependent approach is introduced to refine an initial coarse surface reconstruction using shape-from-shading to estimate detailed surface normals. The prior surface approximation is used to constrain the simultaneous estimation of surface normals and scene illumination, under the assumption of Lambertian surface reflectance. This approach enables detailed surface normals of a moving non-rigid object to be estimated from a single image frame. Refined normal estimates from multiple views are integrated into a single surface normal map. This approach allows highly non-rigid surfaces, such as creases in clothing, to be relit whilst preserving the detailed dynamics observed in video.

  • Huang P, Starck J, Hilton A. (2007) 'A Study of Shape Similarity for Temporal Surface Sequences of People'. IEEE IEEE Int.Conf. on 3D Imaging and Modeling, Sixth International Conference on 3-D Digital Imaging and Modeling, 2007. 3DIM '07., pp. 408-418.
    doi: 10.1109/3DIM.2007.8
    Full text is available at: http://epubs.surrey.ac.uk/110199/
  • Guillemaut J-Y, Kilner J, Starck J, Hilton A. (2007) 'Dynamic Feathering: Minimising Blending Artefacts in View Dependent Rendering'. IET European Conference on Visual Media Production, , pp. 1---8-1---8.
  • Edge JD, Hilton A. (2007) 'Facial Animation with Motion Capture based on Surface Blending'. International Conference on Computer Graphics Theory and Applications,
  • Nadtoka N, Tena JR, Hilton A, Edge J. (2007) 'High-resolution Animation of Facial Dynamics'. IET IET European Conference on Visual Media Production, London: 4th European Conference on Visual Media Production, 2007. IETCVMP., pp. 1---8-1---8.
    Full text is available at: http://epubs.surrey.ac.uk/29712/

    Abstract

    This paper presents a framework for performance-based animation and retargeting of high-resolution face models from motion capture. A novel method is introduced for learning a mapping between sparse 3D motion capture markers and dense high-resolution 3D scans of face shape and appearance. A high-resolution facial expression space is learnt from a set of 3D face scans as a person specific morphable model. Sparse 3D face points sampled at the motion capture marker positions are used to build a corresponding low-resolution expression space to represent the facial dynamics from motion capture. Radial basis function interpolation is used to automatically map the low-resolution motion capture of facial dynamics to the high-resolution facial expression space. This produces a high-resolution facial animation with the detailed shape and appearance of real facial dynamics. Retargeting is introduced to transfer facial expressions to a novel subject captured from a single photograph or 3D scan. The subject specific high- resolution expression space is mapped to the novel subject based on anatomical differences in face shape. Results facial animation and retargeting demonstrate realistic animation of expressions from motion capture.

  • Miller G, Hilton A. (2007) 'Safe Hulls'. IEEE IET European Conference on Visual Media Production, , pp. 1---8-1---8.
    Full text is available at: http://epubs.surrey.ac.uk/111042/

    Abstract

    The visual hull is widely used as a proxy for novel view synthesis in computer vision. This paper introduces the safe hull, the first visual hull reconstruction technique to produce a surface containing only foreground parts. A theoretical basis underlies this novel approach which, unlike any previous work, can also identify phantom volumes attached to real objects. Using an image-based method, the visual hull is constructed with respect to each real view and used to identify safe zones in the original silhouettes. The safe zones define volumes known to only contain surface corresponding to a real object. The zones are used in a second reconstruction step to produce a surface without phantom volumes. Results demonstrate the effectiveness of this method for improving surface shape and scene realism, and its advantages over heuristic techniques.

  • Kilner JJ, Starck J, Hilton A, Guillemaut JY, Grau O. (2007) 'Dual Mode Deformable Models for Free-Viewpoint Video of Outdoor Sports Events'. IEEE IEEE Int.Conf. on 3D Imaging and Modeling, Sixth International Conference on 3-D Digital Imaging and Modeling, 2007. 3DIM '07., pp. 177-184.
    doi: 10.1109/3DIM.2007.22
    Full text is available at: http://epubs.surrey.ac.uk/110208/
  • Huang P, Starck A, Hilton A. (2007) 'Temporal 3D Shape Matching'. IET IET European Conference on Visual Media Production, London, UK: 4th European Conference on Visual Media Production, 2007. IETCVMP., pp. 1-8.
    Full text is available at: http://epubs.surrey.ac.uk/111055/

    Abstract

    This paper introduces a novel 4D shape descriptor to match temporal surface sequences. A quantitative evaluation based on the receiver-operator characteristic (ROC) curve is presented to compare the performance of conventional 3D shape descriptors with and without using a time filter. Feature- based 3D shape descriptors including shape distribution (Osada et al., 2002 ), spin image (Johnson et al., 1999), shape histogram (Ankest et al., 1999) and spherical harmonics (Kazhdan et al., 2003) are considered. Evaluation shows that filtered descriptors outperform unfiltered descriptors and the best performing volume-sampling shape-histogram descriptor is extended to define a new 4D "shape-flow" descriptor. Shape-flow matching demonstrates improved performance in the context of matching time-varying sequences which is motivated by the requirement to connect similar sequences for animation production. Both simulated and real 3D human surface motion sequences are used for evaluation.

  • Hilton A, Starck J. (2007) 'Animation of People from Surface Motion Capture'. IEEE IEEE Computer Graphics and Applications, New York: Workshop on 3D Cinematography 3 (27), pp. 21-31.
    doi: 10.1109/MCG.2007.68
    Full text is available at: http://epubs.surrey.ac.uk/110202/

    Abstract

    Digital content production traditionally requires highly skilled artists and animators to first manually craft shape and appearance models and then instill the models with a believable performance. Motion capture technology is now increasingly used to record the articulated motion of a real human performance to increase the visual realism in animation. Motion capture is limited to recording only the skeletal motion of the human body and requires the use of specialist suits and markers to track articulated motion. In this paper we present surface capture, a fully automated system to capture shape and appearance as well as motion from multiple video cameras as a basis to create highly realistic animated content from an actor’s performance in full wardrobe. We address wide-baseline scene reconstruction to provide 360 degree appearance from just 8 camera views and introduce an efficient scene representation for level of detail control in streaming and rendering. Finally we demonstrate interactive animation control in a computer games scenario using a captured library of human animation, achieving a frame rate of 300fps on consumer level graphics hardware.

  • Turkmani A, Hilton A, Jackson PJB, Edge J. (2007) 'Visual analysis of lip coarticulation in VCV utterances'. Curran Associates 8th Annual Conference of the International Speech Communication Association, Antwerp, Belgium: INTERSPEECH 2007, pp. 1406-1409.
    Full text is available at: http://epubs.surrey.ac.uk/111066/

    Abstract

    This paper presents an investigation of the visual variation on the bilabial plosive consonant /p/ in three coarticulation contexts. The aim is to provide detailed ensemble analysis to assist coarticulation modelling in visual speech synthesis. The underlying dynamics of labeled visual speech units, represented as lip shape, from symmetric VCV utterances, is investigated. Variation in lip dynamics is quantitively and qualitatively analyzed. This analysis shows that there are statistically significant differences in both the lip shape and trajectory during coarticulation.

  • Grau O, Thomas GA, Hilton A, Kilner J, Starck J. (2007) 'A Robust Free-viewpoint Video System for Sport Scenes'. IEEE 3DTV Conference, 3DTV Conference, 2007
    doi: 10.1109/3DTV.2007.4379384
    Full text is available at: http://epubs.surrey.ac.uk/110197/
  • Guillemaut JY, Hilton A, Starck J, Kilner JJ, Grau O. (2007) 'A Baysian Framework for Simultaneous Reconstruction and Matting'. IEEE IEEE Int.Conf. on 3D Imaging and Modeling, Sixth International Conference on 3-D Digital Imaging and Modeling, 2007. 3DIM '07., pp. 167-176.
    doi: 10.1109/3DIM.2007.3
    Full text is available at: http://epubs.surrey.ac.uk/110191/
  • Starck J, Hilton A. (2007) 'Correspondence labelling for wide-timeframe free-form surface matching'. IEEE IEEE Int.Conf.on Computer Vision, IEEE 11th International Conference on Computer Vision, 2007. ICCV 2007., pp. 1-8.
    doi: 10.1109/ICCV.2007.4409108
    Full text is available at: http://epubs.surrey.ac.uk/110207/
  • Starck J, Hilton A. (2006) 'Free-viewpoint Video for Interactive Character Animation'. COE Conference, Japan,
    Full text is available at: http://epubs.surrey.ac.uk/110388/
  • Csakany P, Hilton A. (2006) 'Relighting of Facial Video'. IEEE ICPR, 18th International Conference on Pattern Recognition, 2006. ICPR 2006., pp. 203-206.
    doi: 10.1109/ICPR.2006.994
    Full text is available at: http://epubs.surrey.ac.uk/110186/

    Abstract

    We present a novel method to relight video sequences given known surface shape and illumination. The method preserves fine visual details. It requires single view video frames, approximate 3D shape and standard studio illumination only, making it applicable in studio production. The technique is demonstrated for relighting video sequences of faces

  • Nadtoka N, Hilton A, Tena J, Edge J, Jackson PJB. (2006) 'Representing Dynamics of Facial Expression'. IET European Conference on Visual Media Production, IET 3rd European Conference on Visual Media Production, pp. 183-183.
    Full text is available at: http://epubs.surrey.ac.uk/111040/

    Abstract

    Motion capture (mocap) is widely used in a large number of industrial applications. Our work offers a new way of representing the mocap facial dynamics in a high resolution 3D morphable model expression space. A data-driven approach to modelling of facial dynamics is presented. We propose a way to combine high quality static face scans with dynamic 3D mocap data which has lower spatial resolution in order to study the dynamics of facial expressions.

  • Kittler J, Hilton A, Hamouz M, Illingworth J. (2006) '3D Assisted Face Recognition: A Survey of 3D Imaging, Modelling and Recognition Approaches'. CVPR, , pp. 114---122-114---122.
  • Williams P, Hilton A. (2006) '3D Reconstruction Using Spherical Images'. IET IET European Conference on Visual Media Production, 3rd European Conference on Visual Media Production, 2006. CVMP 2006., pp. 179-179.
    Full text is available at: http://epubs.surrey.ac.uk/110187/
  • Tena JR, Hamouz M, Hilton A, Illingworth J. (2006) 'A Validated Method for Dense Non-rigid 3D Face Registration'. IEEE Int. Conf. on Advanced Video and Signal based Surveillance (AVSS’06), , pp. 81-90-81-90.
  • Miller G, Starck JR, Hilton A. (2006) 'Projective Surface Refinement for Free-Viewpoint Video'. IET European Conference on Visual Media Production, , pp. 153-162-153-162.
    Full text is available at: http://epubs.surrey.ac.uk/111026/

    Abstract

    This paper introduces a novel method of surface refinement for free-viewpoint video of dynamic scenes. Unlike previous approaches, the method presented here uses both visual hull and silhouette contours to constrain refinement of viewdependent depth maps from wide baseline views. A technique for extracting silhouette contours as rims in 3D from the view-dependent visual hull (VDVH) is presented. A new method for improving correspondence is introduced, where refinement of the VDVH is posed as a global problem in projective ray space. Artefacts of global optimisations are reduced by incorporating rims as constraints. Real time rendering of virtual views in a free-viewpoint video system is achieved using an image+depth representation for each real view. Results illustrate the high quality of rendered views achieved through this refinement technique.

  • Tena JR, Hamouz M, Hilton A, Illingworth J. (2006) 'A Validation Method for Dense Non-rigid 3D Face Registration'. IEEE Conf. on Advanced Video and Signal-based Surveillance,
  • Csakany P, Hilton A. (2006) 'Relighting of Facial Images'. IEEE IEEE Int.Conf. on Face and Gesture Recognition, 7th International Conference on Automatic Face and Gesture Recognition, 2006. FGR 2006., pp. 55-60.
    doi: 10.1109/FGR.2006.93
    Full text is available at: http://epubs.surrey.ac.uk/111038/
  • Starck J, Miller G, Hilton A. (2006) 'Volumetric stereo with silhouette and feature constraints'. British Machine Vision Association British Machine Vision Conference, Edinburgh: BMVC 2006, pp. 1189-1198.
    Full text is available at: http://epubs.surrey.ac.uk/111068/

    Abstract

    This paper presents a novel volumetric reconstruction technique that combines shape-from-silhouette with stereo photo-consistency in a global optimisation that enforces feature constraints across multiple views. Human shape reconstruction is considered where extended regions of uniform appearance, complex self-occlusions and sparse feature cues represent a challenging problem for conventional reconstruction techniques. A unified approach is introduced to first reconstruct the occluding contours and left-right consistent edge contours in a scene and then incorporate these contour constraints in a global surface optimisation using graph-cuts. The proposed technique maximises photo-consistency on the surface, while satisfying silhouette constraints to provide shape in the presence of uniform surface appearance and edge feature constraints to align key image features across views.

  • Csakany P, Vajda F, Hilton A. (2006) 'Model Refinement by Iterative Normal-From-Shading'. IET IET European Conference on Visual Media Production, 3rd European Conference on Visual Media Production, 2006. CVMP 2006., pp. 181-181.
    Full text is available at: http://epubs.surrey.ac.uk/111011/
  • Hamouz M, Tena JR, Kittler J, Hilton A, Illingworth J. (2006) '3D Assisted Face Recognition: A Survey'. Book Chapter,
  • Edge J, Hilton A. (2006) 'Visual Speech Synthesis from 3D Video'. IEEE IET European Conference on Visual Media Production, London: 3rd European Conference on Visual Media Production, 2006., pp. 174-174.
    Full text is available at: http://epubs.surrey.ac.uk/111067/

    Abstract

    In this paper we describe a parameterisation of lip movements which maintains the dynamic structure inherent in the task of producing speech sounds. A stereo capture system is used to reconstruct 3D models of a speaker producing sentences from the TIMIT corpus. This data is mapped into a space which maintains the relationships between samples and their temporal derivatives. By incorporating dynamic information within the parameterisation of lip movements we can model the cyclical structure, as well as the causal nature of speech movements as described by an underlying visual speech manifold. It is believed that such a structure will be appropriate to various areas of speech modeling, in particular the synthesis of speech lip movements.

  • Turkmani A, Hilton A. (2006) 'Appearane-Based Inner-Lip Detection'. IET European Conference on Visual Media Production, , pp. 176-176.
  • Miller G, Hilton A, Tang YY, Wang SP, Lorette G, Yeung DS, Yan H. (2006) 'Exact view-dependent visual hulls'. IEEE COMPUTER SOC 18th International Conference on Pattern Recognition, Vol 1, Proceedings, Hong Kong, PEOPLES R CHINA: 18th International Conference on Pattern Recognition (ICPR 2006), pp. 107-110.
    Full text is available at: http://epubs.surrey.ac.uk/110262/
  • Hamouz M, Tena JR, Kittler J, Hilton A, Illingworth J. (2006) 'Algorithms for 3D-assisted face recognition'. IEEE 2006 IEEE 14TH SIGNAL PROCESSING AND COMMUNICATIONS APPLICATIONS, VOLS 1 AND 2, Antalya, TURKEY: IEEE 14th Signal Processing and Communications Applications, pp. 826-829.
  • Huang P, Hilton A. (2006) 'Football Player Tracking for Video Annotation'. IET IET European Conference on Visual Media Production, 3rd European Conference on Visual Media Production, 2006. CVMP 2006., pp. 175-175.
    Full text is available at: http://epubs.surrey.ac.uk/110352/
  • Collins G, Hilton A. (2005) 'A Rigid Transform Basis for Animation Compression and Level of Detail'. Eurographics Association IMA Conference on Vision, Video and Graphics, Edinburgh: Second IMA Conference on Vision, Video and Graphics, pp. 21-28.
  • Collins G, Hilton A. (2005) 'Spatio-Temporal Fusion of Multiple View Video Rate 3D Surfaces'. Los Alamitos, CA 90720-1314 : IEEE Fifth International Conference on 3-D Digital Imaging and Modeling (3DIM’05), Ottawa, Ontario, Canada: Proceeding 3DIM '05 Proceedings of the Fifth International Conference on 3-D Digital Imaging and Modeling, pp. 142-149.
    doi: 10.1109/3DIM.2005.75
    Full text is available at: http://epubs.surrey.ac.uk/29713/

    Abstract

    We consider the problem of geometric integration and representation of multiple views of non-rigidly deforming 3D surface geometry captured at video rate. Instead of treating each frame as a separate mesh we present a representation which takes into consideration temporal and spatial coherence in the data where possible. We first segment gross base transformations using correspondence based on a closest point metric and represent these motions as piecewise rigid transformations. The remaining residual is encoded as displacement maps at each frame giving a displacement video. At both these stages occlusions and missing data are interpolated to give a representation which is continuous in space and time. We demonstrate the integration of multiple views for four different non-rigidly deforming scenes: hand, face, cloth and a composite scene. The approach achieves the integration of multiple-view data at different times into one representation which can processed and edited.

  • Kittler J, Hamouz M, Tena JR, Hilton A, Illingworth J, Ruiz M. (2005) '3D Assisted 2D Face Recognition: Methodology'. Lecture Notes in Computer Science 3773 (Proc. of CIARP�05), , pp. 1055---1065-1055---1065.
  • Starck J, Hilton A. (2005) 'Spherical Matching for Temporal Correspondence of Non-Rigid Surfaces'. IEEE IEEE Int.Conf.Computer Vision, Tenth IEEE International Conference on Computer Vision, 2005. ICCV 2005. 2, pp. 1387-1394.
    doi: 10.1109/ICCV.2005.229
    Full text is available at: http://epubs.surrey.ac.uk/111046/
  • Miller G, Hilton A, Starck J. (2005) 'Interactive Free-viewpoint Video'. IEE IEE European Conf. on Visual Media Production, The 2nd IEE European Conference on Visual Media Production, 2005. CVMP 2005., pp. 50-59.
    Full text is available at: http://epubs.surrey.ac.uk/110790/
  • Kittler J, Hilton A, Hamouz M, Illingworth J. (2005) '3D Assisted Face Recognition: A Survey of 3D Imaging, Modelling and Recognition Approaches'. IEEE Workshop on Advanced 3D Imaging for Safety and Security, A3DISS 2005 (Proceedings of the CVPR 2005 (DVD-ROM)),
  • Starck J, Miller G, Hilton A. (2005) 'Video-Based Character Animation'. ACM ACM SIGGRAPH/Eurographics Symposium on Computer Animation, Los Angeles: 2005 ACM SIGGRAPH/Eurographics symposium on Computer animation, pp. 49---58-49---58.
    doi: 10.1145/1073368.1073375
    Full text is available at: http://epubs.surrey.ac.uk/111060/

    Abstract

    In this paper we introduce a video-based representation for free viewpoint visualization and motion control of 3D character models created from multiple view video sequences of real people. Previous approaches to videobased rendering provide no control of scene dynamics to manipulate, retarget, and create new 3D content from captured scenes. Here we contribute a new approach, combining image based reconstruction and video-based animation to allow controlled animation of people from captured multiple view video sequences. We represent a character as a motion graph of free viewpoint video motions for animation control. We introduce the use of geometry videos to represent reconstructed scenes of people for free viewpoint video rendering. We describe a novel spherical matching algorithm to derive global surface to surface correspondence in spherical geometry images for motion blending and the construction of seamless transitions between motion sequences. Finally, we demonstrate interactive video-based character animation with real-time rendering and free viewpoint visualization. This approach synthesizes highly realistic character animations with dynamic surface shape and appearance captured from multiple view video of people.

  • Hilton A, Starck J. (2004) 'Multiple View Reconstruction of People'. IEEE IEEE Conference on 3D Data Processing, Visualisation and Transmission, 2nd International Symposium on 3D Data Processing, Visualization and Transmission, 2004. 3DPVT 2004., pp. 357-364.
    doi: 10.1109/TDPVT.2004.1335229
    Full text is available at: http://epubs.surrey.ac.uk/111015/
  • Ahmed A, Hilton A, Mokhtarian F. (2004) 'Enriching Animation Databases'. Eurographics Short Paper,
  • Ypsilos IA, Hilton A, Rowe S. (2004) 'Video-rate Capture of Dynamic Face Shape and Appearance'. IEEE IEEE Face and Gesture Recognition, Proceedings Sixth IEEE International Automatic Face and Gesture Recognition, 2004.
    doi: 10.1109/AFGR.2004.1301518
    Full text is available at: http://epubs.surrey.ac.uk/111061/

    Abstract

    This paper presents a system for simultaneous capture of video sequences of face shape and colour appearance. Shape capture uses a projected infra-red structured light pattern together with stereo reconstruction to simultaneously acquire full resolution shape and colour image sequences at video rate. Displacement mapping techniques are introduced to represent dynamic face surface shape as a displacement video. This unifies the representation of face shape and colour. The displacement video representation enables efficient registration, integration and spatiotemporal analysis of captured face data. Results demonstrate that the system achieves video-rate (25Hz) acquisition of dynamic 3D colour faces at PAL resolution with an rms accuracy of 0.2mm and a visual quality comparable to the captured video.

  • Ypsilos IA, Hilton A, Turkmani A, Jackson PJB. (2004) 'Speech Driven Face Synthesis from 3D Video'. IEEE IEEE Symposium on 3D Data Processing, Visualisation and Transmission, Thessaloniki, Greece: 2nd International Symposium on 3D Data Processing, Visualization and Transmission, pp. 58-65.
    doi: 10.1109/TDPVT.2004.1335143
    Full text is available at: http://epubs.surrey.ac.uk/7754/

    Abstract

    We present a framework for speech-driven synthesis of real faces from a corpus of 3D video of a person speaking. Video-rate capture of dynamic 3D face shape and colour appearance provides the basis for a visual speech synthesis model. A displacement map representation combines face shape and colour into a 3D video. This representation is used to efficiently register and integrate shape and colour information captured from multiple views. To allow visual speech synthesis viseme primitives are identified from the corpus using automatic speech recognition. A novel nonrigid alignment algorithm is introduced to estimate dense correspondence between 3D face shape and appearance for different visemes. The registered displacement map representation together with a novel optical flow optimisation using both shape and colour, enables accurate and efficient nonrigid alignment. Face synthesis from speech is performed by concatenation of the corresponding viseme sequence using the nonrigid correspondence to reproduce both 3D face shape and colour appearance. Concatenative synthesis reproduces both viseme timing and co-articulation. Face capture and synthesis has been performed for a database of 51 people. Results demonstrate synthesis of 3D visual speech animation with a quality comparable to the captured video of a person.

  • Hilton A, Kalkavouras M, Collins G. (2004) 'MELIES: 3D Studio Production of Animated Actor Models'. IEE European Conference on Visual Media Production, , pp. 283---288-283---288.
  • Ahmed A, Hilton A, Mokhtarian F. (2004) 'Intuitive Parametric Synthesis of Human Animation Sequences'. IEEE Computer Animation and Social Agents,
  • Starck J, Hilton A. (2003) 'Towards a 3D Virtual Studio for Human Apperance Capture'. IMA International Conference on Vision, Video and Graphics, Bath, , pp. 17---24-17---24.
  • Ahmed A, Hilton A, Mokhtarian F. (2003) 'Cyclification of Animation for Human Motion Synthesis'. Eurographics Short Paper,
  • Starck J, Hilton A. (2003) 'Model-based Multiple View Reconstruction of People'. IEEE IEEE International Conference on Computer Vision, Ninth IEEE International Conference on Computer Vision, 2003., pp. 915-922.
    doi: 10.1109/ICCV.2003.1238446
    Full text is available at: http://epubs.surrey.ac.uk/111021/
  • Mitchelson J, Hilton A. (2003) 'Hierarchical Tracking of Human Motion for Animation'. Model-based Imaging, Rendering, image Analysis and Graphical Special Effects, Paris,
  • Starck J, Hilton A. (2003) 'View-dependant Rendering with Multiple View Stereo Optimisation'. CVPR,
  • Mitchelson J, Hilton A. (2003) 'Hierarchical Tracking of Multiple People'. British Machine Vision Conference,
    Full text is available at: http://epubs.surrey.ac.uk/110697/
  • Hilton A, Starck J, Collins G, Kalkavouras M. (2002) '3D Shape Capture for Archiving and Animation'. AIVA 2002 Workshop,
    Full text is available at: http://epubs.surrey.ac.uk/110188/
  • Collins G, Hilton A. (2002) 'Mesh Decimation for Displacement Mapping'. Eurograhics - Short Paper,
  • Price M, Chandaria J, Grau O, Thomas GA, Chatting D, Thorne J, Milnthorpe G, Woodward P, Bull L, Ong E-J, Hilton A, Mitchelson J, Starck J. (2002) 'Real-Time Production and Delivery of 3D Media'. International Broadcasting Convention, Conference Proceedings, Amsterdam, Netherlands.: International Broadcasting Conference 2002
    Full text is available at: http://epubs.surrey.ac.uk/111030/

    Abstract

    The Prometheus project has investigated new ways of creating, distributing and displaying 3D television. The tools developed will also help today’s virtual studio production. 3D content is created by extension of the principles of a virtual studio to include realistic 3D representation of actors. Several techniques for this have been developed: • Texture-mapping of live video onto rough 3D actor models. • Fully-animated 3D avatars: • Photo-realistic body model generated from several still images of a person from different viewpoints. • Addition of a detailed head model taken from two close-up images of the head. • Tracking of face and body movements of a live performer using several cameras, to derive animation data which can be applied to the face and body. • Simulation of virtual clothing which can be applied to the animated avatars. MPEG-4 is used to distribute the content in its original 3D form. The 3D scene may be rendered in a form suitable for display on a ‘glasses-free’ 3D display, based on the principle of Integral Imaging. By assembling these elements in an end-to-end chain, the project has shown how a future 3D TV system could be realised. Furthermore, the tools developed will also improve the production methods available for conventional virtual studios, by focusing on sensor-free and markerless motion capture technology, methods for the rapid creation of photo-realistic virtual humans, and real-time clothing simulation.

  • Ahmed A, Hilton A, Mokhtarian F. (2002) 'Adaptive Compression of Human Animation Data'. Eurograhics - Short Paper,
  • Hilton A, Starck J, Collins G. (2002) 'From 3D Shape Capture to Animated Models'. IEEE Conference on 3D Data Processing, Visualisation and Transmission,
  • Mitchelson J, Hilton A. (2002) 'Wand-based Calibration of Multiple Cameras'. British Machine Vision Association workshop on Multiple Views,
  • Starck J, Hilton A. (2002) 'Reconstruction of animated models from images using constrained deformable surfaces'. Springer Lecture Notes in Computer Science, 10th Conf. on Discrete Geometry for Computer Imagery 2301, pp. 382-391.
    doi: 10.1007/3-540-45986-3_34
    Full text is available at: http://epubs.surrey.ac.uk/111032/
  • Ahmed A, Mokhtarian F, Hilton A. (2001) 'Parametric Motion Blending through Wavelet Analysis'. Eurographics 2001 - Short Paper, , pp. 347---353-347---353.
  • Starck J, Hilton A, Illingworth J. (2001) 'Human Shape Estimation in a Multi-Camera Studio'. BMVC,
    Full text is available at: http://epubs.surrey.ac.uk/110735/
  • Li Y, Hilton A, Illingworth J. (2001) 'Towards Reliable Real-Time Multiview Tracking'. IEEE International Workshop on Multiple Object Tracking, , pp. 43-50.
    doi: 10.1109/MOT.2001.937980
    Full text is available at: http://epubs.surrey.ac.uk/111059/

    Abstract

    We address the problem of reliable real-time 3D-tracking of multiple objects which are observed in multiple wide-baseline camera views. Establishing the spatio-temporal correspondence is a problem with combinatorial complexity in the number of objects and views. In addition vision based tracking suffers from the ambiguities introduced by occlusion, clutter and irregular 3D motion. We present a discrete relaxation algorithm for reducing the intrinsic combinatorial complexity by pruning the decision tree based on unreliable prior information from independent 2D-tracking for each view. The algorithm improves the reliability of spatio-temporal correspondence by simultaneous optimisation over multiple views in the case where 2D-tracking in one or more views is ambiguous. Application to the 3D reconstruction of human movement, based on tracking of skin-coloured regions in three views, demonstrates considerable improvement in reliability and performance. The results demonstrate that the optimisation over multiple views gives correct 3D reconstruction and object labeling in the presence of incorrect 2D-tracking whilst maintaining real-time performance

  • Wang T, McLauchlan P, Palmer P, Hilton A. (2001) 'Calibration for an Integrated Measurement System of Camera and Laser and its Application'. 5th World Multiconference on Systemics, Cybernetics and Informatics (Awarded Best Paper), Orlando, Florida, USA,
  • Hilton A, Illingworth J, Li Y, Mitchelson J. (2001) 'Real-Time Human Motion Estimation for Studio Production'. BMVA Workshop on Understanding Human Behaviour,
  • Molina L, Hilton A. (2001) 'Learning models for sythesis of human motion'. BMVA Workshop on Probabalistic Methods in Computer Vision,
  • Tanco LM, Hilton A. (2000) 'Realistic synthesis of novel human movements from a database of motion capture examples'. IEEE Workshop on Workshop on Human Motion, 2000., Workshop on Human Motion, 2000., pp. 137-142.
    doi: 10.1109/HUMO.2000.897383
    Full text is available at: http://epubs.surrey.ac.uk/111054/
  • Manessis A, Hilton A, McLauchlan P, Palmer P. (2000) 'A Statistical Geometric Framework for Reconstruction of Scene Models'. British Machine Vision Conference, , pp. 222---231-222---231.
    Full text is available at: http://epubs.surrey.ac.uk/110198/
  • Shen X, Palmer P, McLauchlan P, Hilton A. (2000) 'Error Propagation from Camera Motion to Epipolar Constraint'. British Machine Vision Conference, , pp. 546---555-546---555.
  • Smith R, Hilton A, Sun W. (2000) 'Seamless VRML Humans'. Fifth Industrial Congress on 3D Digitizing, , pp. 1---8-1---8.
  • Sun W, Hilton A, Smith R. (2000) 'Building Animated Models from 3D Scanned Data'. Fifth Industrial Congress on 3D Digitizing, , pp. 1---8-1---8.
  • Smith R, Sun W, Hilton A, Illingworth J. (2000) 'Layered Animation using Displacement Maps'. IEEE IEEE International Conference on Computer Animation, Philadelphia, USA: Computer Animation 2000., pp. 146-151.
    doi: 10.1109/CA.2000.889072
    Full text is available at: http://epubs.surrey.ac.uk/110879/

    Abstract

    This paper presents a layered animation framework which uses displacement maps for efficient representation and animation of highly detailed surfaces. The model consists of three layers: a skeleton; low-resolution control model; and a displacement map image. The novel aspects of this approach are an automatic closed-form solution for displacement map generation and animation of the layered displacement map model. This approach provides an efficient representation of complex geometry which allows realistic deformable animation with multiple levels-of-detail. The representation enables compression, efficient transmission and level-of-detail control for animated models.

  • Manessis A, Hilton A, McLauchlan P, Palmer P. (2000) 'Reconstruction of Scene Models from Sparse 3D Structure'. IEEE IEEE International Conference on Computer Vision and Pattern Recognition, IEEE Conference on Computer Vision and Pattern Recognition, 2000. 2, pp. 666-671.
    doi: 10.1109/CVPR.2000.854938
    Full text is available at: http://epubs.surrey.ac.uk/111034/
  • McLauchlan P, Shen X, Palmer P, Manessis A, Hilton A. (2000) 'Surface-Based Structure-from-Motion using Feature Groupings'. IEEE International Asian Conference on Computer Vision, , pp. 1---10-1---10.
  • Sun W, Hilton A, Smith R, Illingworth J. (1999) 'Layered Animation Models from Captured Data'. Eurographics Workshop on Computer Animation, Eurographics Workshop on Computer Animation 1999, pp. 145---154-145---154.
    Full text is available at: http://epubs.surrey.ac.uk/110206/
  • Hilton A. (1999) 'Towards Model-based Capture of a Persons Shape, Appearance and Motion'. IEEE International Workshop on Modelling People, , pp. 37---44-37---44.
    doi: 10.1109/PEOPLE.1999.798344
    Full text is available at: http://epubs.surrey.ac.uk/111058/

    Abstract

    This paper introduces a model-based approach to capturing a persons shape, appearance and movement. A 3D animated model of a clothed persons whole-body shape and appearance is automatically constructed from a set of orthogonal view colour images. The reconstructed model of a person is then used together with the least-squares inverse-kinematics framework of Bregler and Malik (1998) to capture simple 3D movements from a video image sequence

  • Hilton A, Beresford D, Gentils T, Smith R, Sun W. (1999) 'Virtual People: Capturing human models to populate virtual worlds'. IEEE IEEE International Conference on Computer Animation, Geneva, Switzerland: Proceedings Computer Animation, 1999., pp. 174-185.
    doi: 10.1109/CA.1999.781210
    Full text is available at: http://epubs.surrey.ac.uk/111063/

    Abstract

    In this paper a new technique is introduced for automatically building recognisable moving 3D models of individual people. A set of multi-view colour images of a person are captured from the front, side and back using one or more cameras. Model-based reconstruction of shape from silhouettes is used to transform a standard 3D generic humanoid model to approximate the persons shape and anatomical structure. Realistic appearance is achieved by colour texture mapping from the multi-view images. Results demonstrate the reconstruction of a realistic 3D facsimile of the person suitable for animation in a virtual world. The system is low-cost and is reliable for large variations in shape, size and clothing. This is the first approach to achieve realistic model capture for clothed people and automatic reconstruction of animated models. A commercial system based on this approach has recently been used to capture thousands of models of the general public.

  • Beresford D, Hilton T, Smith R, Sun W. (1999) 'Building 3D Human Models from Captured Images'. Eurographics UK Chapter 17th Annual Conference, Cambridge, April 13-15, 1999, , pp. 22-30-22-30.
    Full text is available at: http://epubs.surrey.ac.uk/110204/
  • Hilton A, Gentils T, Beresford D. (1998) 'Popup-People: Capturing 3D Articulated Models of Individual People'. IEE IEE Colloquim on Computer Vision for Virtual Human Modelling, , pp. 1---6-1---6.
  • Hilton A, Illingworth J. (1997) 'Multi-Resolution Geometric Fusion'. IEEE International Conference on Recent Advances in 3D Digital Imaging and Modeling, , pp. 181---188-181---188.
    Full text is available at: http://epubs.surrey.ac.uk/111017/
  • Saminathan A, Stoddart AJ, Hilton A, Illingworth J. (1997) 'Progress in arbitrary topology deformable surfaces'. BMVA BMVC, , pp. 1---6-1---6.
  • Hilton A, Stoddart AJ, Illingworth J, Windeatt T. (1996) 'Implicit Surface based Geometric Fusion'. Leeds Leeds 16th Annual Statistics Workshop, , pp. 1-8.
    Full text is available at: http://epubs.surrey.ac.uk/110747/
  • Hilton A, Stoddart AJ, Illingworth J, Windeatt T. (1996) 'Marching Triangles: Range Image Fusion for Complex Object Modelling'. IEEE ICIP, Lausanne, Switzerland: International conference on image processing, pp. 381-384.
    doi: 10.1109/3DIMPVT.2011.40
    Full text is available at: http://epubs.surrey.ac.uk/110986/

    Abstract

    A new surface based approach to implicit surface polygonisation is introduced. This is applied to the reconstruction of 3D surface models of complex objects from multiple range images. Geometric fusion of multiple range images into an implicit surface representation was presented in previous work. This paper introduces an efficient algorithm to reconstruct a triangulated model of a manifold implicit surface, a local 3D constraint is derived which defines the Delaunay surface triangulation of a set of points on a manifold surface in 3D space. The `marching triangles' algorithm uses the local 3D constraint to reconstruct a Delaunay triangulation of an arbitrary topology manifold surface. Computational and representational costs are both a factor of 3-5 lower than previous volumetric approaches such as marching cubes

  • Stoddart AJ, Lemke S, Hilton A, Renn T. (1996) 'Uncertainty estimation for surface registration'. BMVA Press BMVC, , pp. 1---6-1---6.
  • Hilton A, Stoddart AJ, Illingworth J, Windeatt T. (1996) 'Building 3D Graphical Models of Complex Objects'. EGUK Eurographics UK Conference, , pp. 193---203-193---203.
  • Stoddart AJ, Hilton A. (1996) 'Registration of multiple point sets'. Vienna ICPR, , pp. 1---4-1---4.
  • Hilton A, Stoddart AJ, Illingworth J, Windeatt T. (1996) 'Reliable Surface Reconstruction from Multiple Range Images'. Springer 4th European Conference on Computer Vision, 1064, pp. 117---126-117---126.
    doi: 10.1007/BFb0015528
    Full text is available at: http://epubs.surrey.ac.uk/111037/

    Abstract

    This paper addresses the problem of reconstructing an integrated 3D model from multiple 2.5D range images. A novel integration algorithm is presented based on a continuous implicit surface representation. This is the first reconstruction algorithm to use operations in 3D space only. The algorithm is guaranteed to reconstruct the correct topology of surface features larger than the range image sampling resolution. Reconstruction of triangulated models from multi-image data sets is demonstrated for complex objects. Performance characterization of existing range image integration algorithms is addressed in the second part of this paper. This comparison defines the relative computational complexity and geometric limitations of existing integration algorithms.

  • Hilton A, Stoddart AJ, Illingworth J, Windeatt T. (1996) 'Reconstruction of 3D Delaunay Surface Models of Complex Objects'. IEEE IEEE International Conference on Systems, Man and Cybernetics, International Conference on Systems, Man, and Cybernetics, 1996., IEEE, pp. 2445-2450.
    doi: 10.1109/ICSMC.1996.561287
    Full text is available at: http://epubs.surrey.ac.uk/111031/
  • Hilton A, Goncalves J. (1995) '3D Scene Representation Using a Deformable Surface'. IEEE IEEE Workshop on Physics Based Modelling, , pp. 24---30-24---30.
  • Hilton A, Stoddart AJ, Illingworth J, Windeatt T. (1994) 'Automatic inspection of loaded PCB’s using 3D range data'. SPIE SPIE Machine Vision Application in Industrial Inspection II, International Symposium on Electronic Imaging: Science and Technology, San Jose, CA Volume 2183, , pp. 226---237-226---237.
  • Stoddart AJ, Hilton A, Illingworth J. (1994) 'Slime: A new deformable surface'. BMVA Press BMVC, , pp. 285---293-285---293.
  • Hilton A, Illingworth J, Windeatt T. (1994) 'Surface Curvature Estimation'. IEEE 12th IAPR International Conference on Pattern Recognition, , pp. 37---41-37---41.
  • Hilton A, Roberts JB, Hadded O. (1992) 'Comparative Evaluation of Techniques for Estimating Turbulent Flow Parameters from In-Cylinder LDA Engine Data'. Fifth International Symposium on Applications of Laser Anemometry to Fluid Mechanics, Lisbon, Portugal, , pp. 130-138.
  • Hilton A, Roberts JB, Hadded O. (1991) 'Autocorrelation Based Analysis of LDA Engine Data for Bias-Free Turbulence Estaimates'. Society of Automotive Engineers International Congress, , pp. 22---30-22---30.

Books

  • Moeslund TB, Hilton A, Krüger V, Sigal L. (2011) Visual Analysis of Humans: Looking at People. Springer-Verlag New York Inc
  • Starck J. (2003) Human Modelling from Multiple Views. PhD Thesis, University of Surrey
  • Hilton A. (1992) Algorithms for Estimating Turbulent Flow Parameters from In-Cylinder Laser Doppler Anemometer Data. Doctor of Philosophy (D.Phil.) Thesis, University of Sussex,UK

Book chapters

  • Hilton A, Guillemaut J, Kilner J, Grau O, Thomas G. (2010) 'Free-Viewpoint Video for TV Sport Production'. in Ronfard R, Taubin G (eds.) Image and Geometry Processing for 3-D Cinematography Springer 5
    doi: 10.1007/978-3-642-12392-4_4
  • Hilton A, Guillemaut J-Y, Kilner J, Grau O, Thomas G. (2010) 'Free-viewpoint Video for Sports TV Production'. Image and Geometry Processing for 3D Cinematography Edition. Springer , pp. 77-106.
    doi: 10.1007/978-3-642-12392-4

Stay Connected

Contact Us

Accessibility | Contacting the University | Cookies | Disclaimer | Freedom of Information

© University of Surrey, Guildford, Surrey, GU2 7XH, United Kingdom. +44 (0)1483 300800

Page Owner: ees2ah
Page Created: Thursday 16 September 2010 13:54:40 by lb0014
Last Modified: Tuesday 23 October 2012 15:47:45 by eex133
Expiry Date: Friday 16 December 2011 13:53:36
Assembly date: Tue Mar 26 22:38:37 GMT 2013
Content ID: 37229
Revision: 8
Community: 1379