Papers by Jonathan Starck
Proceedings of the 1st international workshop on 3D video processing - 3DVP '10, 2010
Stereo film production has recently made a huge impact with the success of James Cameron's 3D mov... more Stereo film production has recently made a huge impact with the success of James Cameron's 3D movie Avatar. Stereo presents a series of challenges: from the construction and calibration of stereo capture rigs, the subsequent work flow, to the post-production tools and technology requirements for working with stereo footage. The Foundry produce both the Academy Award® winning compositor Nuke and the Ocula tool set which is designed specifically for stereo. Ocula addresses inherent problems with different filming techniques -such as the perspective distortion that occurs with "toe-in" camera set-ups -and reduces the extra time and effort required to work with two views instead of one. This talk will provide an introduction to some of the challenges of stereo film production as well as some of the tools and tricks used to produce visual effects in post-production.
Proceedings of the 9th European Conference on Visual Media Production - CVMP '12, 2012
Page 1. Transfer of Albedo and Local Depth Variation to Photo-Textures Francho Melendez Loughboro... more Page 1. Transfer of Albedo and Local Depth Variation to Photo-Textures Francho Melendez Loughborough University [email protected] Mashhuda Glencross Loughborough University [email protected] Jon Starck The Foundry Visionmongers [email protected] Gregory J. Ward Dolby Laboratories [email protected] ABSTRACT Acquisition of displacement and albedo maps for full building façades is a difficult problem and traditionally achieved through a labor intensive artistic process. ...
Med Eng Phys, 1999
A technique to measure surface geometry using a conductive ink sensor is described. In the human ... more A technique to measure surface geometry using a conductive ink sensor is described. In the human system distorted cylinders are common, and geometry can be reconstructed from local measures of curvature. An algorithm is presented to reconstruct the shape of a surface from a series of curvature measurements. The Abrams Gentile Entertainment patented bend sensor was evaluated as a curvature transducer. The sensor was tested at the extremes of the likely measurement range, from curvatures below 0.01 mm−1 up to a curvature of 0.1 mm−1. The upper curvature limit proved beyond the design specification of the sensor. The technique was applied at the lower curvature range to reconstruct one quadrant of the chest of a volunteer and record breathing movement. The bend sensor is inexpensive and can be applied to obtain an approximate reconstruction of surface geometry in the human system.
Medical Engineering & Physics, 1999
A technique to measure surface geometry using a conductive ink sensor is described. In the human ... more A technique to measure surface geometry using a conductive ink sensor is described. In the human system distorted cylinders are common, and geometry can be reconstructed from local measures of curvature. An algorithm is presented to reconstruct the shape of a surface from a series of curvature measurements. The Abrams Gentile Entertainment patented bend sensor was evaluated as a curvature transducer. The sensor was tested at the extremes of the likely measurement range, from curvatures below 0.01 mm Ϫ1 up to a curvature of 0.1 mm Ϫ1 . The upper curvature limit proved beyond the design specification of the sensor. The technique was applied at the lower curvature range to reconstruct one quadrant of the chest of a volunteer and record breathing movement. The bend sensor is inexpensive and can be applied to obtain an approximate reconstruction of surface geometry in the human system.
Television production is increasingly making use of 3D models, in applications including animatio... more Television production is increasingly making use of 3D models, in applications including animation and virtual production. These models are rendered to produce 2D images during the production process. However, with the ever increasing power of 3D graphics processors in home PCs, and new developments in 3D display technology, the time is right to consider how the broadcaster can maintain content in its 3D form all the way through the programme chain. This paper presents the results of PROMETHEUS, a UK 'LINK' project, whose aim is to examine the various issues related to developing an end-to-end 3D programme production chain using MPEG-4.
... Prof. Adrian Hilton and Dr. Jonathan Starck c Peng Huang 2007 ... intrinsic 3D shape descript... more ... Prof. Adrian Hilton and Dr. Jonathan Starck c Peng Huang 2007 ... intrinsic 3D shape description.Chua and Jarvis [8] introduce a point signature, which is invariant to rotation and translation, to describe 3D free-form surfaces. ... follows: (θmin,φmin) = minθ,φ{d(Xi(θ, φ),Yi(0, 0))} ...
Generating free-viewpoint video in outdoor sports environments is currently an unsolved problem d... more Generating free-viewpoint video in outdoor sports environments is currently an unsolved problem due to difficulties in obtaining accurate background segmentation and camera calibration. This paper introduces a technique for the reconstruction of a scene in the presence of these errors. We tackle the issues of reconstruction completeness, and accuracy of surface shape and appearance. We introduce the concept of the conservative visual hull as a technique to improve reconstruction completeness. We then present a view-dependent surface optimisation technique using deformable models to improve surface shape and appearance. We contribute a novel dual-mode snake algorithm that is robust to noise and demonstrates reduced dependence on parameterisation by separating the search of the solution space from the data fitting. We conclude by presenting results of this technique along with a quantitative evaluation against other reconstruction techniques using a leave-oneout data set.
This paper presents a novel model-based framework for rapid transformation of captured surface sh... more This paper presents a novel model-based framework for rapid transformation of captured surface shape into a structured representation suitable for efficient storage, transmission, manipulated, visualization and animation. Captured surface shape can be derived from either active 3D sensors or passive reconstruction from multiple view images and video. Results are presented for archiving of historical artifacts and production of animated models of real people in a multiple camera studio.
Conventional 2D video production provides a fixed-view reproduction of a recorded event in which ... more Conventional 2D video production provides a fixed-view reproduction of a recorded event in which a director defines every moment to be viewed. Multiple camera studio systems are now being developed to capture real-world events from multiple viewpoints to replay the event in 3D as a freeviewpoint video. Free-viewpoint video provides the consumer the flexibility to interact with a scene by changing the viewpoint in replaying the event. The challenge in computer vision and computer graphics remains to capture real world events for both replay and to provide the director or consumer the freedom to synthesize new unseen content. In this paper we explore the use of free-viewpoint video in content synthesis by re-using captured scenes of people. Our work combines image based scene reconstruction and video-based animation techniques to provide a new approach that allows interactive character animation from free-viewpoint video.
This paper introduces a representation for multiple view video to support high-quality interactiv... more This paper introduces a representation for multiple view video to support high-quality interactive free-viewpoint rendering of moving people. Multiple wide baseline views are integrated into a view-dependent representation based on pair wise refinement of the visual-hull. An exact view- dependent visual-hull (VDVH) algorithm is presented to compute an initial approximation of the scene geometry. Refinement of the VDVH surface is
This paper introduces the concept of a "3D Virtual Studio" for human appearance capture... more This paper introduces the concept of a "3D Virtual Studio" for human appearance capture, akin to the motion capture studio for human motion tracking. Ultimately the 3D Virtual Studio should enable video-realistic recon- struction of a moving person from any viewpoint. A mesh-based stereo technique is presented to reconstruct a moving person from multiple camera views. This technique optimises a
British Machine Vision Conference, 2006
This paper presents a novel volumetric reconstruction technique that com- bines shape-from-silhou... more This paper presents a novel volumetric reconstruction technique that com- bines shape-from-silhouette with stereo photo-consistency in a global op- timisation that enforces feature constraints across multiple views. Human shape reconstruction is considered where extended regions of uniform ap- pearance, complex self-occlusions and sparse feature cues represent a chal- lenging problem for conventional reconstruction techniques. A unified ap- proach is introduced
Virtual view synthesis of people from multiple view video sequences
SMPTE Motion Imaging Journal, 2007
This contribution describes robust methods to provide a freeviewpoint video visualisation of spor... more This contribution describes robust methods to provide a freeviewpoint video visualisation of sport scenes using a multicamera set-up. This allows generation of novel views of actions from any angle and is of interest for visualisation in TV productions. The system utilises 3D reconstruction techniques previously developed for studio use. This paper discusses some experiences found while applying these techniques for an uncontrolled outdoor environment and addresses robustness issues. This includes segmentation, camera calibration and 3D reconstruction. A number of different 3D representations, including billboards, visual hulls and viewdependent geometry are evaluated for the purpose.
Procedings of the British Machine Vision Conference 2006, 2006
This paper presents a novel volumetric reconstruction technique that combines shape-from-silhouet... more This paper presents a novel volumetric reconstruction technique that combines shape-from-silhouette with stereo photo-consistency in a global optimisation that enforces feature constraints across multiple views. Human shape reconstruction is considered where extended regions of uniform appearance, complex self-occlusions and sparse feature cues represent a challenging problem for conventional reconstruction techniques. A unified approach is introduced to first reconstruct the occluding contours and left-right consistent edge contours in a scene and then incorporate these contour constraints in a global surface optimisation using graph-cuts. The proposed technique maximises photo-consistency on the surface, while satisfying silhouette constraints to provide shape in the presence of uniform surface appearance and edge feature constraints to align key image features across views.
Lecture Notes in Computer Science, 2015
Uploads
Papers by Jonathan Starck