David Kim

david.kim@ncl.ac.uk | PhD Student

I am a PhD Student at Newcastle University in the School of Computing Science and an on-site Microsoft Research PhD Fellow working within the Interactive 3D Technologies group at Microsoft Research in Cambridge. I received my MSc in Media Informatics from Ludwig Maximilian University of Munich in 2008. Before moving to the UK, I worked on novel multi-touch technologies and applications in the Fluidum group in Munich. My current research focuses on novel input and output technologies for "Freeform 3D Interactions in Everyday Environments".

Natural User Interfaces (NUI) has received a great deal of attention in recent years. Much of this attention is around the Kinect and gaming in the living room. My research looks at ways of taking NUI out of the living room, into our everyday lives. Through the design, prototyping and evaluation of novel NUI systems, I am exploring how NUI can become truly ubiquitous, allowing such interactions to be incorporated into new user experiences and scenarios, in particular in rethinking traditional mobile and desktop interactions.

A secondary theme within my research is exploring the convergence of NUI with Augmented Reality (AR). Over the years we’ve seen AR technologies such as glasses, tracking and mapping, and mobile computing maturing. A less researched topic is how to make such AR technologies interactive. I’m interested in fusing together ideas from NUI with AR. These areas can be seen as very complimentary; NUI is focused on sensing new forms of input, and AR traditionally focuses on new forms of output. Bringing these two fields together can lead to new user experiences that radically change the way we interact and even think about computing systems.

Curriculum Vitae

David Kim CV


D. Kim, O. Hilliges, S. Izadi, A. Butler, J. Chen, I. Oikonomidis, P. Olivier. Digits: Freehand 3D Interactions Anywhere Using a Wrist-Worn Gloveless Sensor. ACM UIST, Cambridge, MA, USA, Oct 2012 (Best Demo Award 2nd place)

D. Molyneaux, S. Izadi, D. Kim, O. Hilliges, S. Hodges, X. Cao, A. Butler, and H. Gellersen. Interactive Environment-Aware Handheld Projectors for Pervasive Computing Spaces. PERVASIVE, Springer, Newcastle upon Tyne, UK, Jun 2012 (Best Paper Award)

O. Hilliges, D. Kim, S. Izadi, M. Weiss, A. Wilson. HoloDesk: Direct 3D Interactions with a Situated See-Through Display. ACM CHI, Austin, TX, USA, May 2012

S. Izadi, D. Kim, O. Hilliges, D. Molyneaux, R. Newcombe, P. Kohli, J. Shotton, S. Hodges, D. Freeman, A. Davison, and A. Fitzgibbon. KinectFusion: Real-Time 3D Reconstruction and Interaction using a Moving Depth Camera. ACM UIST, Santa Barbara, CA, USA, Oct 2011

R. Newcombe, S. Izadi, O. Hilliges, D. Molyneaux, D. Kim, A. Davison, P. Kohli, J. Shotton, S. Hodges, A. Fitzgibbon. Real-Time Dense Surface Mapping and Tracking with Kinect. IEEE ISMAR. Basel, Switzerland, Oct 2011 (Best Paper Award)

A. Butler, O. Hilliges, S. Izadi, S. Hodges, D. Molyneaux, D. Kim, D. Kong. Vermeer: Direct Interaction with a 360° Viewable 3D Display. ACM UIST, Santa Barbara, CA, USA, Oct 2011

A. Butler, S. Izadi, O. Hilliges, D. Molyneaux, S. Hodges, D. Kim. Shake'n'Sense: Reducing Interference for Overlapping Structured Light Depth Cameras. ACM CHI, Austin, TX, USA, May 2012 (Honorable Mention)

D. Kim, P. Dunphy, P. Briggs, J. Hook, J. Nicholson, J. Nicholson, P. Olivier. Multi-Touch Authentication on Tabletops. ACM CHI, Atlanta, Georgia, USA, Apr 2010

O. Hilliges, D. Kim, S. Izadi. Creating Malleable Interactive Surfaces using Liquid Displacement Sensing. IEEE Tabletop and Interactive Surfaces, Amsterdam, Netherlands, Oct 2008

O. Hilliges, L. Terrenghi, S. Boring, D. Kim, H. Richter, A. Butz. Designing for Collaborative Creative Problem Solving. ACM Creativity & Cognition, Washington D.C., USA, Jun 2007




Digits: freehand 3D interactions anywhere using a wrist-worn gloveless sensorDavid Kim, Otmar Hilliges, Shahram Izadi, Alex D. Butler, Jiawen Chen, Iason Oikonomidis, Patrick Olivier (2012) urlpdfProceedings of UIST 2012p. 167-176ACM

HoloDesk: direct 3D interactions with a situated see-through displayOtmar Hilliges, David Kim, Shahram Izadi, Malte Weiss, Andrew Wilson (2012) urlpdfProceedings of CHI 2012p. 2421-2430ACM

Interactive environment-aware handheld projectors for pervasive computing spacesDavid Molyneaux, Shahram Izadi, David Kim, Otmar Hilliges, Steve Hodges, Xiang Cao, Alex Butler, Hans Gellerson (2012) urlpdfProceedings of Pervasive 2012p. 197-215Springer

Shake'n'sense: reducing interference for overlapping structured light depth camerasAlex D. Butler, Shahram Izadi, Otmar Hilliges, David Molyneaux, Steve Hodges, David Kim (2012) urlpdfProceedings of CHI 2012p. 1933-1936: ACM


KinectFusion: real-time 3D reconstruction and interaction using a moving depth cameraShahram Izadi, David Kim, Otmar Hilliges, David Molyneaux, David Newcombe, Pushmeet Kohli, Jamie Shotton, Steve Hodges, Dustin Freeman, Andrew Davison, Andrew Fitzgibbon (2011) urlpdfProceedings of UIST 2011p. 559-568ACM

KinectFusion: real-time dense surface mapping and trackingAndrew J. Davison, Shahram Izadi, Pushmeet Kohli, Otmar Hilliges, Jamie Shotton, David Molyneaux, Steve Hodges, David Kim, Andrew Fitzgibbon (2011) urlpdfProceedings of ISMAR 2011p. 127-136IEEE

Vermeer: direct interaction with a 360° viewable 3D displayAlex Butler, Otmar Hilliges, Shahram Izadi, Steve Hodges, David Molyneaux, David Kim, Danny Kong (2011) urlpdfProceedings of UIST 2011p. 569-576ACM


Multi-touch authentication on tabletopsDavid Kim, Paul Dunphy, Pam Briggs, Jonathan Hook, John Nicholson, James Nicholson, Patrick Olivier (2010) urlpdfProceedings of CHI 2010p. 1093-1102: ACM

Copyright 2012 Digital Interaction Group