Hrvoje Benko Headshot

Hrvoje Benko

Director, Research Science
Meta Reality Labs Research
Affiliate Professor at the University of Washington Information School

Google Scholar  dblp   ACM DL
Headshot: low res   high res
How to say my name?


Dr. Hrvoje Benko is a Director of Research Science at Meta Reality Labs Research where he is developing novel interactions, devices and interfaces for Contextualized AI, Augmented and Virtual Reality. He is leading the efforts to invent novel wearable devices that enable people to use their gestures, gaze and voice to express themselves while harnessing the contextualized understanding of their environment for better interactions. He currently leads a multi-disciplinary organization that includes scientists and engineers with expertise in human computer interaction, computer vision, machine learning, AI, design, neuroscience and cognitive psychology.

He is an expert in the field of Human-Computer Interaction (HCI) where he has coauthored more than 80 scientific articles and 70 issued patents. His research has been awarded 13 best paper awards or honorable mentions at the top HCI conferences and he has received the ACM UIST Lasting Impact Award in 2022 for his co-authored work "OmniTouch: Wearable Multitouch Interaction Everywhere". He has been active in the organization of the ACM User Interface Systems and Technology conference, the premiere technical conference in HCI, serving as the program chair in 2012 and as the general chair in 2014. He sits on the editorial board of the TOCHI Journal, the premiere journal in the HCI field.

He also holds an Affiliate Full Professor position at the University of Washington Information School. Prior to his current role at Meta, he was a Principal Researcher at Microsoft Research, where he worked on novel haptic handheld devices, multi-touch interactions, large-scale projection-mapping environments, and novel AR/VR interactions and technologies. He received a Ph.D. in Computer Science from Columbia University in 2007 investigating mobile augmented reality and multi-touch interactive technologies. In 2023, he was inducted into the SIGCHI Academy for his research contributions to the field of Human-Computer Interaction.





Publications

2024
Efficient Mid-Air
Dudley, J.J., Karlson, A., Todi, K., Benko, H., Longest, M., Wang, R., and Kristensson, P.O. (2024). Efficient Mid-Air Text Input Correction in Virtual Reality. In Proceedings of IEEE ISMAR 2024.
pdf
PicoRing
Takahashi, R., Whitmire, E., Boldu, R., Ng, S., Kienzle, W., and Benko, H. (2024). picoRing: battery-free rings for subtle thumb-to-index input. In Proceedings of ACM UIST 2024.
SoundScroll
Kim, D., Whitmire, E., Boldu, R., Kienzle, W., and Benko, H. (2024). SoundScroll: Robust Finger Slide Detection Using Friction Sound and Wrist-Worn Microphones. In Proceedings of ACM ISWC 2024.
A Meta-Bayesian Approach for Rapid Online Parametric Optimization for Wrist-based Interactions
Liao, Y.C., Desai, R., Pierce, A.M., Taylor, K.E., Benko, H., Jonker, T.R., and Gupta, A. (2024). A Meta-Bayesian Approach for Rapid Online Parametric Optimization for Wrist-based Interactions. In Proceedings of ACM CHI 2024.
MineXR
Cho,H., Yan, Y., Todi, K., Parent, M., Smith, M., Jonker, T.R., Benko, H. and Lindlbauer, D. (2024). MineXR: Mining Personalized Extended Reality Interfaces. In Proceedings of ACM CHI 2024.

2023
Gaze Ray Cursor
Chen, D. L., Giordano, M., Benko, H. Grossman, T., and Santosa, S. (2023). Gazeraycursor: Facilitating Virtual Reality Target Selection by Blending Gaze and Controller Raycasting. In Proceedings of the 29th ACM Symposium on Virtual Reality Software and Technology (VRST 2023).
Mid-Air Virtual Keyboard
Dudley, J.J., Zheng, J., Gupta, A., Benko, H., Longest, M., Wang, R. and Kristensson, P.O. (2023). Evaluating the Performance of Hand-based Probabilistic Text Input Methods on Mid-air Virtual Querty Keyboard. In IEEE Transactions on Visualization and Computer Graphics.
RIDS: Implicit Detection of A Selection Gesture Using Hand Motion Dynamics During Freehand Pointing in Virtual Reality
Xu, X., Yu, M., Jonker, T.R., Todi, K., Lu, F., Qian, X., Belo, J., Wang, T., Li, M., Mun, A., Wu, T.Y., Shen, J., Zhang, T., Kokhlikyan, N., Wang, F., Sorenson, P., Kim, S.K., and Benko, H. (2023). XAIR: A Framework of Explainable AI in Augmented Reality. In Proceedings of ACM CHI '23.
ACM CHI 2023 Best Paper Honorable Mention
Mid-air eyes away typing
Gupta, A., Sendhilnathan, N., Hartcher-O'Brian, J., Pezent, E., Benko, H., and Jonker, T.R. (2023). Investigating Eyes-away Mid-air Typing in Virtual Reality using Squeeze haptics-based Postural Reinforcement. In Proceedings of ACM CHI '23.
Fashimpaur, J., Karlson, A., Jonker, T.R., Benko, H., and Gupta, A. (2023). Investigating Wrist Deflection Scrolling Techniques for Extended Reality. In Proceedings of ACM CHI '23.
Zhao, M., Pierce, A.M., Tan, R., Zhang, T., Wang, T., Jonker, T.R., Benko, H., and Gupta, A. (2023). Gaze Speedup: Eye Gaze Assisted Gesture Typing in Virtual Reality. In Proceedings of ACM Intelligent User Interfaces (ACM IUI 23).

2022
RIDS: Implicit Detection of A Selection Gesture Using Hand Motion Dynamics During Freehand Pointing in Virtual Reality
Zhang, T., Hu, Z., Gupta, A., Wu, C.-H., Benko, H., and Jonker, T.R. (2022). RIDS: Implicit Detection of A Selection Gesture Using Hand Motion Dynamics During Freehand Pointing in Virtual Reality. In Proceedings of ACM User Interface Software and Technology (ACM UIST '22).
pdf
Optimizing the Timing of Intelligent Suggestion in Virtual Reality
Yu, D., Desai, R., Zhang, T., Benko, H., Jonker, T.R., and Gupta, A. (2022). Optimizing the Timing of Intelligent Suggestion in Virtual Reality. In Proceedings of ACM User Interface Systems and Technology (ACM UIST '22).
pdf
Peacock, C.E., Lafreniere, B., Zhang, T., Santosa, S., Benko, H., and Jonker, T.R. (2022). Gaze as an Indicator of Input Recognition Errors. In Proceedings of the ACM on Human-Computer Interaction. Volume 6. Issue ETRA.
pdf

2021
RotoWrist Device
Parizi, F. S., Kienzle, W., Whitmire, E., Gupta, A., and Benko, H. (2021). RotoWrist: Continuous Infrared Wrist Angle Tracking using a Wristband. In Proceedings of ACM VRST '21.
Toward gaze-based prediction
David-John, B., Peacock, C. E., Zhang, T., Mudison, T. S., Benko, H., and Jonker, T. R. (2021). Towards gaze-based prediction of the intent to interact in virtual reality. In Proceedings of ACM Symposium on Eye Tracking Research & Applications (ACM ETRA '21).
pdf
False Positive vs. False Negative Errosts
Lafreniere, B., Jonker, T. R., Santosa, S., Parent, M., Glueck, M., Grossman, T., Benko, H., and Wigdor, D. (2021). False Positives vs. False Negatives: The Effects of Recovery Time and Cognitive Costs on Input Error Preference. In Proceedings of ACM UIST '21.
Typing Coactivation Study
Foy, C. R., Dudley, J., Gupta, A., Benko, H., and Kristensson, P.O. (2021). Understanding, Detecting and Mitigating the Effects of Coactivations in Ten-Finger Mid-Air Typing in Virtual Reality. In Proceedings of ACM CHI '21.
ACM CHI 2021 Best Paper Honorable Mention
ElectroRing
Kienzle, W., Whitmire, E., Rittaler, C., and Benko, H. (2021). ElectroRing: Subtle Pinch and Touch Detection with a Ring. In Proceedings of ACM CHI '21.
Armstrong
Li, Z., Chan, J., Walton, J., Benko, H., Wigdor, D., and Gluek, M. (2021). Armstrong: An Empirical Examination of Pointing at Non-Dominant Arm-Anchored UIs in Virtual Reality. In Proceedings of ACM CHI '21.
Peacock, C. E., David-John, B., Zhang, T., Murdison, T. S., Boring, M. J., Benko, H., & Jonker, T. R. (2021). Gaze signatures decode the onset of working memory encoding. In CHI ‘21 workshop “Eye Movements as an Interface to Cognitive State”.

2020
PredictivePointing
Gupta, A., Samad, M., Kin, K., Kristensson, P.O., and Benko, H. (2020). Investigating Remote Tactile Feedback for Mid-Air Text-Entry in Virtual Reality. In Proceedings of IEEE ISMAR '20.
pdf
Acoustico
Gong, J., Gupta, A. and Benko, H. (2020). Acustico: Surface Tap Detection and Localization using Wrist-based Acoustic TDOA Sensing. In Proceedings of ACM UIST '20.
Head-Coupled Gaze
Henrikson, R., Grossman, T., Trowbridge, S., Wigdor, D., and Benko, H. (2020). Head-Coupled Kinematic Template Matching: A Prediction Model for Ray Pointing in VR. In Proceedings of ACM CHI '20.
RoleAIinAR
Jonker, T. R., Desai, R., Carlberg, K., Hillis, J., Keller, S., and Benko, H. (2020). The Role of AI in Mixed and Augmented Reality Interactions. In CHI '20 workshop "Artificial Intelligence for HCI: A Modern Approach".
pdf

2019
ActiTouch
Zhang, Y., Kienzle, W., Ma, Y., Ng, S. S., Harrison, C., and Benko, H. (2019). ActiTouch: Robust Touch Detection for On-Skin AR/VR Interfaces. In Proc. of ACM UIST 2019.
RL Labeling
Gebhardt, C., Hecox, B., van Opheusden, B., Wigdor, D., Hillis, J., Hilliges, O., and Benko, H. (2019). Learning Cooperative Personalized Policies from Gaze Data. In Proc. of ACM UIST 2019.
Tasbi
Penzent, E., Israr, A., Samad, M., Robinson, S., Agrawal, P., Benko, H., and Colonnese, N. (2019). Tasbi: Multisensory Squeeze and Vibrotactile Wrist Haptics for Augmented and Virtual Reality. In Proc. of World Haptics Conference (WHC 2019).
PerformanceEnvelopesVRTyping
Dudley, J., Benko, H., Wigdor, D., and Kristensson, P.O. (2019). Performance Envelopes of Virtual Keyboard Text Input Strategies in Virtual Reality. In Proc. of IEEE ISMAR 2019.
HapticPhone
Maiero, J., Eibich, D., Kruijff, E., Hinkenjann, A., Stuerzlinger, W., Benko, H., Ghinea, G. (2019). Back-of-Device Force Feedback Improves Touch Screen Interaction for Mobile Devices. IEEE Transactions on Haptics (TOH). doi: 10.1109/TOH.2019.2911519
PseudoHapticWeight
Samad, M., Gatti, E., Hermes, A., Benko, H., and Parise, C. (2019). Pseudo-Haptic Weight: Changing the Perceived Weight of Virtual Objects By Manipulating Control-Display Ratio. In Proc. of ACM CHI 2019.
pdf

2018
Strasnick, E., Holz, C., Ofek, E., Sinclair, M. and Benko, H. (2018). Haptic Links: Bimanual Haptics for Virtual Reality Using Variable Stiffness Actuation. In Proc. of ACM CHI '18.
HapticRevolver
Whitmire, E., Benko, H., Holz, C., Ofek, E. and Sinclair, M. (2018). Haptic Revolver: Touch, Shear, Texture, and Shape Rendering on a Reconfigurable Virtual Reality Controller. In Proc. of ACM CHI '18.
ACM CHI 2018 Best Paper Honorable Mention
CaneController
Zhao, Y., Bennett, C., Benko, H., Cutrell, E., Holz, C., Morris, M. and Sinclair, M. (2018). Enabling People with Visual Impairments to Navigate Virtual Reality with a Haptic and Auditory Cane Simulation. In Proc. of ACM CHI '18.
CLAW
Choi, I., Ofek, E., Benko, H., Sinclair, M. and Holz, C. (2018). CLAW: A Multifunctional Handheld Haptic Controller for Grasping, Touching, and Triggering in Virtual Reality. In Proc. of ACM CHI '18.
MRTouch
Xiao, R., Schwartz, J., Wilson, A.D., and Benko, H. (2018). MRTouch: Adding Touch Input to Head-Mounted Mixed Reality. IEEE Transactions on Visualization and Computer Graphics (TVCG) 24(4). Presented at IEEE VR 2018 Conference

2017
MeetAlive
Fender, A.R., Benko, H. and Wilson, A.D. (2017). MeetAlive: Room-Scale Omni-Directional Display System for Multi-User Content and Control Sharing. In Proc. of ACM Interactive Surfaces and Spaces (ISS) 2017.
ACM ISS 2017 Best Paper Award
HybridHFRDepth
Lu, J., Benko, H., and Wilson, A.D. (2017). Hybrid HFR Depth: Fusing Commodity Depth and Color Cameras to Achieve High Frame Rate, Low Latency Depth Camera Interactions. In Proc. of ACM CHI 2017.
ACM CHI 2017 Best Paper Honorable Mention
SparseHapticProxy
Cheng, L.-P., Ofek, E., Holz, C., Benko, H., and Wilson, A. (2017). Sparse Haptic Proxy: Touch Feedback in Virtual Environments Using a General Passive Prop. In Proc. of ACM CHI 2017.

2016
NormalTouch
Benko, H., Holz, C., Sinclair, M., and Ofek, E. (2016). NormalTouch and TextureTouch: High-fidelity 3D Haptic Shape Rendering on Handheld Virtual Reality Controllers. In Proc. of ACM UIST 2016.
ACM UIST 2016 Best Paper Honorable Mention
Invited for Reprise Presentation at ACM Siggraph 2017
Sparse Periphery
Xiao, R. and Benko, H. (2016). Augmenting the Field-of-View of Head-Mounted Displays with Sparse Peripheral Displays. In Proc. of ACM CHI 2016.
ACM CHI 2016 Best Paper Honorable Mention
Haptic Retargeting
Azmandian, M., Hancock, M., Benko, H., Ofek, E., and Wilson, A.D. (2016). Haptic Retargeting: Dynamic Repurposing of Passive Haptics for Enhanced Virtual Reality Experiences. In Proc. of ACM CHI 2016.
ACM CHI 2016 Golden Mouse Award (best video)
Snap To Reality
Nuernberger, B., Ofek, E., Benko, H., and Wilson, A.D. (2016). SnapToReality: Aligning Augmented Reality to the Real World. In Proc. of ACM CHI 2016.
Pre Touch
Hinckley, K., Heo, S., Pahud, M., Holz, C., Benko, H., Sellen, A., Banks, R., O'Hara, K., Smyth, G., and Buxton, W. (2016). Pre-Touch Sensing for Mobile Interaction. In Proc. of ACM CHI 2016.
Room2Room
Pejsa, T., Kantor, J., Benko, H., Ofek, E., and Wilson, A.D. (2016). Room2Room: Enabling Life-Size Telepresence in a Projected Augmented Reality Environment. In Proc. of ACM Conference on Computer Supported Cooperative Work (CSCW 2016).
ACM CSCW 2016 Best Paper Award

2015
FoveAR
Benko, H., Ofek, E., Zheng, F., and Wilson, A. D. (2015). FoveAR: Combining an Optically See-Through Near-Eye Display with Spatial Augmented Reality Projections. In Proc. of ACM UIST 2015.
Sensing Tablet Grasp
Yoon, D., Hinckley, K., Benko, H., Guimbretiere, F., Irani, P., Pahud, M., and Gavriliu, M. (2015). Sensing Tablet Grasp + Micro-mobility for Active Reading. In Proc. of ACM UIST 2015.
IllumiRoom
Jones, B., Benko, H., Ofek, E., and Wilson, A. D. (2015). IllumiRoom: Immersive Experiences Beyond the TV Screen. Communications of the ACM, Vol. 58 No. 6, Pages 93-100.10.1145/2754391
Juggling Knibbe
Knibbe, J., Benko, H., and Wilson, A. (2015). Juggling the Effects of Latency: Motion Prediction Approaches to Reducing Latency in Dynamic Projector-Camera Systems. Microsoft Research Technical Report MSR-TR-2015-35. May, 2015.

2014
CrossMotion
Wilson, A. D. and Benko, H. (2014). CrossMotion: Fusing Device and Image Motion for User Identification, Tracking and Device Association. In Proc. of ACM International Conference on Multimodal Interaction (ICMI 2014).
Interacting Above and Beyond the Display
Wilson, A.D. and Benko, H. Special Issue Guest Editors (2014). Interacting Above and Beyond the Display. IEEE Computer Graphics and Applications, 34:3, May-June. 20-21.
Dyadic Projected Spatial Augmented Reality
Benko, H., Wilson, A. D., Zannier, F. (2014). Dyadic Projected Spatial Augmented Reality. In Proc. of ACM UIST 2014.
RoomAlive
Jones, B., Sodhi, R., Murdock, M., Mehra, R., Benko, H., Wilson, A., Ofek, E., MacIntryre, B., Raghuvanshi, N., Shapira, L. (2014). RoomAlive: Magical Experiences Enabled by Scalable, Adaptive Projector-Camera Units. In Proc. of ACM UIST 2014.
Grip Stylus+Pen
Hinckley, K., Pahud, M., Benko, H., Irani, P., Gavriliu, M., Guimbretiere, F., Chen, X., Matulic, F., Buxton, W., Wilson, A. D. (2014). Sensing Techniques for Tablet+Stylus Interaction. In Proc. of ACM UIST 2014.
ACM UIST 2014 Best Paper Award
Invited for Reprise Presentation at ACM Siggraph 2015
TouchMover
Sinclair, M., Pahud, M. and Benko, H. (2014). TouchMover 2.0 - 3D Touchscreen with Haptic Feedback and Haptic Texture. In Proc. of IEEE Haptics Symposium (HAPTICS '14).

2013
TouchMover
Sinclair, M., Pahud, M. and Benko, H. (2013). TouchMover: Actuated 3D Touchscreen with Haptic Feedback. In Proc. of ACM Interactive Tabletops and Surfaces (ITS 2013).
ACM ITS 2013 Best Paper Award
Motion and Context Sensing Techniques for Pen Computing
Hinckley, K., Chen, X., and Benko, H. (2013). Motion and Context Sensing Techniques for Pen Computing. In Proc. of Graphics Interface 2013.
Deformable Touch
Bacim, F., Sinclair, M., and Benko, H. (2013). Understanding Touch Selection Accuracy on Flat and Hemispherical Deformable Surfaces. In Proc. of Graphics Interface 2013.
pdf
IllumiRoom
Jones, B., Benko, H., Ofek, E., and Wilson, A. D. (2013). IllumiRoom: Peripheral Projected Illusions for Interactive Experiences. ACM Siggraph 2013 Emerging Technologies. Anaheim, CA.
Best Demo Invitation to Laval Virtual, France 2014
IllumiRoom
Jones, B., Benko, H., Ofek, E., and Wilson, A. D. (2013). IllumiRoom: Peripheral Projected Illusions for Interactive Experiences. In  Proc. of ACM CHI 2013.
ACM CHI 2013 Best Paper Award
ACM CHI 2013 Golden Mouse Award (best video)
Steimle, J., Benko, H., Cassinelli, A., Ishii, H., Leithinger, D., Maes, P., and Poupyrev, I. (2013) Displays take new shape: an agenda for future interactive surfaces. (workshop) CHI Extended Abstracts 2013. p. 3283-3286
pdf
SketchSpace
Holman, D., Girouard, A., Benko, H., and Vertegaal, R. (2013). The Design of Organic User Interfaces: Shape, Sketching and Hypercontext. Interacting with Computers, Oxford Journals. 25(2): 133-142.
Touching 3D
Steinicke, F., Benko, H., Daiber, F., Keefe, D.F., and de la Rivière, J.-B. Special Issue Guest Editors (2013). Foreword to the special section on touching the 3rd dimension. Computers & Graphics. 37(3). 

2012
Aigner, R., Wigdor, D., Benko, H., Haller, M., Lindbauer, D., Ion, A., Zhao, S., and Koh, J.T.K.V. (2012). Understanding Mid-Air Hand Gestures: A Study of Human Preferences in Usage of Gesture Types for HCI. Microsoft Research Technical Report MSR-TR-2012-111. November, 2012.
Beamatron
Wilson, A. D., Benko, H., Izadi, S., and Hilliges, O. (2012). Steerable Augmented Reality with the Beamatron. In Proc. of ACM UIST 2012. p. 413-422.
MirageTable
Benko, H., Jota, R. and Wilson, A. D. (2012). MirageTable: Freehand Interaction on a Projected Augmented Reality Tabletop. In Proc. of ACM CHI 2012. p. 199-208.
LightGuide
Sodhi, R., Benko, H., and Wilson, A. D. (2012). LightGuide: Projected Visualizations for Hand Movement Guidance. In Proc. of ACM CHI 2012. p. 179-188.
ACM CHI 2012 Best Paper Honorable Mention
Steinicke, F., Benko, H., Krüger, A., Keefe, D.F., de la Rivière, J.-B., Anderson, K., Häkkilä, J., Arhippainen, L., and Pakanen, M. (2012) The 3rd dimension of CHI (3DCHI): touching and designing 3D user interfaces. CHI Extended Abstracts 2012: p. 2695-2698.
pdf

2011
MultiTouch Pen + Accelerometer
Sun, M., Cao, X., Song, H., Izadi, S., Benko, H., Guimbretiere, F., Ren, X., and Hinckley, K. (2011). Enhancing Naturalness of Pen-and-Tablet Drawing through Context Sensing. In Proceedings of ACM Interactive Tabletops and Surfaces (ITS '11). p. 83-86.
OmniTouch
Harrison, C., Benko, H., Wilson, A. D. (2011). OmniTouch: Wearable Multitouch Interaction Everywhere. In Proceedings of ACM UIST 2011. p. 441-450.
ACM UIST Lasting Impact Award 2022
PocketTouch
Saponas, T.S., Harrison, C., Benko, H. (2011) PocketTouch: Through-Fabric Capacitive Touch Input. In Proceedings of ACM UIST 2011. p. 303-308.
Virtualna Okruzenja
Pandžić, I. S., Pejša, T., Matković, K., Benko, H., Čereković, A., Matijašević, M. (2011). Virtualna Okruženja: Interaktivna 3D grafika i njene primjene. (In Croatian, translated title: Virtual Environments: Interactive 3D graphics and applications). ISBN: 978-953-197-606-0. Element d.o.o., Zagreb, September 2011.
Multi-Touch Pen
Song, H., Benko, H., Guimbretiere, F., Izadi, S., Cao, X., and Hinckley, K. (2011). Grips and Gestures on a Multi-Touch Pen. In Proceedings of ACM CHI 2011. p. 1323-1332.
Rock and Rails
Wigdor, D., Benko, H., Pella, J., Lombardo, J., and Williams, S. (2011). Rock & Rails: Extending Multi-touch Interactions with Shape Gestures to Enable Precise Spatial Manipulations. In Proceedings of ACM CHI 2011. p. 1581-1590.
SketchSpace
Holman, D. and Benko, H. (2011). SketchSpace: Designing Interactive Behaviors with Passive Materials. CHI 2011 Extended Abstracts, May, 2011.
StereoBlocks
Jota, R. and Benko, H. (2011). Constructing Virtual 3D Models with Physical Building Blocks. CHI 2011 Extended Abstracts, May, 2011.

2010
Pinch-the-Sky Dome
Benko, H. and Wilson, A. D. (2010). Multi-Point Interactions with Immersive Omnidirectional Visualizations in a Dome. In Proceedings of ACM Interactive Tabletops and Surfaces (ITS '10). p. 19-28.
Pen + Touch = New Tools
Hinckley, K., Yatani, K., Pahud, M., Coddington, N., Rodenhouse, J., Wilson, A., Benko, H., and Buxton, B. (2010). Pen + Touch = New Tools. In Proceedings of ACM UIST '10. pp. 27-36.
LightSpace
Wilson, A. and Benko, H. (2010). Combining Multiple Depth Cameras and Projectors for Interactions On, Above, and Between Surfaces. In Proceedings of ACM UIST '10. pp. 273-282.
Benko, H. and Wigdor, D. Imprecision, Inaccuracy, and Frustration: The Tale of Touch Input. In "Tabletops - Horizontal Interactive Displays". Christian Mueller-Tomfelde (ed.). ISBN: 978-1-84996-112-7. Springer HCI Series, Springer-Verlag London Ltd., April 2010.
MT Mouse Models
Benko, H., Izadi, S., Wilson, A. D., Cao, X., Rosenfeld, D., and Hinckley, K. (2010). Design and Evaluation of Interaction Models for Multi-touch Mice. In Proceedings of Graphics Interface 2010. p. 253-260.
Manual Dexterity
Hinckley, K., Yatani, K., Pahud, M., Coddington, N., Rodenhouse, J., Wilson, A., Benko, H., and Buxton, B. (2010) Manual Deskterity: An Exploration of Simultaneous Pen + Touch Direct Input. ACM CHI 2010 Extended Abstracts (alt.chi).
Pictionaire
Hartmann, B., Morris, M., Benko, H., and Wilson, A. D. (2010). Pictionaire: Supporting Collaborative Design Work by Integrating Physical and Digital Artifacts. In Proceedings of ACM CSCW '10. p. 421-424.
Three's Company
Tang, A., Pahud, M., Inkpen, K., Benko, H., Tang, J., and Buxton, B. (2010). Three's Company: Understanding Communication Channels in Three-way Distributed Collaboration. In Proceedings of ACM CSCW '10. p. 271-280.
pdf
Pinch-the-Sky Dome
Benko, H., Wilson, A. (2010). Pinch-the-Sky Dome: Freehand Multi-Point Interactions with Immersive Omni-Directional Data. CHI 2010 Extended Abstracts, April, 2010.

2009
EMG + Surface
Benko, H. Saponas, T.S., Morris, D., and Tan, D. (2009). Enhancing Input On and Above the Interactive Surface with Muscle Sensing. In Proceedings of ACM Interactive Tabletops and Surfaces (ITS '09). 93-100.
ShadowGuides
Freeman, D., Benko, H., Morris, M. R., and Wigdor, D. (2009). ShadowGuides: Visualizations for In-Situ Learning of Multi-Touch and Whole-Hand Gestures. In Proceedings of ACM Interactive Tabletops and Surfaces (ITS '09). p. 165-172.
Dome
Benko, H. (2009). Beyond Flat Surface Computing: Challenges of Depth-Aware and Curved Interfaces. In Proceedings of ACM MultiMedia '09.
Mouse 2.0
Villar, N., Izadi, S., Rosenfeld, D., Benko, H., Helmes, J., Westhues, J., Hodges, S.,  Butler, A., Ofek, E., Cao, X., and Chen, B. (2009). Mouse 2.0: Multi-touch Meets the Mouse. In Proceedings of ACM User Interface Software and Technology (UIST '09). p. 33-42.
ACM UIST 2009 Best Paper Award
Mice and Keyboards on the tabletop
Hartmann, B., Morris, M. R., Benko, H., and Wilson, A. D. (2009). Augmenting Interactive Tables with Mice & Keyboards.In Proceedings of ACM User Interface Software and Technology (UIST '09). p. 149-152.
Ripples
Wigdor, D., Williams, S., Cronin, M., White, K., Levy, R., Mazeev, M., and  Benko, H. (2009). Ripples: Utilizing Per-Contact Visualizations to Improve User Interaction with Touch Displays. In Proceedings of ACM User Interface Software and Technology (UIST '09). p. 3-12.
Separability of Manipulations
Nacenta, M., Baudisch, P, Benko, H., and Wilson, A. D. (2009). Separability of Spatial Manipulations in Multi-touch Interfaces.In Proceedings of Graphics Interface '09. Kelowna, BC, Canada, May 2009. p. 175-182.
DepthTouch
Benko, H. andWilson, A. (2009). DepthTouch: Using Depth-Sensing Camera to Enable Freehand Interactions On and Above the Interactive Surface. Microsoft Research Technical Report MSR-TR-2009-23. March, 2009.
TabletopSurvey
Benko, H., Morris, M. R., Brush, A.J.B., and Wilson, A.D. (2009). Insights on Interactive Tabletops: A Survey of Researchers and Developers. Microsoft Research Technical Report MSR-TR-2009-22. March, 2009.
pdf

2008
Sphere
Benko, H., Wilson, A. D., and Balakrishnan, R. (2008). Sphere: Multi-Touch Interactions on a Spherical Display. In Proceedings of ACM User Interface Software and Technology (UIST '08). Monterey, CA. p. 77-86.
DepthTouch
Benko, H., Wilson, A. (2008). DepthTouch: Using Depth-Sensing Camera to Enable Freehand Interactions On and Above the Interactive Surface. IEEE Workshop on Tabletops and Interactive Surfaces '08. Amsterdam, the Netherlands, October 1-3, 2008.

2007
PhD Dissertation
Benko, H. (2007). User Interaction in Hybrid Multi-Display Environments. Ph.D. Dissertation. Department of Computer Science, Columbia University, New York, NY. May 2007.
pdf
Pointer Warping
Benko, H. and Feiner, S. (2007). Pointer Warping in Heterogeneous Multi-Monitor Environments. In Proceedings of Graphics Interface '07. Montreal, Canada. May 28-30. p. 111-117.
pdf
Balloon Selection
Benko, H. and Feiner, S. (2007). Balloon Selection: A Multi-Finger Technique for Accurate Low-Fatigue 3D Selections. In Proceedings of IEEE Symposium on 3D User Interfaces. Charlotte, North Carolina, USA. March 10-11. p. 79-86.

2006
Precise dual finger selection techniques
Benko, H., Wilson, A. D., and Baudisch, P. (2006). Precise Selection Techniques for Multi-Touch Screens. In Proceedings of ACM CHI 2006 (CHI'06: Human Factors in Computing Systems). Montreal, Canada. April 24-27. p. 1263-1272.

2005
Multi-monitor mouse
Benko, H. and Feiner, S. (2005). Multi-Monitor Mouse. ACM CHI 2005 (CHI'05: Human Factors in Computing Systems) Extended Abstracts. Portland, Oregon, USA. April 2-7. p. 1208-1211.
Cross-Dimensional Gestures
Benko, H., Ishak, E.W., and Feiner, S. (2005). Cross-Dimensional Gestural Interaction Techniques for Hybrid Immersive Environments. In Proceedings of IEEE Virtual Reality (VR '05). Bonn, Germany. March 10-12. p. 209-116.

2004
VITA
Benko, H., Ishak, E.W., and Feiner, S. (2004). Collaborative Mixed Reality Visualization of an Archaeological Excavation. In Proceedings of The International Symposium on Mixed and Augmented Reality (ISMAR '04). November 2-5. p. 132-140.
Allen, P., Feiner, S. Troccoli, A., Benko, H., Ishak, E., and Smith, B. (2004). Seeing into the Past: Creating a 3D Modeling Pipeline for Archaeological Visualization. In Proceedings of International Symposium on 3D Data Processing Visualization and Transmission (3DPVT '04). p. 751-758.
pdf
Monte Polizzo
Allen, P., Feiner, S., Meskell, L., Ross, K., Troccoli, A., Smith, B., Benko, H., Ishak, E., and Conlon, J. (2004). Digitally Modeling, Visualizing and Preserving Archaeological Sites. In Proc. Joint Conference on Digital Libraries 2004 (JCDL 2004). Tuscon, AZ. June 7-11. pp. 389.
pdf
Mirage
Thorisson, K., Benko, H., Abramov, D., Arnold, A., Maskey, S., and Vaseekaran, A. (2004). Constructionist Design Methodology for Interactive Intelligences. AI Magazine. Vol. 25, No. 4. p. 77-90.

2003
MAVEN
Kaiser, E., Olwal, A., McGee, D., Benko, H., Corradini, A., Li, X., Cohen, P., andFeiner, S. (2003). Mutual Dissambiguation of 3D Multimodal Interaction in Augmented and Virtual Reality. In Proceedings of The Fifth International Conference on Multimodal Interfaces (ICMI '03). Vancouver, BC. Canada. November 5-7. p. 12-19.
SenseShapes
Olwal, A., Benko, H., and Feiner, S. (2003). SenseShapes: Using Statistical Geometry for Object Selection in a Multimodal Augmented Reality System. In Proceedings of The Second International Symposium on Mixed and Augmented Reality (ISMAR '03). Tokyo, Japan. October 7-10. p. 300-301.

2001
eIreland
Benko, H. (2001). e-Ireland: Europe's New Internet Hub. Perspectives on Business and Economics, Volume 19. Martindale Center for the Study of Private Enterprise, Lehigh University, Bethlehem, PA, USA. p. 39-48.
pdf



Selected Presentations

Benko, H. Beyond Words: Improving Interactions for AI-Assisted AR.
Keynote at IEEE ISMAR 2024. Seattle, WA.
Benko, H. Augmenting Human Capabilities for the Mixed Reality Future.
MIT HCI Seminar. Cambridge, MA. November, 2022
ETH Zurich HCI Seminar. Zurich, Switzerland. December, 2021.
pdf
Benko, H. The Future of Mixed Reality Interactions.
International XR Workshop. Auckland, New Zealand. February 12, 2021.
Keynote at ACM ISS 2020. Lisbon, Portugal. 
Stanford HCI Seminar. Stanford, CA. Oct. 16, 2020.
Keynote at IEEE AIVR 2019. San Diego, California.
pdf
Benko, H. The ABC of MR Interactions.
Keynote at IEEE ISMAR 2018. Munich, Germany.
pdf
Benko, H. VR Haptic Controllers: Multi-Purpose Handheld Haptics Beyond Vibro-Tactors.
Keynote at Haptic Symposium 2018. San Francisco, CA. March 25, 2018.
pdf
Benko, H. (2017). Perception Equals Reality.
VR World Congress in Bristol, UK. April 12, 2017.
University of British Columbia, Lecture Series. February 9, 2017.
Simon Fraser University, February 10, 2017.
pdf
Benko, H. (2015). Interacting with Photons: Creating Interactive Projected Augmented Reality Experiences.
TUX Sander's Distinghished Speaker Series in Toronto, ON. October 13, 2015.
Columbia University CS Lecture Series. New York, NY. October 14, 2015.
New York University CS Lecture Series. New York, NY. October 15, 2015.
pdf
Benko, H. (2013). Istraživanja iz Microsoft Research-a na području proširene stvarnosti. (in Croatian).
WinDays Conference. Umag, Croatia, April 24, 2013.
Benko, H. (2013). Beyond Flat Displays.
ACM CHI '13 Workshop on Displays Take New Shape. April 28, 2013.
Benko, H. (2012). Rich Augmented Reality Interactions Without Goggles, Gloves or 3D Trackers.
DUB Research Talk. University of Washington. January 4, 2012.
Benko, H. (2011). High-fidelity Augmented Reality Interactions.
Microsoft Research Latin American Faculty Summit. Cartagena, Colombia. May 19, 2011.
Benko, H. (2011). Multi-touch Interactions on Small Input Devices.
DUB Research Talk. University of Washington. February 2, 2011.
Benko, H. (2009). Alternative Form Factors of Surface Computing.
Microsoft Research Faculty Summit. July 15, 2009.
Wilson, A. D. and Benko, H. Riffing on Surface.
Department of Computer Science. Invited Lecture. University of California Santa Barbara. March 6, 2009.
Benko, H. Non-Flat Surface Computing.
Microsoft Research Cambridge Lab. September 15, 2008.
VITA
Benko, H. Collaborative Mixed Reality Visualization of an Archaeological Excavation.
MIT Media Lab. Invited Lecture. January 12, 2005.
Ph.D. Seminar, Computer Science, Columbia University. November 23, 2004.