Unity games with Gesture Recognition

2018 · Human Computer Interaction

2018SS Virtual Reality Final Project

Introduction

We implemented a gesture recognition scheme in an existed Unity game, to improve user experience and make this game more challenging

Racing game: A 2v2 racing game. there are some objects on the road, they randomly cause cars to speed up, slow down, jump, or rotate.
Gesture Recognition: In Unity, Leap Motion would detect hand and finger motions as an input. Because Leap Motion could differentiate open palm and close fist better than other gestures, we chose * right-hand fist as speedup, right open hand as slowdown; left-hand fist as right-turn left open hand as left-turn*.

Hands have to be close enough to the Leap Motion device, and there should not be any other object in front of Leap Motion
The delay between gestures and reactions of cars is not negligible

Create a more intuitive way to control cars
If combining with Google VR Cardboard, we might have a better user experience in VR games