As a product designer at Sony, I designed new applications for sensing technology being developed by recently acquired SoftKinetic, exploring spatial and gestural interaction in the context of driving. The project culminated in an interactive demo of an augmented reality (AR) windshield HUD for CES 2017, with some interactions later integrated into BMW 7 series vehicles. I collaborated with a UX researcher to conduct a competitive audit of existing in-car gesture interfaces and designed a system of gestural interactions, including passive sensing features like pedestrian detection and driver alertness warnings. I mapped user flows, storyboarded scenarios, and developed gestures like pinch-to-view 360 maps and swipe-to-reject calls, which were implemented in BMW's vehicles. My design work for visualizing and interacting with a 3D map was awarded a patent, furthering Sony's business goals of expanding their IP portfolio in innovative automotive technologies.
CES 2017 Demo Coverage
Competitive Audit
User Journey Mapping and Storyboarding
AR User Interface and Gestural Interaction Design
BMW 7 Series Gestures
Patents
Enhancing information in a three-dimensional map, US10650037B2
Press
SoftKinetic's Gesture Control Technology Rolls Out in Additional Car Model
Sony wants you to stop touching (or talking to) your car’s infotainment system