System and Methods for On Body Gestural Interfaces and Projection Displays

Abstract

A wearable system with a gestural interface for wearing on, for instance, the wrist of a user. The system comprises an ultrasonic transceiver array structure and may comprise a pico projector display element for displaying an image on a surface. User anatomical feature inputs are received in the form of ultrasound signals representative of a spatio-temporal cross-section of the wrist of the user by articulating wrist, finger and hand postures, which articulations are translated into gestures. Inputs from inertial and other sensors are used by the system as part of the anatomical feature posture identification method and device. Gestures are recognized using a mathematically-modeled, simulation-based set of biological metrics of tissue objects, which gestures are converted to executable computer instructions. Embodiments of the system disclosed herein may also be used to monitor biometric and health data over computer networks or using onboard systems.

What is claimed: 
     
         1 . A method for generating a gesture command comprising the steps of:
 providing a mathematical model of a plurality of tissue objects that make up a cross-section of an anatomical feature of a user based on a rigid body motion of the plurality of tissue objects and on a set of biological metrics of the plurality of tissue objects comprising the cross-section;   generating an ultrasound signal data set representative of a spatio-temporal cross-section of the plurality of tissue objects that make up the cross-section based on the mathematical model;   identifying a property of at least one of the plurality of tissue objects comprising the cross-section by correlating the ultrasound signal data set with one or more simulated ultrasound measurements generated based on the mathematical model;   estimating a position of the anatomical feature based on the identified property of the at least one tissue object that makes up the cross-section of the anatomical feature; and   generating a gesture command based on the estimated position.