Skip to main content

Apple’s 3D Display & Imaging patent could lead to Kinect-like gestures for future Apple TV

Apple was just granted a patent by the US Patent and Trademark Office (via Patently Apple) detailing 3D display & imaging technologies that could potentially lead to advanced Kinect-like navigation through performing gestures or manipulating holographic images within a virtual 3D space.

Essentially, this would allow you to perform hand gestures within a virtual space while your hands are displayed on a screen, allowing for precise manipulation of on-screen elements.

The patent’s inventor also notes that these imaging technologies could be used for presence detection, head tracking, and auxiliary display capabilities as well. We can’t help think of Kinect-like gaming for a potential future Apple TV, although the extent of the gestures and tech described in the patent goes well beyond current implementations.

As Patently Apple notes, the “virtual elements have no real physical embodiment” but could potentially take advantage of holographic technology that the same inventor outlined in a previous Apple patent. The application could also include audio feedback. For example a clicking sound when pressing a button within the virtual space would provide confirmation of the action.

Patently Apple explains:

“a user would place his or her left hand 120 and/or right hand 122 into the imaging volume or space. The hands would then be detected by the scanning beam. A left hand image 124 and a right hand image 126, respectively, would then be projected by the projection beam onto the display area to provide immediate feedback to the user concerning the relationship between the user’s hands and the various virtual objects within the imaging volume or space. Thus, as depicted, the user could grasp one of the knob images with the left hand by moving the left hand until the left hand image indicates that the selected virtual knob (not shown) represented by the corresponding knob image has been engaged. The knob could then be grasped and manipulated such as by rotating the knob.”

One can only imagine the implications this could have on games and business apps running on a future Apple TV. However, it appears the tech could be used as a global navigation method rather than geared towards a specific application. The patent even touches on potential uses for mobile devices such as an “interactive virtual keyboard” that would detect “finger locations and moves”.

FTC: We use income earning auto affiliate links. More.

You’re reading 9to5Mac — experts who break news about Apple and its surrounding ecosystem, day after day. Be sure to check out our homepage for all the latest news, and follow 9to5Mac on Twitter, Facebook, and LinkedIn to stay in the loop. Don’t know where to start? Check out our exclusive stories, reviews, how-tos, and subscribe to our YouTube channel

Comments

Author

Avatar for Jordan Kahn Jordan Kahn

Jordan writes about all things Apple as Senior Editor of 9to5Mac, & contributes to 9to5Google, 9to5Toys, & Electrek.co. He also co-authors 9to5Mac’s Logic Pros series.