external image Rmuj5Rv.jpg
Developer
Magic Leap
Display
Scanning fiber display with piezoelectric actuator ?
Occlusion mask with liquid crystal display(s) ?
Resolution
3840×2048 (8 Mpx) at 60 Hz ?
Optics
Zone plate diffraction patterning device (720 Hz) ?
12 layers of depth from 0.25 m to 3 m ?
Waveguide with embedded diffraction grating ?
Tracking

FOV
40°x40° ?
Weight

Release date
?
 Price
 ?

Development


Hardware


Projection device

Scanning fiber display with piezoelectric actuator with a 3840×2048 resolution (8 Mpx) at 60 Hz.

external image v1gxctk7yjube7nvdge6.jpg

Occlusion mask

Blocks light in specific pixels with liquid crystal display(s) operating at 60 Hz coupled with the projection device.

Zone plate diffraction patterning device

12 layers (focal planes) of depth from 0.25 to 3 m operating at 720 Hz for 60 Hz viewing.

Zones plates are devices that can focus the light at specific specific focal points, it's an interference pattern exploiting Fresnel diffraction. It can be created by laser printing on a transparent sheet, as it's known in the photography field.

Doesn't need to render multiple viewpoints per pixel and compromise resolution like pinlight displays (1/10 final resolution).

Probable working :
  • transmits the frame and the depth of each pixel (1 to 12 levels) each frame
  • for each depth level :
    • mask pixels from other depth levels with a high-frequency binary display (ferro-liquid, bluephase or bent-core)
    • display a specific diffraction pattern (among 12, from 0.25 to 3 m focusing) with a zone plate pattern for 1.38 ms (720 Hz)
    • project the whole frame at 60 Hz.

The resulting image projected in the eye should provoke an accomodation response and should offer low-persistance as a by-product (each layer of depth is displayed for 1.38 ms at 60 Hz).

Waveguide with embedded diffraction grating

Redirects collimated light towards the eye through the diffraction pattern while allowing transparency.
Potential manufacturer : BAE Systems PLC (2009 patent).

external image 2015001677720150016777-00000006.gif

Software


Performance requirements

4 Mpx (2560x1440) is feasible in VR with the Gear VR, 8 Mpx may be doable soon for AR, which should require a lot less rendering (only partial superposed GUIs/3D models, background is filled with the physical world).

Less bound by fillrate (the major problem on mobile) and pixel complexity. Rendering at 40°x40° is a lot less demanding than at 100°x100° for the same resolution in regard to geometry, so less bound by geometric complexity as well.

Media







In the media

http://www.nytimes.com/2014/07/15/science/taking-real-life-sickness-out-of-virtual-reality.html
http://www.roadtovr.com/what-we-know-about-magic-leap-rumored-500m-investment-funding/
http://www.technologyreview.com/news/532001/how-magic-leaps-augmented-reality-works/
http://www.technologyreview.com/news/538146/magic-leap-needs-to-engineer-a-miracle/
http://www.kotaku.com.au/2015/01/how-magic-leap-is-secretly-creating-a-new-alternate-reality/
http://gizmodo.com/how-magic-leap-is-secretly-creating-a-new-alternate-rea-1660441103
http://www.wsj.com/video/magic-leap-shows-augmented-reality-capabilities/ADBB6B11-DD22-4A02-9F6A-EA67CBCD4CD1.html
http://www.engadget.com/2015/10/20/magic-leap-wsjdlive/
http://www.theverge.com/2015/10/20/9579167/magic-leap-manufacturing
http://uploadvr.com/magic-leap-moves-past-rd-opens-facility-in-israel/
http://recode.net/2015/10/25/augmented-reality-startup-magic-leap-talks-to-alibaba-about-a-big-funding-round/
http://venturebeat.com/2015/11/13/epics-tim-sweeney-believes-vr-will-evolve-more-like-console-games-than-mobile/3/

Relevant forum threads

http://www.reddit.com/r/oculus/comments/2j65uj/google_invests_500m_in_magic_leap/
http://www.reddit.com/r/oculus/comments/2jbfv7/reportedly_on_the_verge_of_a_500m_investment/
http://www.reddit.com/r/oculus/comments/2jezr6/magic_leap_has_a_patent_on_snow_crashstyle_image/
https://developer.oculusvr.com/forums/viewtopic.php?f=26&t=10449
http://www.reddit.com/r/oculus/comments/2zt9mi/heres_a_link_to_a_public_dropbox_i_came_across_on/
https://www.reddit.com/r/oculus/comments/3fgfgd/new_magic_leap_patent_application_shows_large_fov/
https://www.reddit.com/r/oculus/comments/3pkflf/magic_leap_is_about_to_build_millions_of_its/
https://www.reddit.com/r/oculus/comments/3pklpf/shot_directly_through_magic_leap_technology/
https://www.reddit.com/r/oculus/comments/3pkcac/new_magic_leap_demo_video/
https://www.reddit.com/r/oculus/comments/3pmf1n/magic_leap_website_updated/
https://www.reddit.com/r/oculus/comments/3pmvqc/tempering_expectations_in_all_likelihood_magic/
https://www.reddit.com/r/oculus/comments/3rawed/translated_article_about_magic_leap_prototype/
https://www.reddit.com/r/oculus/comments/3sq5sn/tim_sweeney_on_magic_leap_it_felt_like_if_you/

References


External links

Official website
Magic Leap on Wikipedia

Patents

Three dimensional virtual and augmented reality display system ----- November 23, 2012
Multiple depth plane three-dimensional display using a wave guide reflector array projector - June 11, 2013
VIRTUAL AND AUGMENTED REALITY SYSTEMS AND METHODS - March 7, 2015

Display

Ultra-high resolution scanning fiber display (drawings) - January 15, 2014
Display system and method - March 14, 2014

Field of view

Ergonomic Head Mounted Display Device And Optical System - December 22, 2011
Wide-field of view (fov) imaging devices with active foveation capability - April 4, 2013
Ergonomic head mounted display device and optical system - September 11, 2013

Publications

Brian Schowengerdt publications
3D Displays using Scanning Laser Projection (pdf) by Brian T. Schowengerdt, Richard S. Johnston, C. David Melville, Eric J. Seibel (University of Washington) - SID 2012