r/iOSProgramming • • Sep 10 '20

Solved! This time without delay, 60 fps! Real-time reflections in augmented reality [iPad Pro 2020]

295 Upvotes

11 comments sorted by

20

u/AR_MR_XR Sep 10 '20

In the previous demo, using AR Quick Look, we saw a delay of 2-8 seconds until the objects appear: https://www.reddit.com/r/AR_MR_XR/comments/ioplvm/realtime_reflections_in_augmented_reality_in_the/

The same goes for some other custom apps. But this demo here uses a custom app by Dan Monaghan and with his code there's no delay.

Dan Monaghan

Ok, this is the shiny sphere test. Real-time Environmental lighting, 60fps, no delay + a little bit of occlusion with the flowers! Time for some crazier shapes. Nice work @ apple #arkit #devteam #AugmentedReality #ipadpro2020 #wwdc20

https://twitter.com/danmonaghanz/status/1303461402737127424

David Liu

welp it's insane how clever it fakes a reflection map with what seems like blending a generic reflection map or some other earlier camera data ... and wrapping the current camera capture against its lower edges (note how it doesn't reflect from the front!) crazy!

https://twitter.com/thedak/status/1303814424902459392

6

u/[deleted] Sep 10 '20

Any good tutorials for getting started with ARKit?

5

u/th3suffering Sep 10 '20

Thats really neat. I thought those balls were really there and was looking around to figure out where the AR object was, and then it dawned on me.

4

u/monkeydoodle64 Sep 10 '20

Damn that looks real

3

u/vijaykharage Sep 10 '20

Satisfying yet terrifying future of AR

2

u/moi2388 Sep 10 '20

Oh wow, this is beautiful!

1

u/factor3x Sep 11 '20

This seemed so real at first it took me at least 6 second to understand what was going on.

1

u/iamthatalm Sep 11 '20

Nice to see a glimpse of what AR is capable of on a phone.