r/iOSProgramming • u/MechaSnowflake • Aug 26 '20
Article Body Pose Detection with Apple's Vision framework
58
19
u/toastyd00d Aug 26 '20
Was this done in real-time?
16
u/MechaSnowflake Aug 26 '20
Not for this video, but it works almost as fluent in real-time (depends on the device, being better in newer iPhones).
12
5
Aug 26 '20
That's really impressive. I thought pose detection required the lidar data.
5
u/MechaSnowflake Aug 26 '20
It doesn't, but I'm sure they will eventually leverage the LiDAR scanner, having in mind that the iPhone 12 would probably have it.
5
4
2
Aug 26 '20
It's not perfect, obviously, but that's really quite remarkable. It'll only get better from here.
1
5
3
u/ProbablyANoobYo Aug 26 '20
I see our AI overlords have trouble detecting spins and flips. Who knew anime lovers could be our last line of defense
2
2
2
1
u/svangsgaard Aug 26 '20
I think they are using the PoseNet models. I've been looking into Tensorflow for doing the same thing. Chose Tensorflow for Android compatibility. But I never finished it...😀
1
0
27
u/MechaSnowflake Aug 26 '20
Full article: https://orangeloops.com/2020/08/hand-tracking-body-pose-detection-with-vision-framework/