@daringfireball@gruber What if it’s more of a “transparency mode” type of effect? Meaning the outward facing display will show the actual person’s eyes as captured by the inward-facing cameras, creating the illusion that the headset is see through. Not sure if it’s actually feasible though, considering current technology and the impact on battery life
@tomwinzig@provuejim@brianyap No, think about it: it's completely dark inside an XR headset. Cameras won't work. They'll need other sensors for gaze tracking.
@gruber@provuejim@brianyap FaceID can literally change the realtime video so that your irises look like they're aimed at the camera (viewer). Colorizing or grayscaling an infrared image in realtime doesn't seem too hard, but again maybe they're going to use the visible light from the inward facing screens?
@gruber@provuejim@brianyap The other thing about these inward facing cameras capturing your face is that Apple is likely to use all of this not (just?) for googly eye outward view, but for your avatar within VR.
In terms of photorealism, they could have you use your iPhone camera to capture a good high def 3D model of your face, and then use the internal sensors to fuse them into a realistic 3D avatar (regardless of whether they then display any of that on the exterior of the device).
@tomwinzig@provuejim@brianyap You're right. If they're going to make high-res avatars for FaceTime, they could use the same for an outward screen. But it stlil seems like a dumb goofy idea that would be a waste of money and battery life.
@gruber@provuejim@brianyap Yeah it does seem like a waste of battery life, but then again isn't the current rumor that you have to wear a fanny pack battery for this thing 😬
Also what if the front screen isn't a traditional retina screen, but something less intensive that just gives you "a hint" of their eyes/face, enough to make eye contact?
@brianyap How would that work with parallax? What if I'm wearing the headset and you're looking at my face -- and you're not directly in front of me? There's no way to avoid the fact that the image of my face would appear painted on the surfaces of the goggles.
Add comment