May 2018 – onebyonedesign

So here’s a little trick for mapping a device camera image onto a 3D model when using Unity3D and Google’s ARCore in order to create some realistic environment reflections and further blend augmented reality with plain old reality. I originally got the idea from this Unity blog post. Before digging into John Sietsma’s solution, though, I implemented my own and figured there were big enough differences to warrant describing my own approach. Before jumping into some code, here’s a little look at the effect in action. You can see how the floating torus reflects both the color of the candle as well as my hand waving around it. In this video, the reflection amount is set to .85 and the blur amount to 7 (those properties will be made clear later): Overview From a high perspective, the effect is achieved by taking the camera image, blurring it, then mapping it onto a 3d model using radial coordinates based on the world normals. Is the effect perfect? Not at all. Really the entire thing is faked. First, because we’re using the camera as an environment map, it’s entirely possible to see an item behind the 3d model reflected in front of it. Also, […]
Read More

Pickle Rick in Augmented Reality

Environment Mapping with ARCore and Unity3D

Devon O. Wolfgang

Categories

Recent Comments

Archives