The Challenge
Letting someone virtually try on accessories like hats and bracelets in AR requires accurately tracking head and hand movement in real time — get the tracking even slightly wrong and the accessory visibly floats or lags behind the body part it’s supposed to sit on, breaking the illusion immediately.
Our Approach
We built the fitting experience around real-time head and hand tracking specifically, rather than a generic flat face-filter approach, since accessories worn on the head and hands need to move and rotate convincingly with the body part they’re attached to. Built in Unity with C# for the tracking and placement logic behind each accessory type.
Key Features
- Real-time head tracking for hat and headwear placement
- Real-time hand tracking for bracelet and wrist accessory placement
- Accurate movement tracking so accessories move naturally with the wearer
- Built for a fashion try-on use case
Outcome
An AR virtual try-on experience letting users try fashion accessories like hats and bracelets before buying.
Leave a Comment