Project Five | 2021 

LiDAR Try-On



Project

Exploring LiDAR Technology and 3D Body Scanning

Role
Creative Technologist

Description

LiDAR Try-On mobile app offers virtual experiences by harnessing the power of LiDAR (Light Detection and Ranging) technology. Through precise 3D body scanning, the app provides users with accurate measurements and an authentic representation of themselves, eliminating the need for generic avatars. This approach ensures a truly personalized and immersive virtual experience that could surpass expectations.



Takeaway
This project offered an exciting opportunity to dive deep into LiDAR technology and explore its multifaceted implications within the fashion industry. Through this exploration, I learned about the nuances of 3D body scanning, the challenges of achieving high-fidelity digital representations, and the practicalities of integrating such advanced capabilities into a consumer-facing mobile application. Ultimately, this led to proposing a mobile app that allows users to virtually try on clothes and visualize themselves in AR/VR spaces.

Currently, while mobile devices equipped with LiDAR offer impressive capabilities, the raw 3D scans can still present glitches and imperfections. At this stage, external, third-party software often remains crucial for making the necessary corrections and delivering a polished 3D body scan that can accurately map digital garments onto a user's precise body dimensions.

Looking ahead, the potential for LiDAR technology in fashion is immense. My vision for future iterations of this concept involves a day when our mobile devices alone can perform highly accurate scans, enabling truly immersive virtual try-ons directly within our homes, facilitated by advanced Augmented Reality and Virtual Reality. In the near future, the integration of Artificial Intelligence (AI) will undoubtedly play a pivotal role in streamlining and enhancing this process, potentially automating corrections and improving the fidelity of scans and garment mapping. Exploring the powerful synergy between LiDAR and AI presents an incredibly interesting and impactful area for continued development within the fashion technology landscape.




What am I Augmenting?
Enhance the virtual try-on experience with a LiDAR-powered solution that enables precise 3D body scanning, offering users accurate measurements and an authentic digital representation of themselves, thereby moving beyond generic avatar recommendations.




Foreground
The presence of LiDAR technology on mobile devices presents significant future potential. These compact LiDAR systems can efficiently scan and acquire a richer dataset of environmental information. Their enhanced range and scanning capabilities lead to superior object detection, particularly in discerning the spatial relationship and depth of objects relative to one another.



Problem
The conventional process of digitizing user data, often reliant on manual input for profiling, frequently leads to a negative user experience. This friction can deter users from providing personal data and is prone to inaccuracies and human error, undermining the reliability of digital profiles.





                                                 

Paper Prototyping

Welcome Page - Sign Up
Virtual Try-On

Virtual Fashion Show
Discover Models






Welcome Page
Welcome to LiDAR Try-On. This initial screen serves as the gateway to the virtual try-on experience, allowing users to seamlessly create a new account or sign in to an existing one.



Sign Up Page
As part of the sign-up process, users provide explicit consent by agreeing to the app's Privacy & Policy. Transparency is key, and users are informed that their permission can be withdrawn at any time, ensuring control over their personal data.



Home Page
The Home Page acts as the central hub for the user's personalized experience. From here, users can access and manage their profile, and most importantly, initiate the LiDAR scanning process to begin their virtual try-on journey.




             
     











How to Scan
This section provides users with essential tips and best practices to ensure they achieve the highest quality LiDAR scans. It educates users on proper scanning techniques to maximize accuracy and detail.



Processing the Scan
This crucial stage involves the transformation of raw LiDAR data into precise body measurements. It details the intricate processes of data execution, the algorithmic measurements performed, and the rigorous quality control checks implemented to ensure the integrity and accuracy of the final 3D body model.
3D Scanning Processing













Go Shopping
This section redefines the shopping experience, moving beyond traditional product discovery. By leveraging the accuracy of LiDAR scans, users are presented with a more authentic-looking and comprehensive real-time motion capture of garments on their own 3D body model. This sophisticated approach powers a digital personalization and recommendation system, significantly reducing the time and friction users typically encounter while exploring and finding desired garments. The streamlined interface and intuitive design also lead to a remarkable reduction in the number of clicks required, ensuring a seamless and efficient shopping journey.




              
     











Measurment
The core of the LiDAR Try-On experience begins with precise body measurement. During the scanning process, users adopt a specific posture – feet apart and arms extended – to ensure the creation of a comprehensive 3D body model perfectly suited for digital garment design. This method enables the seamless overlapping of 3D garment designs onto the scanned human body, offering an authentic virtual try-on experience.


Beyond accurate fit, the platform features a interface for virtual try-ons, complemented by quick and easy methods for sharing. This ensures a more adequate fit-matching of garments to consumers than traditional online shopping. Furthermore, by collecting valuable data and leveraging machine learning, the app is poised to significantly expand the e-commerce marketplace while boosting in-app engagement and facilitating social sharing among users.








Discover Model
The "Discover Model" feature fosters a dynamic social network between stylists and consumers, revolutionizing product presentation through augmented reality. This innovative approach allows users to virtually view garments on a diverse array of existing models, enabling them to find models whose body types and styles resonate most closely with their own.

Beyond enhanced visualization, this feature provides invaluable insights into user behavior and preferences. The rich data collected through these interactions can be leveraged for sophisticated demand forecasting and optimizing supply chain planning. Ultimately, "Discover Model" significantly improves a brand's ability to precisely match consumers with their desired products, creating a more efficient and personalized shopping ecosystem.




              
    










AR/VR
The AR/VR Space transforms the try-on experience by bringing garments into the user's real environment. By simply pressing the AR button, users can enter augmented reality mode, where their scanned body or chosen model, adorned with the selected garment, appears within their physical surroundings.

Users can intuitively pinch to adjust the scale of the virtual garment and model, ensuring a perfect fit within their space. This feature allows for unparalleled experimentation, enabling users to place their chosen attire in various real-world settings – from their living room to an outdoor scene – to truly visualize how it looks and moves. The seamless integration of sharing capabilities further enhances the experience, allowing users to effortlessly share their AR try-ons with friends or stylists.