Talk to me
Work and Productivity
In January 2024, I participated in MIT Reality Hack, the premier XR hackathon, hosted at the MIT Media Lab. Sponsored by Meta, we focused on the work and productivity track, aiming to develop an XR application to enhance workplace connections and productivity across devices.
Utilizing the Meta Quest 3 device and Meta's toolkits, we successfully created a robust XR application tailored to our objectives. Our solution not only facilitated seamless collaboration but also fostered deeper interpersonal connections among users, regardless of their XR device.
The culmination of our efforts resulted in winning the hackathon, showcasing the effectiveness and innovation of our project in the XR landscape.
Project Type
XR Design Hackathon
2023 / (6 Months)
Team
Tools
Blender, Unity, Meta Presence, Figma, Adobe CC
Research
The internet's inception in 1990 reshaped global connectivity, fostering remote work trends. COVID-19's impact in 2020 highlighted the need for real-time communication, driving platforms like Zoom into mainstream use. Despite a plethora of communication apps, workplace effectiveness remains a challenge.
Recognizing this, we explored AR/VR's potential to revolutionize remote interactions. Our aim: to create inclusive, accessible solutions that redefine workplace communication for all.
Proposed User Flow
Questions at hand
To ensure a seamless transition towards collaborative work using XR technology, it's imperative to address the potential constraints faced by early adopters. This challenge arises from the coexistence of XR users with colleagues utilizing non-XR devices, necessitating solutions that uphold inclusivity and productivity for all team members.
How can we facilitate seamless communication between XR and non-XR employees within a workspace, ensuring that the experiences of both groups are enhanced rather than compromised?
Design
Based on both a survey conducted during the hackathon and existing literature, our findings indicate a clear preference for real-time communication over text messages in workplace environments. This preference is attributed to its efficiency and effectiveness in completing tasks promptly.
Avg. in-person conversational response time
Average text message response time
Tech Stack
To develop Talk to Me, we extensively used the Meta Presence Platform, delving into its Passthrough SDK, Interaction SDK, and Voice SDK. For cloud-based communication between users, we employed the Photon server integrated with Slack. Additionally, we utilized Unity for crafting personalized avatars and dynamic animations to enrich the user experience.
Gallery
