The U Experience Magic Leap Campus Tour

Extended Reality, Fall 2020

by Richard Westlund

September 18, 2020

Maria del Carmen Aguilar-Velez By combining their creativity with powerful computing tools, University of Miami (UM) graduate students Maria Aguilar and Manouj Govindaraju crafted an extended reality (XR) application to welcome incoming freshman. Now, campus newcomers will be able put on a Magic Leap 1 set and ‘walk’ through the campus, learn about academics, athletics, and other topics, and listen to UM students talking about their fondest memories.

Magic Leap 1 Creator Edition

Manouj Govindaraju

“Today’s Generation Z students can get bored with conventional orientation programs and campus tours, so we wanted to engage them through an exciting, immersive experience,” said Manouj, who graduated with Maria in May with a Master of Fine Arts (MFA) degree.

For Maria, creating an interactive XR application was a “thrilling” way to use powerful computing and data tools. “It will help new students make a deep connection with the University, inspire the new generation, and seed their ‘Canes love.”

Launched by UM Student Affairs and supported by IDSC, “The U Experience” combines real-world and virtual environments in an interactive XR application that goes beyond virtual reality (digital only) and augmented reality, which adds a digital dimension to real-world video.

The U Experience Magic Leap Campus Tour

“This is a phenomenal multidisciplinary project that brings students, faculty, and research staff together,” said Nick Tsinoremas, IDSC Founding Director and Vice Provost for Research Computing and Data. “It demonstrates that that XR coupled with artificial intelligence and powerful computing represent how we will all be interacting, learning, and creating knowledge in a hybrid physical and digital world.”

Kim Grinfeder

Maria and Manouj looked at the main concerns of Generation Z students and their families about college life, and designed and developed the XR application in keeping with UM initiatives for student orientation and retention, according to Prof. Kim Grinfeder, Director of the School of Communication Interactive Media Program.

“From the outset, we wanted to provide a collaborative, forward-thinking project that allowed our students to focus on what’s next in computing.” He added “The ability to translate knowledge into a digital product is one of our priorities and it’s great to see it come together in such an innovative package.”

The U Experience Magic Leap sandwich board Magic Leap Lab

Phase one of The U Experience was tested in the Magic Leap Lab at the Richter Library last August (2019). “That gave us a great opportunity to try the first version of the app with users, learn from them, and come up with this new version,” said Maria. “The support we received from IDSC and our advisors from the Interactive Media Program was amazing.”

IDSC provided technical support including access to the University’s supercomputer. “The team used a LiDAR (Light Detection and Ranging) laser system to measure distances across the University, and provided us with the generated 3D mesh, which we were able to directly plug into the application,” said Manouj. “The scale of the project would not have been the same, if not for the IDSC’s computing resources.”

Maria noted that the benefits of XR include increased content understanding, better grasp of spatial structures, long-term memory retention, and increased student motivation, and that XR applications can significantly change the way information is delivered to college students. “This project provides opportunities for future development, such as adding more layers of information, exploring new interactions with data visualizations, and testing the experience in other platforms,” she said. “It also opens up opportunities for evaluation and comparison with traditional programs for freshmen orientation.”

Both Maria and Manouj felt the XR project was a powerful learning experience, helping them develop their data science skills, while contributing to the future of the University. “When designing an extended reality app, there seem to be a million possibilities,” Maria said. “Your artboard is not just a rectangle, it’s a 360° space and it takes some time to start imagining a whole new experience in 3D. But we created a new version of the app that gives the user a feeling of being in a new environment.”

“I will definitely be using
supercomputers in my future.”

Manouj plans to become an XR applications developer. “Understanding your target users is vital when developing these experiences,” he said. “I will definitely be using supercomputers in my future.”

Maria believes effective use of data is essential for any field in academics or industry. “We need to keep the research, design, and development of products, services, and applications based on data,” she said. “I’m looking forward to seeing what’s coming next.”

Transform The Way You Learn About The U

youtube.com/watch?v=ssaVlLCfWpQ

The U Experience Capstone Project

uexperience.wixsite.conm/uexperience
M.F.A. in Interactive Media
Maria Aguilar • Manouj Govindaraju

CONCEPT
By translating the concept of Magicverse, different layers of information on top of a 3D map of the University of Miami Coral Gables campus were developed. Each layer was carefully designed taking into consideration the motivations and concerns of students. The layers complement each other creating an experience that will allow students to learn about the different aspects of the University of Miami, and will help them adjust to college life.

Barbara Millet