I have explored and led various AR, VR, and MR related projects at the University of Melbourne and Deakin University. Many of these projects are in development or under review now, so I cannot put much details for now. More details to follow later:)
We investigate repurposing existing virtual reality applications as teaching platforms. A pilot study conducted using six freely available social applications on the Oculus Quest platform investigates the practical issues involved in using these applications for distributed learning in a higher education context. Recordings and reports from collaborative sessions with each application yield insights into employing virtual reality as an environment to support teaching.
In this project, we developed an AR application to assist people from migrant communities and host communities to better understand each others' culture through augmentation of everyday artefacts, bodily movements, etc. We used the lens of immersive performance to investigate how the developed tool and facilitate engagement and learning through doing. Paper currently under review in CHI 2023 Conference.
Santa’s Lil Helper (SLH) is a location based, augmented reality (AR) experience. It invited families to weave through Melbourne’s iconic inner city laneways to help track down Santa and save Christmas. Participants use their smartphone and a little Christmas magic to activate AR markers hidden around the city. By finding Santa’s merry crew and triggering 3D and 360 content, the spirit of Christmas takes on a new form across the Melbourne CBD through December.
The Augmented Studio platform uses projection mapping to turn a human body into an interactive canvas in real-time. It uses projectors and depth sensors to enable projections of an anatomy model onto a moving body for practical physiotherapy classes, allowing students to observe the dynamic changes in the anatomical configuration of the body throughout a range of movements.
This projects involves a public demonstration in collaboration with the Melbourne Science Gallery to investigate the use of On Body Projections in public settings. Body as a canvas creates an interaction loop where interaction with information causes changes in the body, which in turn changes the display of information. Our findings show that body as a canvas create connectedness between the body and information.
This has been a truely multi disciplinary team!