bayesrule / alongtheoceanicflow-thesis Goto Github PK

AlongTheOceanicFlow (ATOF)
Youtube video: https://www.youtube.com/watch?v=fXUbgwYNnbk
Thesis document: http://hdl.handle.net/10589/145576

Platform: Application for HoloLens.

Type: Master's degree thesis of Christian Gianluca Tagliabue in Computer Science and Engineering at Politecnico di Milano.

Languages: developed in C# (mostly) and Python. Framework: Unity + Mixed Reality Toolkit.

Technologies: HoloLens, Vuforia, Smart Objects.

Abstract:

Neurodevelopmental disorders (NDD) are pathologies that can appear in child’s early developmental process, limiting personal, cognitive and motor capabilities. The purpose of this thesis is to explore the potential of the Tangible Mixed Reality (TMR) in helping subjects affected by those pathologies. This term refers to a type of Mixed Reality (MR) including the interaction between MR devices and Smart Objects with tangible feedbacks. This innovative interaction paradigm has been instantiated in an application called Along the Oceanic Flow (ATOF). This application is designed to support NDD experts and has the goal to help people affected by NDD to improve motor and cognitive skills through game exercises. ATOF transforms the user’s room into an ocean floor full of interactive decorations in which the subject, leveraging the TMR interaction paradigm, has to complete different experiences by doing motor and cognitive tasks like collecting elements, avoiding obstacles and finding ways to open treasure chests. The tasks have been thought to be very easy to complete and, among them, there is an experience in which the difficulty of the exercises gradually increases during the game. Furthermore, all the experiences can be customized by the therapist in order to satisfy the specific needs of each user-patient, given the fact that each one of them will have a different degree of disability. An exploratory study involving 14 subjects affected by NDD has been performed to investigate the likability and usability of Along the Oceanic Flow and its potential as a therapeutic tool. ATOF was well-accepted by the participants and the activities in the TMR space were perceived as enjoyable and simple. A more extensive and long-term empirical research is needed to validate these early results, but the study suggests that ATOF, and more generally the applications based on the TMR paradigm, could be adopted as a complement to more traditional interventions. This work, the problems encountered, and the solutions implemented, could be inspirational for the designers and developers of future TMR applications dedicated to people affected by NDD and not only.