Client

Panasonic Avionics

Project

Augmented Reality (AR) Travel App

Role

Responsible for the creation of the 2D and 3D user interface

Brief

Panasonic approached the team at Neutral Digital to develop an Augmented Reality (AR) Travel App to demonstrate how this technology could improve the passenger journey. We proposed using Microsoft Hololens, as it was the best mobile AR solution available. Having an untethered experience was paramount to the context of travel and mobility.

Process

We created a scenario in which the passenger had just landed at Singapore’s Changi Airport and had to be guided to the baggage claim. They then had to pick a mode of transportation to their hotel and would later explore the city on their way to a restaurant.

As part of this project I was responsible for the visual design and information architecture of separate interaction elements as well as testing the whole experience throughout the R&D process. The deadline was set to one month and to make the process more efficient and gather as much feedback as possible, we arranged daily design and development meetings. We would bring a piece of work to the board and discuss all together until we agreed on a design that we can improve or develop for the next meeting. 

Initial user flow sketches - from scanning your airplane ticket to arriving to the Marina Bay Sands hotel. Made by Gabriel Martzloff.

Colour scheme exploration for various experience stages

Outcome

A fully functional prototype was presented during the AIX 2016 trade show. The experience was specifically made to last less than 10 minutes . This was enough time for the user to get used to the new hardware with provided visual and voice-over guidance as well as to go through every stage, including leaving enough time to explore Singapore's map and its landmarks.

Points of interest

At the end of the experience the user can freely move inside Singapore's urban map and explore all POI around. To make the POI's interaction points clear and simple to activate, I have created three different states (shown below). When the user would focus their eyesight on the icon it would expand into a title and when air tapped it would pop up and full information would appear. 

Point of interest design in three different states (from left - rest, hover, air tapped)

Final result

Real-life journey trigger

For first time Hololens users, we decided to introduce a simple integrated gesture to trigger the digital experience. While the experience could be easily activated by any allocated colour or shape in space, I have designed a ticket with a barcode which was used as a main focus object. This ticket was also used as a promotional material which was given out during the AIX.

Ticket designed to have a distinctive barcode that is easily recognised by Hololens

Final result

Information Architecture

To better understand the possibilities of the augmented space, I had to switch to another tool that would allow me to think and create within the 3D and 4D space directly. Tiltbrush helped me to create a simple prototype of the initial user journey. 3D Developers also implemented a map within the file so I could include sketches inside and above the map. 

 

Later I would be using Illustrator to create most of the flat assets ready to be implemented in Unity and Cinema4D files at the final development stages. Those would then be refined and animated by the 3D artists and tested within the team. 

Initial exploration sketches made with TiltBrush

Final result

Reflection

The goal of this project was to show how AR technology could be implemented in our daily routines. We wanted to see if in the future people would be interested in travelling without the help of mobile and web resources. This gave us a good representation of how technology can become an integral part of our lives without creating too much distraction.

This project is the most exciting piece of work I've done so far. While the deadline was demanding, we as a team of 3D professionals, architects, animators and visual designers, worked together to make one of the first travel enhancing experiences in the world. Constant communication, a drive to explore and an open mind made all of this possible in such a short amount of time. 

While my knowledge of 3D software such as Cinema4D and Unity was limited, I was seeking advice and help from 3D artists and architects who knew how to bring my ideas into another dimension. 

Overall, I am looking for another opportunity to work on a mixed or augmented reality project that could enhance and simplify our other daily experiences. There are already many examples that brought new emotions and knowledge to our society. I am interested to explore what AR and VR can do to the everyday consumer or how it can relate to ongoing problems in our world. 

Show More