Assignment 4 Report

Share this post:

Introduction

Imagine a world where people awkwardly bend down to read the recycling+waste information on the bins which could be basic knowledge to others and get conscious about making the line wait too long behind him/her. This is clearly a barrier to learning due to the physiological discomfort the situation poses especially in public. If managed carefully to aid learning, this can create a development of not only the rubbish thrower’s general knowledge of whatever he/she is getting rid of but also the overall fun of the activity.

With the help of AR technology, rubbish throwers can enrich their bin-rubbish matching experience and enhance learning with the additional ability to inspect 3D models and animations with fun and ease.

Pitch Video

Application Description

With the help of AR technology, the app is able to elevate the rubbish-bin matching game experience by simulating 3D models into the real environment so that the user can freely and easily observe them and read more information on it. Not only will the user become educated on what goes into which bin, he/she will understand the impact each rubbish type does to the environment creating an overall awareness of using products which create the type of rubbish in the future. This works in both ways whether it would be learning about the rubbish type or the bin.

Users:

People who come from third-world countries who are not used to recycling
Very young people who need to learn how to recycle
Very old people who need to learn how to recycle
People who are not aware of the level of impact each rubbish type has on the world

Duality of Virtual Interface

The virtual AR interface brings the technology side (via the camera and the Vuforia Engine) and the experience side (mimicking people’s natural ability to circle around objects, view and explore more information about them). This creates an affordance of a life-like and intuitive viewing experience in a one-stop location/platform.

Human Computer Design Process

The interface problem
1. In a normal rubbish bin area, the rubbish throwers can only see the 2D labels on the bins. They do not have enough depth or time to learn about the type of rubbish or bin. Recycling can be confusing or even intimidating when you are all alone without nearby assistance or in public/queues when there are so many bystanders judging you if you are going to do the right thing.
2. Rubbish throwers only throw away their rubbish and forget. There is very minimal learning activity to gain a fuller understanding of its impact on the world.
Requirements of the interface solution
1. An accurate but basic 3D representation of the rubbish type is needed to instil a good mental foundation of how rubbish throwers understand
2. Ability to circle around the object and zoom in/out to inspect
3. Visual aids (Virtual sign boards/texts explaining what the object is about and its impact on the environment)
4. Audio aids (The application can also maintain the voice delivered explanations of the objects like in a real classroom)
5. Wireless web-camera equipped devices (e.g, phones.)
6. Ability to self-pace themselves with their inspection of the models and learn by themselves on their own phones (No more stalling the queue)
Suitable interface technologies
1. In a situation where the rubbish throwers want to be traveling quick and light with rubbish potentially in their hands, the use of smaller mobile phones appear the most appropriate due to its relative safety and cost compared to VR headsets.

Interaction Design

Storyboard

Mode 1 (Bin Scanner)

Mode 2 (ARubbish - Play Mode)

Technical Development

The application requires just a web camera and image sets A and B to enjoy the full experience of a bin-rubbish matching game. Due to the mobility requirement of the camera, it is best played on a mobile phone.

This is done in two different modes namely:

MODE 1: SCAN BIN ONLY

Scanning the respective bin’s image target shows a list of rubbish types it can receive
- If the user is not happy with the list, he/she gains an incentive to keep scanning other bins
- This also promotes incidental learning in which the user gets a chance to educate him/herself with knowledge that can be handy the next time

Comment: If the user found the bin, his current rubbish could potentially go in, he can switch to Mode 2 to start the matching process

MODE 2: RUBBISH FIRST BIN LATER

Scanning the respective rubbish’s image target shows a 3D model of the rubbish-type in which the app educates the user with basic information about the rubbish type and where the rubbish could go to by showing an image target of the bin.

Comment: If there is a match, the user will be able to confirm with an ‘ok button’ then a specific animation will play (e.g, the rubbish going into the bin).

Image Targets

Set A (Bins)


Organic Waste	Recycling	General Waste

Set B (Rubbish Types)

	To be worked	To be worked
Recycling Image Target	Organic Image Target	General Waste Image Target

Engagement

The application uses Vuforia Engine’s Image Targeting Technology to select and display 3D models upon detecting a familiar image.

A target image from Set A produces a relevant information screen that the user can read to learn more about what the bin can take

Matching activity

Under the same engine, it also utilises a matching sequence. This helps the user to match the rubbish with appropriate bins by scanning the image targets provided on the bins in order to verify if their answer is correct or not (as explained above in Interaction Design).


Organic Bin via (Organic image target) rejecting the plastic bottle	Waste Bin via (Waste image target) rejecting the plastic bottle	Recycling Bin via (Recylcing image target) accepting the plastic bottle