Assignment 2/3 Report

Share this post:

Introduction

https://img.freepik.com/premium-vector/teacher-student-class_97632-544.jpg?w=1380

Imagine a classroom where the teacher flips through pages of random objects and the students guess what they are after evaluating or hearing more hints from the teacher. This creates a development of not only the kids’ vocabulary but also additional knowledge of the objects the teacher is explaining about.

With the help of AR technology, student can enrich their picture-word matching game experience and enhance learning with the ability to inspect 3D models in details with fun and ease. The 3D models also feature virtual noticeboards that explain more about the object they are inspecting so that the students can obtain more insights about the object rather than merely learning new vocabularies. Lastly, the upbeat background music also brings an exciting positive atmosphere to the learning environment.

Pitch Video

Application Description

With the help of AR technology, the app is able to elevate the picture-word matching game experience by simulating 3D models into the real environment so that the user can freely and easily observe them and learn more from it.

Duality of Virtual Interface

The virtual AR interface brings the technology side (via the camera and the Vuforia Engine) and the experience side (mimicking people’s natural ability to circle around objects and view them). This creates an affordance of a life-like and intuitive viewing experience as if you are in a real physical gallery.

Human Computer Design Process

The interface problem
1. In a normal classroom, students can only see the 2D pictures in the textbook. They have no additional knowledge of the realistic depth that allows them to see into spaces, notice the movement of light and shadows, and gain a fuller understanding of what's being shown.
2. Students only sit and guess. There is very minimal physical activity to do this. Often, it leads to arguments when there is a large group.
Requirements of the interface solution
1. An accurate but basic 3D representation of the real world objects are needed to instil a good mental foundation of how kids understand
2. Ability to circle around the object and zoom in/out to inspect
3. Visual aids (Virtual sign boards explaining what the object is about)
4. Audio aids (The application can also maintain the voice delivered explanations of the objects like in real classrooms)
5. Wireless web-camera equipped devices (e.g, phones.)
6. Ability to self-pace themselves with their inspection of the models and give answers by themselves on their own phones (No more arguments)
Suitable interface technologies
1. In a classroom where the students are relatively very young (Toddlers to pre-schoolers), the use of smaller mobile phones appear the most appropriate due to its relative safety and cost compared to VR headsets.

Interaction Design

Storyboard

Technical Development

The application requires just a web camera and image sets A and B to enjoy the full experience of a picture-word match game. Due to the mobility requirement of the camera, it is best played on a mobile phone.

Image Targets

Generated via: https://www.brosvision.com/ar-marker-generator/

Set A

The images below are the image targets that generate 3D models.

Set B

The images below are image targets that are to be matched with Set A images to confirm if your answer is correct or not.

Engagement

The application uses Vuforia Engine’s Image Targeting Technology to select and display 3D models upon detecting a familiar image.

A target image from Set A produces one of the biomes

Noticeboard explaining what the biome is about.

Under the same engine, it also utilises Image Target Collision. This helps the user to match the biomes with appropriate cards by bringing the two image targets closer in order to verify if their answer is correct or not (as explained above in Interaction Design).


The student gets it wrong by matching the Golf biome with the ‘Farm’ wild card.	The student gets it correct by matching the Golf biome with the ‘Golf’ wild card.

Descriptions of 3D Models

All 3D models were extracted from the following Unity Store Asset Pack: Low_Poly_Ultimate_Pack_5.45

In summary, each model represents a mini biome that contains characters and props that are relevant to it. As of now, there is a total of 8 biomes (Golf, Wild Wild West, Concert, Construction, Jurassic, Farm, Beach, Artic).