Intelligent Cloud-based Mobile Augmented Reality

2018 COE Engineering Design Project (LG03)

---

Faculty Lab Coordinator

Ling Guan

Topic Category

Networking

Preamble

Augmented reality (AR) is a live view of a real-world environment which is augmented by computer-generated virtual objects. The critical challenge in AR is the seamless integration of the virtual objects into the real scene. In this project, students are required to develop a cloud-based mobile AR system by addressing the challenge using machine learning, image processing and computer vision techniques.

Objective

This project aims to develop and implement an intelligent cloud-based mobile AR system to track the camera pose in real time and deliver virtual objects from cloud servers to mobile users.

Partial Specifications

The intelligent mobile AR system to be developed should: (i) deploy on iOS platform for iPhone or iPad; (ii) estimate and track camera pose in real time; (iii) deliver virtual objects from cloud server to mobile.

Suggested Approach

 Study the literature on machine learning, image recognition, camera calibration, and graphics rendering;
 Research on-demand model streaming from cloud to mobile;
 Develop a cloud-based mobile AR prototype with Open Source Computer Vision (OpenCV) library, Xcode, and Unity game engine;
 Test the prototype for typical utility conditions.

Group Responsibilities

This project will be done by a group of three students. It is expected that all three students are involved in all aspects of the project. Study the techniques/algorithms in machine learning, camera calibration, image recognition, and graphics rendering. The students will learn practical programming skills in C++ and objective-C, and get familiar with Open Source Computer Vision (OpenCV) library, iOS software development, and Unity game engine. All students are responsible for the demo and project report.

Student A Responsibilities

Software development, testing and demonatration

Student B Responsibilities

Software development, testing and demonstration

Student C Responsibilities

Software development, testing and demonstration

Course Co-requisites

Software engineering, cloud computing, image analysis