Control a Game with AI-based Hand Gesture Recognition

2021 COE Engineering Design Project (TY04)

---

Faculty Lab Coordinator

Truman Yang

Topic Category

Software Systems

Preamble

This project is to design and implement a gesture recognition system. Through a gesture recognition algorithm performed on the input from an attached camera, the human body will send messages to a game. The algorithm aims to both detect gestures, as well as signal the game to act accordingly.

Objective

The project is to study a human–machine interface application in game. Students need to design and implement AI-based hand gesture algorithms to provide solutions of gesture controlled games. Literature review will be conducted. The project will implement multiple neural network models/Machine learning techniques to determine a hand detection and gesture recognition solution. Students need to utilize AI techniques to improve the performance of gesture recognition.

Partial Specifications

(1) Software development with Python.
(2) Provide improvement on both games and hand gesture recognition
(3) The algorithms must effective and efficient.

Suggested Approach

(1) Use OpenCV for image processing and feature extraction.
(2) Use multiple neural network models and machine learning techniques to support hand detection and gesture recognition
(3) Review the existing project of last year and find room to improve.
(4) Design a new game with creative SCAMPER techniques, test performances for each phase of improvement and evaluate their performance

Group Responsibilities

Design, implement, and test the algorithms as specified above.

Student A Responsibilities

Design and program AI models for hand gesture recognition system

Student B Responsibilities

Design and implement a new game using Scamper

Student C Responsibilities

Evaluate the performance of the hand gesture recognition system

Student D Responsibilities

Document the design and implantation of the algorithms and solutions

Course Co-requisites

AI-related courses COE318: Software Systems

To ALL EDP Students

Due to COVID-19 pandemic, in the event University is not open for in-class/in-lab activities during the Winter term, your EDP topic specifications, requirements, implementations, and assessment methods will be adjusted by your FLCs at their discretion.