Computer Science

FOODator

FOODator is the world’s very first interactive culinary app. With FOODator, you will browse through the restaurants in the area with confidence and peace of mind. Find your perfect match in three simple steps! Swipe left to cycle through nearby restaurants, swipe right on your restaurant match to be presented with its relevant information. Chat with restaurant representatives to gain more information or to make reservations. Yes, it’s that simple. With FOODator, you’re guaranteed to find your perfect match! And the best part is, you’ll never second guess your decision ever again.

FOODator – new tastes, every day.

A Smart Robotic Walker with Intelligent Close-proximity Interaction Capabilities for Elderly Mobility Safety

We propose a novel smart robotic walker that targets a convenient-to-use indoor walking aid for the elderly. The walker supports multiple modes of interactions through voice, gait, or haptic touch, and allows intelligent control via learning-based methods to achieve mobility safety. Our design enables a flexible, initiative, and reliable walker due to three main functions. Our walker tracks users in front by detecting lower limb gait while providing close-proximity walking safety support. By monitoring force pressure on a specially designed soft-robotic interface on the handle, the walker can detect human intentions and predict emergency events. Our walker performs reinforcement learning-based sound source localization to locate and navigate to the user based on his/her voice signals.

Playing chess with robotic arm

This project aimed at building an autonomous chess-playing machine that can play chess with a human player at home. It consisted of making a robotic arm, building arm controller apps, applying openCV on the mobile phone, and building an AI chess engine.
The working logic are described as four steps. First, the phone capture an image of the chessboard. Then, it recognizes the chessboard and location and color of the piece. Next, the chess engine determines the next move and sends the command to the robotic arm. Finally, the robotic arm helps to move the piece.

Combing Physical and Virtual Gaming Experience – Hexplore Fort

Since the gaming industry is becoming saturated, players tend to raise their requirements to the quality of gaming experience. Fusion of physical and virtual gaming experience may provide a fresh feeling to the players. In this project, a single-player Augmented Reality (AR) mobile game called Hexplore Fort is developed, where the players can control a spider-like robot – hexapod to adventure with the storyline in the game. Players can explore the fort that is augmented by AR by controlling the movement of hexapod, collecting items, fighting with enemies and buying assistance provided by the spy, in order to capture the princess.

Smart Email Client To Detect Malicious URLs

The aim of this project was to detect phishing emails or URLs with a high accuracy. For the same, our deliverable was in the form of an improved email client that scrapes the last unread email from a user’s inbox and checks if it is safe or malicious. A series of Machine Learning algorithms were tried and experiments and research was conducted. From the results obtained, it was determined that a Balanced Random Forest algorithm after optimization in the form of algorithm tuning, training-testing split, feature analysis and other methods, was the most suitable choice for the project as it gave an accuracy of around 98% and after some experiments on optimization, it even reached a 100% accuracy.

Web-based Multiplayer Online Game

Mental health issues, especially depression and loneliness, are becoming more common amongst young people. Fortunately, they are usually treatable without any medical help, and games might be the answer. Since people who suffer with these issues turn to video games, it can be considered as perfect medium to provide them with the remedy. Onslaught Arena is a web-based, online game that was modified to introduce multiplayer support and communication services to combat depression and loneliness. The game is backed by a NodeJS server that analyses user’s preference to provide them with the best possible gaming partner.

Weakly Supervised Object Localization for Assembly Line Understanding

Our main objective for this project is to design a deep learning model to perform an efficient and accurate object classification and localization on assembly line so that further human-robot collaboration can be facilitated. We further formulate our task as a weakly supervised object localization problem. More specifically, the model will be training with image-level labeled data and output a predicted category and a bounding box for the object that worker is interacting with given one input image.

Hacking Wong: Videogame

A rogue-like video game for our final project of COMP3329.
Hacking Wong follows the story of an outlandish twist to a mundane part of student life – submitting assignments. The character is late to submit his assignment and must reach the CS lab before the deadline, however, that is easier said than done since the lab is locked and he now finds himself being attacked by exploding frogs, shock boars and fire breathing dragons. Roam around the HKU campus in search of the TA who holds the key and defeat all enemies in this action-packed adventure.

Early Diagnosis of Scoliosis in Children from RGB-D Images Using Deep Learning

Scoliosis is typically diagnosed from X-ray images, but diagnostic X-rays increase the risk of developmental problems and cancer in those exposed. This project aims to eliminate children’s X-ray exposure in the early diagnosis of scoliosis by generating X-ray images of children’s backs from the corresponding harmless RGB-D images. In this project, a deep learning model based on HRNet was built and trained to detect landmark locations of the backs on the RGB-D images first. With the detected landmarks, the X-ray images of the children’s backs were eventually synthesized from the corresponding RGB-D images by another deep learning model that was built and trained based on the pix2pix model.