top of page

Co-Organisers:
I-RICE'26
4th International Research, Innovation, Creativity & Engineering Project Competition 2026

Project ID:
ITCS04311
FatigueGuard: Real-Time Driver Fatigue Detection via Edge AI and Cloud
Project Title:
Category:
Information Technology/ Computer Science/ AI
Inventors:
CHEW RONG BIN, CHEW RONG BIN
Institution/Company:
Southern University College
Invention Description/ Abstract:
FatigueGuard is a low-cost driver safety prototype designed to detect fatigue-related behaviour in real time using Edge Artificial Intelligence and provide timely warnings through a Flutter mobile application. The system classifies four driver conditions: normal, eyes closed, yawning and distracted. Its Edge Impulse image-classification model achieved an accuracy of 91.11%.
The proposed hardware uses an ESP32-S3 N16R8 camera board with an OV3660 camera. Image inference is designed to run locally on the device, improving response time and protecting driver privacy because only lightweight detection results are transmitted instead of raw camera footage. The results are sent through a local Wi-Fi HTTP status interface to the Flutter application.
The application provides three levels of fatigue intervention. Level One gives a mild voice reminder, Level Two activates a stronger critical warning and recommends pulling over, while Level Three presents a planned Rest and Service Area navigation interface. A Collision SOS user-interface prototype with a cancellation countdown has also been designed.
During FYP1, the AI model, ESP32-S3 firmware build, Flutter interface, warning workflow, Android APK and simulated HTTP integration were completed. Physical camera validation remains pending. Future development will complete local history storage, real navigation, collision sensing, emergency communication and cloud-based fleet management.
Invention Technical Description
FatigueGuard consists of an edge detection device, a Flutter driver application, local data storage and a planned cloud management layer.
The target edge device is an ESP32-S3 N16R8 camera board equipped with an OV3660 camera, 16 megabytes of flash memory and 8 megabytes of PSRAM. The camera captures driver images, while the Edge Impulse model performs local classification into four states: normal, eyes closed, yawning and distracted. The model achieved 91.11% accuracy in the current test result.
The trained model was exported as an Edge Impulse Arduino library and integrated into the ESP32-S3 firmware. The compiled firmware uses approximately 77% of the available program storage and 16% of dynamic memory. Physical real-time inference testing will be conducted when the camera hardware is available.
Detection results are represented as lightweight JSON status data and provided through a local Wi-Fi HTTP “status” endpoint. The Flutter application receives the current state and activates the corresponding interface. The prototype presently uses simulated ESP32 responses to validate communication and application behaviour before physical integration.
The application implements a three-level warning workflow. Level One provides a mild reminder, Level Two gives a critical alarm and pull-over recommendation, and Level Three displays the planned R and R navigation interface. Hive CE integration has started for storing detection history locally. A Collision SOS interface has also been designed, but physical collision detection, emergency calls, SMS messages and live GPS sharing remain planned features.
The proposed FYP2 cloud layer will use Node.js, Express and MySQL to support a Fleet Manager dashboard. The architecture limits raw video transmission by performing image processing on the ESP32-S3 and transmitting only detection status data.
Demostration/ Presentation Video
Poster/ Broucher/ Invention Photo
Additional Documents
bottom of page

