Malaysia's population aged 65 years and above increased to 8.0% in 2025, highlighting the growing need for accessible and user-friendly smart home technologies that support independent living among older adults. Conventional home control methods rely on wall switches, multiple remote controls, voice commands, or text-based mobile interfaces, which may be inconvenient for elderly users with limited mobility, reduced physical strength, hand tremors, visual impairments, or difficulty understanding complex interfaces. Therefore, a more intuitive, touchless, and elderly-friendly home control solution is required. The Smart Gesture-Controlled Home System is proposed as a mobile application-based home automation prototype that enables users to operate virtual home appliances through predefined hand gestures captured using a camera-based gesture recognition interface. The objective of this project is to improve convenience and accessibility by allowing users to control appliances such as lights, fans, and televisions without physical contact. The proposed system provides an icon-based appliance selection interface followed by gesture execution through the smartphone camera, where captured gestures are processed through image acquisition, hand detection, feature extraction, and gesture recognition before being translated into corresponding appliance commands. To further enhance accessibility, the system can also be deployed on a large Smart Display (Smart Home Hub) as an alternative interaction device, providing a larger user interface, fixed camera positioning for improved gesture detection, hands-free operation, and continuous monitoring for bedridden elderly users, wheelchair users, and elderly care environments. By centralizing multiple appliance controls into a single application, the proposed innovation reduces dependence on physical switches, multiple remote controls, and voice commands while promoting a more natural human-computer interaction experience. In conclusion, this project offers a practical and accessible smart home solution that improves the quality of life for elderly users and provides a foundation for future integration with real Internet of Things (IoT) home automation systems.