Emotion Linked AIoT Based Cognitive Home Automation System with Sensovisual Method

This paper focuses on research done for implementation of emotion linked Artificial Intelligence of Things based smart Home Automation System. Previously, Home automation research scope was limited to either remote controlled systems or voice operated commands-based systems or virtual assistant-based systems. The problem with these systems was they were not self-adapting systems nor emotion-based mood enhancing systems. Our Proposed system combines real-world data for emotion awareness, sensing, learning, and decision-making. The proposed system is milestone in Smart home journey because, it is enhancing the systems security, efficiency and user experience. Thus, we present a cognitive intelligent home automation system featuring computer vision, environmental sensing, data processing, learning, and adaptation capabilities. Face recognition-based door access control used in the proposed system allows access only to authorized user. Further, Convolutional Neural Network and support vector machine algorithm-based emotion detection is implemented. The system recognizes emotions on the user's face and enhances user experience by controlling the ambient light as per the mood/emotion of the user. To implement system, we have used the methodology with different modes of operations such as privileged mode, non-privileged mode, intelligent mode, manual mode. We are proposing the “sensovisual” term in this paper which is combination of the sensor and visual method for smart home automation.