Long short-term memory fuzzy finite state machine for human activity modelling

A challenging key aspect of recognising and modelling human activity is to design a model that can deal with the uncertainty in human behaviour. Several machine learning and deep learning techniques are employed to model the Activity of Daily Living (ADL). This paper provides a new method based on Fuzzy Finite State Machine (FFSM) and Long Short-Term Memory (LSTM) neural network for modelling and recognising human activities. The learning capability in the LSTM allows the system to learn the relations in the temporal data to identify the parameters of the rule-based system through time steps in the learning mode. The learned parameters are then used for generating the fuzzy rules that govern the transitions between the system's states. Experimental results are presented to demonstrate the effectiveness of the proposed approach.