Human body features recognition based adaptive user interface for extra-large touch screens

With the widespread use of extra-large touch screens (eLTS) in various settings such as work and education, interaction efficiency and user experience have garnered increased attention. The current user interface (UI) layouts of eLTS are primarily categorized into two modes: fixed position and manual adjustment. The fixed UI layout fails to accommodate users of different heights and sizes, while the manual adjustment mode involves cumbersome steps and lacks sufficient flexibility. This study proposes an adaptive UI for eLTS. The optimal operational area on the eLTS is determined based on users’ height, eye level, arm length, face orientation, and distance from the screen. The eLTS menu is then positioned and displayed within this optimal area. Simulations involving users of various heights (P1 female, P50 male and female, and P99 male) were conducted to evaluate fatigue using the rapid upper limb assessment (RULA) method. The results indicate that the proposed adaptive UI significantly reduces user fatigue.