Designing Computer Vision Support for Science Practical Work: A Qualitative Investigation into the Noticing Practices and Support Preferences of Science Teachers

With teachers continuing to report challenges in classroom management and difficulties in implementing scientific inquiry, the current manner in which science practical work is conducted in schools suggests the need for added teacher support. In this regard, we can leverage computer vision to provide instructional support by relieving teachers of the need to carry out mundane observations and perform basic interpretations of student activity. However, to our knowledge, little is known about the noticing practices of teachers during practical work, and the support preferences of such a computer vision system have not been studied before. To this end, we recruited 17 science educators with different teaching expertise for a qualitative investigation into the noticing practices and support preferences of science teachers. Results revealed seven major categories and 36 minor categories of student activity that teachers typically observe, which enabled us to derive observation routines that can emulate quality teacher noticing for computer vision input. Our obtained list of observation categories represents a first-of-its-kind list which takes into account concrete noticing practices of science teachers and remains applicable across all types of practical tasks. From participants’ ranking of computer vision models, we further understood the type of computer vision output that teachers prefer for instructional support. To our best of knowledge, no prior research has examined the connection between teacher noticing and computer vision in such detail. Using these findings, we can then pursue the development of computer vision for instructional support in science practical work in an informed manner, taking into account the realities of science laboratories and proclivities of science teachers.