Predicting tap locations on touch screens in the field using accelerometer and gyroscope sensor readings

Schmitt, E. & Voigt-Antons, J.-N.
Paper presented at the International Conference on Human-Computer Interaction, July 2020
Summary
We propose a lightweight method to infer tap locations on smartphones from inertial sensor data alone. Models trained on accelerometer and gyroscope signals generalize across users and devices and enable input reconstruction in real-world settings. Potential applications include implicit error detection, accessibility aids, and interaction analytics without screen capture.
Written for this site, the published abstract is at the DOI.
Cite as
Schmitt, E. & Voigt-Antons, J.-N. (2020, July). Predicting tap locations on touch screens in the field using accelerometer and gyroscope sensor readings. Paper presented at the International Conference on Human-Computer Interaction. https://doi.org/10.1007/978-3-030-50309-3_43