Multitask Virtual Keyboard Controlled by an Eye-Gaze-Based Intelligent Entry System

Amal Hameed Khaleel; Thekra Abbas; Abdul-Wahab Sami Ibrahim

doi:10.47852/bonviewJCCE52026027

Authors

Amal Hameed Khaleel Department of Computer Science, Basrah University, Iraq https://orcid.org/0000-0003-2759-2897
Thekra Abbas Department of Computer Science, Mustansiriyah University, Iraq
Abdul-Wahab Sami Ibrahim Department of Computer Science, Mustansiriyah University, Iraq https://orcid.org/0000-0001-5112-7640

DOI:

https://doi.org/10.47852/bonviewJCCE52026027

Keywords:

eye gaze, eye-typing, human–computer interaction, computer vision, virtual keyboard

Abstract

In modern society, computers and cell phones play an integral role in individuals' everyday lives. Individuals utilize messaging platforms such as WhatsApp, WeChat, and Facebook daily to communicate with others. Virtual keyboards are a significant tool in assistive technology because they aid individuals with significant motor disabilities in making effective contact with computers. This study proposes an eye-gaze-controlled virtual keyboard using a new method called Distance Eyelid-Iris-MediaPipe, which enables individuals with disabilities to write effectively. The suggested virtual keyboard is an affordable assistive device because it only necessitates a webcam for operation. The proposed virtual keyboard consists of six supplementary menus: two menus for English letters, one for numerical digits and mathematical operations, one for important text operations, one for Latin symbols, and an emoji menu. The suggested keyboard has special characteristics such as auditory feedback and visual highlighting of pressed keys. The testing of the proposed system received positive feedback from several users, and the empirical results of the proposed system were better than those of the previous models. It achieved this with an average typing rate of 18 characters per minute and 4 words per minute, and it had a NASA-TLX score of 10% and a system usability scale score of 93.

Received: 27 April 2025| Revised: 25 June 2025| Accepted: 11 July 2025

Conflicts of Interest

The authors declare that they have no conflicts of interest to this work.

Data Availability Statement

Data are available on request from the corresponding author upon reasonable request.

Author Contribution Statement

Amal Hameed Khaleel: Conceptualization, Methodology, Software, Formal analysis, Investigation, Resources, Data curation, Writing – original draft, Writing – review & editing, Visualization, Project administration. Thekra Abbas: Methodology, Validation, Resources, Writing – original draft, Writing – review & editing, Supervision. Abdul-Wahab Sami Ibrahim: Conceptualization, Formal analysis, Investigation, Resources, Writing – review & editing, Supervision.