Letter and Person Recognition in Freeform Air-Writing Using Machine Learning Algorithms

Air-writing is an emerging form of human-computer interaction that enables text entry through hand movements in the air. This paper explores air-writing-based person recognition alongside letter recognition to analyze the correlation between subjects and their writing styles. This analysis has poten...

Full description

Saved in:
Bibliographic Details
Main Authors: Huseyin Kunt, Zeki Yetgin, Furkan Gozukara, Turgay Celik
Format: Article
Language:English
Published: IEEE 2025-01-01
Series:IEEE Access
Subjects:
Online Access:https://ieeexplore.ieee.org/document/10858063/
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1825207032748179456
author Huseyin Kunt
Zeki Yetgin
Furkan Gozukara
Turgay Celik
author_facet Huseyin Kunt
Zeki Yetgin
Furkan Gozukara
Turgay Celik
author_sort Huseyin Kunt
collection DOAJ
description Air-writing is an emerging form of human-computer interaction that enables text entry through hand movements in the air. This paper explores air-writing-based person recognition alongside letter recognition to analyze the correlation between subjects and their writing styles. This analysis has potential applications in early childhood education for assessing cognitive and psychomotor skills, as well as in user authentication. A comprehensive framework for freeform air-writing analysis using a wearable glove is introduced, encompassing person and letter recognition, letter segmentation, feature extraction, and dataset generation. Unlike user authentication where person recognition depends on predefined content, such as a passcode or signature, person recognition here depends on the underlying writing style of the writer in free-form. The free-form air-writing indicates the user freedom to select any letter with any size (varying from a quarter to the full size of an A4 page) to write on the air. In the study, a dataset is also developed, containing the air-writing signals from the wearable glove, integrated with IMU sensors (gyroscope and accelerometer). Fourier and wavelet transforms are used to extract features and the performances of various machine learning algorithms, namely Decision Tree, Random-Forest, K-Nearest Neighbors, Support Vector Machine, Artificial Neural Networks, and SubSpace KNN, are comparatively studied. To the best of the authors’ knowledge, there is no study for person recognition from freeform air-writing letters through IMU sensors, and also there is no study using the Fourier and Wavelet features in this context. Furthermore, the study is also original due to its publicly available air-writing dataset on the Turkish alphabet and also applying various machine learning algorithms. The experimental results show that SubSpace KNN is superior to the others under the suggested parameter settings.
format Article
id doaj-art-952bb6e301e941f794cd9efedfd424e1
institution Kabale University
issn 2169-3536
language English
publishDate 2025-01-01
publisher IEEE
record_format Article
series IEEE Access
spelling doaj-art-952bb6e301e941f794cd9efedfd424e12025-02-07T00:01:21ZengIEEEIEEE Access2169-35362025-01-0113231422315510.1109/ACCESS.2025.353660910858063Letter and Person Recognition in Freeform Air-Writing Using Machine Learning AlgorithmsHuseyin Kunt0https://orcid.org/0009-0001-1806-8383Zeki Yetgin1https://orcid.org/0000-0001-5918-6565Furkan Gozukara2https://orcid.org/0000-0001-9379-2163Turgay Celik3https://orcid.org/0000-0001-6925-6010Department of Computer Engineering, Mersin University, Mersin, TürkiyeDepartment of Computer Engineering, Mersin University, Mersin, TürkiyeDepartment of Computer Engineering, Mersin University, Mersin, TürkiyeDepartment of Information and Communication Technologies, Centre for Artificial Intelligence Research (CAIR), University of Agder, Grimstad, NorwayAir-writing is an emerging form of human-computer interaction that enables text entry through hand movements in the air. This paper explores air-writing-based person recognition alongside letter recognition to analyze the correlation between subjects and their writing styles. This analysis has potential applications in early childhood education for assessing cognitive and psychomotor skills, as well as in user authentication. A comprehensive framework for freeform air-writing analysis using a wearable glove is introduced, encompassing person and letter recognition, letter segmentation, feature extraction, and dataset generation. Unlike user authentication where person recognition depends on predefined content, such as a passcode or signature, person recognition here depends on the underlying writing style of the writer in free-form. The free-form air-writing indicates the user freedom to select any letter with any size (varying from a quarter to the full size of an A4 page) to write on the air. In the study, a dataset is also developed, containing the air-writing signals from the wearable glove, integrated with IMU sensors (gyroscope and accelerometer). Fourier and wavelet transforms are used to extract features and the performances of various machine learning algorithms, namely Decision Tree, Random-Forest, K-Nearest Neighbors, Support Vector Machine, Artificial Neural Networks, and SubSpace KNN, are comparatively studied. To the best of the authors’ knowledge, there is no study for person recognition from freeform air-writing letters through IMU sensors, and also there is no study using the Fourier and Wavelet features in this context. Furthermore, the study is also original due to its publicly available air-writing dataset on the Turkish alphabet and also applying various machine learning algorithms. The experimental results show that SubSpace KNN is superior to the others under the suggested parameter settings.https://ieeexplore.ieee.org/document/10858063/Air writingperson recognitionArduino datasetFourier transformneural networkssubspace KNN
spellingShingle Huseyin Kunt
Zeki Yetgin
Furkan Gozukara
Turgay Celik
Letter and Person Recognition in Freeform Air-Writing Using Machine Learning Algorithms
IEEE Access
Air writing
person recognition
Arduino dataset
Fourier transform
neural networks
subspace KNN
title Letter and Person Recognition in Freeform Air-Writing Using Machine Learning Algorithms
title_full Letter and Person Recognition in Freeform Air-Writing Using Machine Learning Algorithms
title_fullStr Letter and Person Recognition in Freeform Air-Writing Using Machine Learning Algorithms
title_full_unstemmed Letter and Person Recognition in Freeform Air-Writing Using Machine Learning Algorithms
title_short Letter and Person Recognition in Freeform Air-Writing Using Machine Learning Algorithms
title_sort letter and person recognition in freeform air writing using machine learning algorithms
topic Air writing
person recognition
Arduino dataset
Fourier transform
neural networks
subspace KNN
url https://ieeexplore.ieee.org/document/10858063/
work_keys_str_mv AT huseyinkunt letterandpersonrecognitioninfreeformairwritingusingmachinelearningalgorithms
AT zekiyetgin letterandpersonrecognitioninfreeformairwritingusingmachinelearningalgorithms
AT furkangozukara letterandpersonrecognitioninfreeformairwritingusingmachinelearningalgorithms
AT turgaycelik letterandpersonrecognitioninfreeformairwritingusingmachinelearningalgorithms