IT306 – CAPSTONE PROJECT 1

Jeffrey A. Flor Jodan Jay Piña BSIT 3A

Trisha Trinidad Zarmaine Grace Pascasio

ACTIVITY # 1
 Select an area of topic for your capstone project (i.e., game development, web app. e-
learning systems, etc.)
 Read and review at least 10 literature/systems related to the chosen topic/area. Recent
literatures/systems (from 2013-2024).
 For each literature write a review.

Area of topic:
Arduino Project
Specific topic:
Smart Gloves: Hand Gestures to Speech and Text Conversion
Brief introduction of the chosen topic:
Wearable technology, such as smart gloves with Arduino implementations for hand
motions to voice and text conversion, is intended to improve accessibility for those with speech
or movement disabilities. These gloves use the real-time sensor data processing capabilities of
Arduino to recognize hand motions. Arduino connects to communication modules via
specialized code, making it easier to translate detected motions into spoken or written language.
These gloves provide low latency and real-time engagement, making them an inclusive and
flexible communication tool for people with a range of communication issues. They may also be
integrated with other assistive technology.

Rueda Street, 063 055 5339857

Calbayog City www.nwssu.edu.ph
[email protected]
 Review of the 10 related literatures/systems
1.
Many individuals, those with deafness or difficulties in hearing, depend heavily on sign
language as their primary means of communication. While commonly associated with the deaf
community, sign language also serves as a valuable tool for others who face challenges with
spoken language, regardless of their hearing ability. In sign language, a symphony of
handshapes, movements, and body language orchestrates the expression of thoughts and ideas.
Moreover, a combination of words and symbols contributes to the richness of this visual
language. Recognizing the significant communication barriers faced by individuals with special
needs in a world dominated by spoken language, this project takes aim at dismantling these
barriers. Its core objective is to develop a portable solution that can translate the eloquent
language of sign gestures into readily understandable text and synthesized speech. This
transformative technology holds the potential to foster seamless communication between
individuals with and without disabilities, paving the way for a more inclusive and connected
society.
The project “Multi- Purpose Smart Glove for Differently Abled Community People”
conducted by Punit Pura, Bhushan Parab, Rohit Bandgar, Rahul Naik, and Dr. Jyoti Dange
(2022) intends to eliminate obstacles that separate individuals with special needs from the
normal people. The main components of this project include a hand glove, flex sensors,
Accelerometer and Gyroscope (MPU 6050), Bluetooth module (HC-05), 1kΩ resistors, contact
wires, Arduino Nano, Arduino Uno, NRF24L01+trnasceivers, Pulse sensor, and an Android
App. This project has three modes; Mode 1 the Sign Language mode, Mode 2 the Home
Automation, and Mode 3 the Health Monitoring. Based from the final result of this project, when
mode 1 is selected the flex sensor and accelerator angles values are used to show letters or
sentences encoded in precise movement as per American Sign Language (ASL), on the screen. If
the home automation mode is accessed, the turning on/off of a specific appliance will be
executed, in line to the gestures introduced to a specific output. When health monitoring mode is
selected, it will take readings from an Arduino Nano connected to pulse sensor and transfer the
to the app over Bluetooth, where the user’s heart pulse values is displayed. Thus, the final result
of the project is successful as every mode performed properly.
One of the Smart Glove project's strengths is its admirable emphasis on resolving the
communication difficulties that people who are deaf or hard of hearing encounter. Including sign
language interpretation with text and voice synthesis is a big step in the right direction for
improving public awareness of people with disabilities. The addition of functionality to control
household appliances and track health enhances the Smart Glove's overall usefulness for
individuals with special needs by increasing its adaptability and practicality. However, there are
some possible drawbacks to take into account. First off, there may be an extra degree of
complication and dependency if deaf and hard-of-hearing people must rely on a mediator to
explain their rights and sign language. To reduce the need for outside assistance, it would be
essential to make sure that the Smart Glove's translation skills are precise and dependable. It's
crucial to establish balance when it comes to the enhanced features, such as controlling
household appliances and health monitoring feature. Prioritizing communication facilitation
should be the Smart Glove's main objective. Extra features shouldn't conflict with or overshadow
this goal.
The project's incorporation of a Sign Language mode, utilizing flex sensors and
accelerometer angles for displaying American Sign Language (ASL) letters and sentences,
represents a commendable advancement in communication enhancement, fostering awareness
and inclusivity. The Smart Glove's versatility, demonstrated through additional modes like Home
Rueda Street, 063 055 5339857
Calbayog City www.nwssu.edu.ph
[email protected]
 Automation and Health Monitoring, amplifies its overall utility for differently-abled individuals,
showcasing successful outcomes in each mode. The project successfully achieves its intended
goals, particularly in enhancing communication for individuals with special needs. However,
potential concerns arise regarding the dependency on a mediator for communication and sign
language interpretation, necessitating a focus on ensuring the precision and reliability of the
translation skills. The assessment emphasizes the critical need for balance in features,
highlighting that while capabilities like controlling household appliances and health monitoring
bring value, they should not overshadow the primary goal of improving communication. Striking
this balance is deemed essential for the Smart Glove's effectiveness in meeting the diverse needs
of the differently-abled community.
Both the Multi-purpose Smart Glove and Smart Gloves: Hand Gestures to Speech and
Text Conversion aim to address communication challenges for disabled individuals. The Smart
Glove, primarily designed for deaf and hard-of-hearing individuals using sign language,
recognizes the difficulty in communication with the general public due to the lack of awareness
of sign language. The project's major goal is to provide a portable and smart solution to convert
disabled people's gestures into easily understandable text and speech synthesis. The Smart Glove
also boasts additional features, including the management of home appliances and health
monitoring, with users switching between modes through an installed application for greater
independence. On the other hand, wearable technology with Arduino implementations focuses
on improving accessibility for those with speech or movement disabilities. These gloves use real-
time sensor data processing capabilities of Arduino to recognize hand motions, enabling
translation into spoken or written language. While both projects share the common objective of
enhancing communication through technology, they differ in their target user groups,
technological details, and specific emphasis on real-time engagement. The contribution of the
Multi- Purpose Smart Glove for Differently Abled Community People to our project lies in their
mutual commitment to leveraging technology, sensor data processing, and Arduino connectivity
to create inclusive and flexible communication tools for individuals with diverse communication
issues.
In conclusion, the emphasis on sign language interpretation and the incorporation of
additional features like home automation and health monitoring make the "Multi-Purpose Smart
Glove for Differently Abled Community People" project a commendable initiative in addressing
communication difficulties faced by the deaf and hard of hearing. The success of the project in
executing its three modes showcases its practicality and adaptability. However, the assessment
raises valid concerns about potential complications and dependency if a mediator is needed for
communication, emphasizing the importance of precision in translation skills. Striking a balance
between enhanced features and prioritizing communication facilitation is crucial for the Smart
Glove's effectiveness. Despite these considerations, the project contributes to the broader field of
wearable technology, aligning with the goal of improving accessibility for individuals with
speech or movement disabilities. The mutual commitment to leveraging technology and Arduino
connectivity for inclusive communication tools highlights the potential synergy between the
Multi-Purpose Smart Glove and similar projects, collectively working towards a more inclusive
and connected society.

Rueda Street, 063 055 5339857

Calbayog City www.nwssu.edu.ph
[email protected]