Thursday, May 25 2017

VietNamNews

Young minds take sign language into the digital age

Update: April, 15/2017 - 09:00
Tân (left) wearing the speakable glove which is translating the sign language into text and speech presented by a smart phone. Tôi Yêu Bạn (I love you) is the message of the sign language. — VNS Photo Hữu Dương
Viet Nam News

Two school pupils have been very clever.

They have made a special device that picks up what people say with their hands, using sign language.

Then, the device writes it down on a phone screen.

They won first prize at the Viet Nam Science and Technology Fair for their device.

by Lê Ái

The gloved hands moved in thin air, in a pantomime that only those who know sign language could decipher.

However, these were no ordinary gloves. They could speak. “Tôi yêu bạn (I love you)", they said, conveying a core message to deaf and mute people from two students, Phạm Thiên Tân and Chử Hoàng Minh Đức, of the Lê Hồng Phong High School for gifted students in HCM City.

“When I tried to talk with the deaf and mute people, I discovered that I was communication-impaired myself. I did not understand the sign language that they were using, while most of them could understand what others were saying by reading mouth movements,” said 17-year-old Tân.

“I felt really uncomfortable just a few hours after living as a ‘deaf’ person. I wondered about the language barrier between the deaf and mute people and those who do not understand sign language.”

Obsessed by this barrier for days, Tân and one of his classmates, Đức, came up with the idea of a glove that is capable of converting sign language into spoken Vietnamese. This would help normal people to understand the language of the deaf and mute people and remove an invisible linguistic barrier.

Tân and Đức’s initiative recently won the highest award for high school students in the south at the Viet Nam Science and Technology Fair.

Smart solution

The solution that the two high school students came up with involved a glove and a smart phone. The glove is attached with a Flex Sensor and an MPU6050 sensor.

When the wearer uses the sign language, the sensors will read the movements of the hand, and transmit the data to the phone via an application based on the Android system. The phone screen will display the characters, texts and sounds based on the data.

The sounds that the phone utters now is the sweet and young voice of a female student who is a member of the science club at the Lê Hồng Phong High School for gifted students .

Tân and Đức have so far successfully transcribed 31 hand movements into sounds and speech on the phone. Besides the alphabet, the glove can also ‘speak’ many words and phrases, including “I love you”, “I”, “You”, “Việt Nam”, “Hello”, “Parents”, and “Love”.

 The young “scientists” are planning to write more codes to arrange the words in a sentence properly, and on connecting two gloves to make a full sentence on the smart phone in the near future.

Both Đức and Tân has gained a much better understanding about sign language. “Sign language is actually very simple. They just use key words in the sentences and shorten the sentences as much as possible,” Đức said

Tân said the “speaking” glove is similar to the Google Translate tool, in that it helps the users “translate” the sign language into Vietnamese speech; however, it cannot be 100 per cent correct.

“As students majoring in physics, both of us are interested in controlling the chips. The science club of our school is where Đức and I can engage in our passion for inventing new things,” Tân said.

“One day, by chance, I learned about a glove that can be used to control robots. I asked myself: why not apply the principle of reading hand movements of this glove into translating sign language. That’s how this happened.”

The two friends started working on the “speaking” glove in last August, and “finalized” the product last month, just one day before their examinations, after many sleepless nights.

However, they are not sure when they can finish the linguistic system for the glove, for it is something that requires constant updates.

Keeping it practical

“The process of creating a scientific product has to stop on reaching some stage, because the creator himself lacks the knowledge to carry on with the project. So far, we are continuing to study and absorbing knowledge essential for improving our product,” Tân said.

“We cannot foretell anything about the future, but we wish to introduce our product to the market or transfer the technology to other researchers who can continue to develop it and make it a really useful product for deaf and mute people," he said.

Đức said that half way into their work, they found that their idea coincided with that of an American youth, but they also found their creation also had its own strengths that was an improvement.

The glove created by Đức and Tân can directly interact with a smart phone, a popular means of communication that everyone can possess, instead of connecting with a central computer via bluetooth, a pretty costly device that not everyone knows how to use.

According to Võ Mạnh Hùng, physics teacher at the Lê Hồng Phong High School, Đức and Tân’s talking glove has high applicability because it uses Vietnamese and prioritises Vietnamese users. Also, it is flexible in that one glove can be used by different people.

However, the two young men had to overcome quite a few challenges to finish making their glove in time for the Viet Nam Science and Technology Fair.

“In terms of technology, the more we work, the more we felt deficient. Many components broke down, and they were not cheap, so we had to be very careful,” Đức recalled.

“We also faced many linguistic difficulties in presenting our product in public. Fortunately, we received great support from our school in improving our expression and presentation through several rounds of the Viet Nam Science and Technology Fair.”

The talking glove is not their first creation. Earlier, Tân and Đức had collaborated to make other products like a machine to measure alcohol levels and an astronomical telescope.

The first prize in the Viet Nam Science and Technology lFair has only fuelled their aspirations. They dream of attending top-notch scientific and technological centres in the world where they can take their scientific passion to greater heights.

GLOSSARY

The gloved hands moved in thin air, in a pantomime that only those who know sign language could decipher.

Gloved hands are hands on which a person is wearing gloves.

A pantomime is a type of theatrical production.

To decipher means to work out what is being said, or written.

“Tôi yêu bạn (I love you)", they said, conveying a core message to deaf and mute people from two students, Phạm Thiên Tân and Chử Hoàng Minh Đức, of the Lê Hồng Phong High School for gifted students in HCM City.

Conveying means carrying.

A core message is a main message.

“When I tried to talk with the deaf and mute people, I discovered that I was communication-impaired myself. 

Communication-impaired means not able to communicate well.

I wondered about the language barrier between the deaf and mute people and those who do not understand sign language.”

Mute means unable to speak.

Obsessed by this barrier for days, Tân and one of his classmates, Đức, came up with the idea of a glove that is capable of converting sign language into spoken Vietnamese.

If you are obsessed with something, it is in your mind a lot.

Converting means changing.

This would help normal people understand the language of the deaf and mute people and remove an invisible linguistic barrier.

If something is invisible it cannot be seen.

Linguistic means to do with language.

Tân and Đức’s initiative recently won the highest award for high school students in the south at the Viet Nam Science and Technology Fair.

Initiative, in this case, means enterprise.

The solution that the two high school students came up with involved a glove and a smart phone.

A solution means an answer.

When the wearer uses the sign language, the sensors will read the movements of the hand, and transmit the data to the phone via an application based on the Android system.

A sensor is a measuring device.

To transmit means to send.

Data means information.

The sounds that the phone utters now is the sweet and young voice of a female student who is a member of the science club at the Lê Hồng Phong High School for gifted students.

Gifted means very clever and with incredible natural skills.

Tân and Đức have so far successfully transcribed 31 hand movements into sounds and speech on the phone.

If something is transcribed, it is written down.

“As students majoring in physics, both of us are interested in controlling the chips."

To major in physics means to take the subject up to the final year in a degree.

Chips are microchips, a tiny wafers of semiconducting material used to make an integrated circuit.

"The science club of our school is where Đức and I can engage in our passion for inventing new things,” Tân said.

A passion is a feeling of being so keen on something that it does not matter how much time or money you spend on it.

To invent something means to have an idea and be the first person to make it into a device.

However, they are not sure when they can finish the linguistic system for the glove, for it is something that requires constant updates.

Constant means ongoing.

“So far, we are continuing to study and absorbing knowledge essential for improving our product,” Tân said.

Absorbing means taking in.

“We cannot foretell anything about the future, but we wish to introduce our product to the market or transfer the technology to other researchers who can continue to develop it and make it a really useful product for deaf and mute people," he said.

Foretell means saying what will happen ahead of the time.

Đức said that half way into their work, they found that their idea coincided with that of an American youth, but they also found their creation also had its own strengths that was an improvement.

If two things co-incide, they happen at the same time.

The glove created by Đức and Tân can directly interact with a smart phone, a popular means of communication that everyone can possess, instead of connecting with a central computer via bluetooth, a pretty costly device that not everyone knows how to use.

Interact means communicate very directly by being very involved.

Possess means have, or own.

According to Võ Mạnh Hùng, physics teacher at the Lê Hồng Phong High School, Đức and Tân’s talking glove has high applicability because it uses Vietnamese and prioritises Vietnamese users.

To prioritise Vietnamese users means to make them the most important and put them first in the line to be helped.

“In terms of technology, the more we work, the more we felt deficient

Being deficient means not having enough of something.

Many components broke down, and they were not cheap, so we had to be very careful,” Đức recalled.

Components are parts.

Earlier, Tân and Đức had collaborated to make other products like a machine to measure alcohol levels and an astronomical telescope.

To collaborate means to work jointly on something.

An astronomical telescope is a device used to look at the stars in the sky.

The first prize in the Viet Nam Science and Technology Fair has only fuelled their aspirations.

If the fair fuelled people’s aspirations, it gave them more hope.

WORKSHEET

State whether the following sentences are true, or false:

1. Sign language is used mostly by people who are deaf and cannot hear.

2. When using sign languages, people try to make their sentences as long as possible.

3. Phạm Thiên Tân and Chử Hoàng Minh Đức attend school in Da Nang.

4. Phạm Thiên Tân and Chử Hoàng Minh Đức are friends.

5. When Phạm Thiên Tân and Chử Hoàng Minh Đức were working on their device, they found that people from New Zealand were doing much the same type of work.

ANSWERS:

© Duncan Guy/Learn the News/ Viet Nam News 2017

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

1.  True; 2. False; 3. False; 4. True; 5. False.

 

 

Send Us Your Comments:

See also: