An application to aid hearing and visually challenged students in their studies

The apps, Vision Companion and Audable, were developed by BNY Mellon Technology

July 19, 2023 09:41 pm | Updated July 20, 2023 04:58 pm IST - CHENNAI

The Vision Companion app, developed by BNY Mellon Technology, aids the visually challenged students to download lessons and read them

The Vision Companion app, developed by BNY Mellon Technology, aids the visually challenged students to download lessons and read them | Photo Credit: JOTHI RAMALINGAM B

An app now allows vision and hearing-impaired students at Little Flower Convent Higher Secondary School to study on their own.

Students in higher classes use the mobile app to access lessons at home. The Vision Companion app, developed by BNY Mellon Technology, aids the visually challenged to download lessons and read them. The app comes with a split screen with the bottom half devoted to a microphone icon. The user can tap on the screen and speak a keyword from a lesson. The app will download the lesson from Google Drive and read it aloud.

“This is a self-help tool and volunteers helped record the lessons,” said M. Maharajan, Director of Applications Development, BNY Mellon Technology. The pandemic propelled the app, said Nitin Chandel, managing director and head of engineering at the company. “Accessibility is the key. Our affirmative interventions in aid of persons with disabilities include provisioning accessible educational aids and assistive technologies in support of education and barrier-free learning spaces,” he said.  “We had volunteers who figured the needs. The team talked to parents and students,” he added.

Ganesh Pandian A., director of the company in Chennai, whose visually-challenged daughter is an alumna of the school said the app was a natural development. In college, with no teachers to support her at every step, the simple task of finding her way to the restroom was a struggle, he recalled.

Currently, the app can be used by students who learn in English, Hindi, Tamil and Marathi. Its catalogue boasts a total of 4,000 audio lessons. “We developed the version for the vision-impaired first, and the version for the hearing-impaired was the natural next step,” Mr. Maharajan said. The team created visual files that students could read.

The user screen of ‘Audable’ (the app for the hearing impaired) comes with a listen and speak option. The mobile screen is split into two, with the bottom half used to record and store ‘favourite’ words. A hearing-impaired person can tap on the word and the app will pronounce it. The user can type out a message and tap on the speak icon to read it aloud.

“When the user wants to understand what is being said they could simply click the ‘listen’ button and the app will capture the speaker’s voice input and display it as text in a text box”, Mr. Maharajan said.

The app also comes with a default SOS option. It loads two emergency contacts – primary and secondary. A user can tap thrice on the mic to activate a call that will go to the stored primary contact. 

Visually challenged S. Nivedha of Class XII uses the app to access all her classwork materials. “It also allows us to access other books and impart knowledge,” she said. The teachers said the students had the freedom to explore and learn on their own.

Top News Today

Sign in to unlock member-only benefits!
  • Access 10 free stories every month
  • Save stories to read later
  • Access to comment on every story
  • Sign-up/manage your newsletter subscriptions with a single click
  • Get notified by email for early access to discounts & offers on our products
Sign in


Comments have to be in English, and in full sentences. They cannot be abusive or personal. Please abide by our community guidelines for posting your comments.

We have migrated to a new commenting platform. If you are already a registered user of The Hindu and logged in, you may continue to engage with our articles. If you do not have an account please register and login to post comments. Users can access their older comments by logging into their accounts on Vuukle.