Voice for the blind

Text to speech engine Madhura can read out e-text in two regional languagesKannada and Tamil

Arundhati Ramanathan
Updated2 Dec 2015, 02:33 AM IST
A.G. Ramakrishnan (left) and H.R. Shivakumar. After nearly 15 years of development and at a cost of about `5.3 lakh, the duo built the Madhura software. Photo: Hemant Mishra/Mint<br /><br />
A.G. Ramakrishnan (left) and H.R. Shivakumar. After nearly 15 years of development and at a cost of about `5.3 lakh, the duo built the Madhura software. Photo: Hemant Mishra/Mint

Bengaluru: Siddalingeshwar Ingalagi was left blind at the age of four after his retina detached. Though the 24-year-old is literate, a simple thing such as reading news in his native language Kannada was not that easy for him. While any other 24-year-old would have accessed news over his smartphone, Ingalagi had to rely on TV or radio broadcasts. Though there is assistive technology to help the blind, it was mostly made for the English speakers. For regional speakers like Ingalagi, there was no good solution available.

It was the predicament of people like Ingalagi that A.G. Ramakrishnan, professor at the department of electrical engineering and chairman of the Medical Intelligence and Language Engineering Laboratory at the Indian Institute of Science, tried to solve along with H.R. Shivakumar, a PhD student at the institute.

After nearly 15 years of development, at a cost of about 5.3 lakh, raised from Karnataka State Council for Science and Technology and Tamil Software Development Fund of the Tamil Nadu government, the duo built a text to speech (TTS) engine from scratch that is able to read out e-text in two regional languages—Kannada and Tamil.

“All the tools that exist for the blind are in English, there are not many good tools for other languages,” said 56-year-old Ramakrishnan. “We wanted to change that.”

Their aim was to not only develop a tool for regional speakers but also to make it sound as close to a real human voice. “Most of the tools out there sound robotic. We wanted to make it sound as natural as possible and in a way that is intelligible,” says Shivakumar, who was the chief architect and programmer of the speech engine, which has been named Madhura.

Ramakrishnan spent nearly 15 years developing the software. He relied on the support of doctoral research students for working on this project. Most of the time, the students wanted to work on fancier projects than one that solves a problem for the blind, so few people struck on to see it through.

Almost 15 students and project staff worked on creating this but it was brought to life when an IBM employee Shivakumar joined Ramakrishnan’a team in 2007 and pursued this problem for his doctoral research.

While existing tools are created on top of available open-source software, Ramakrishnan and his team wanted to create it from scratch, writing their own code. For this, they created a corpus of 1,000 sentences that has all possible combinations of words and phonemes (unit of speech). They had a native speaker speak those phonemes such that any combination of word can be created from that corpus. Not just that, to make it sound natural, the software was programmed to have pauses after commas and full stops and other intonations.

The advantage of creating it on their own has resulted in a clearer and more natural voice, says Shivakumar.

With most TTS engines, people get bored with the voice as it is mechanical and drones on, says Ramakrishnan and he didn’t want that in the TTS they were building. “When you speak a sentence today and say the same thing tomorrow, you may have a different way of saying it. Our software is also programmed to change the way a sentence is spoken each time,” explains Ramakrishnan.

What is innovative about their software?

Ramakrishnan says the method in which their sentence is split into basic units is unique and the way it is put together in the context of surrounding units, is also unique. The software, once installed in a computer, is recognized by screen readers, which then uses the speech engine to read out any text.

For Ingalagi, listening to news is now a ritual. He goes to a few Kannada news websites, listens through the headlines, and then whichever news interests him, he dumps the audio file onto his mobile phone. “I listen to the news when I travel now,” he says.

Besides users such as Ingalagi, agencies such as Nabard too are exploring the use of this software, said Ramakrishnan. With initiatives such as the Jan Dhan Yojana, banks send text messages of the account balance and other information to account holders. Besides the disabled, even the illiterate can use this software.

The software is being given free to any non-profit organization that work for the blind. Ramakrishnan says a company will be set up by the end of this year to sell it commercially to companies who could also use this for building navigation tools in regional languages. They will also expand their offering to 14 regional languages from the current two.

The duo is also exploring partnering with companies so that they could reach out to the blind with this software as part of their corporate social responsibility initiatives.

Mint has a strategic partnership with Digital Empowerment Foundation, which hosts the Manthan and mBillionth awards.

Catch all the Business News, Market News, Breaking News Events and Latest News Updates on Live Mint. Download The Mint News App to get Daily Market Updates.

MoreLess
First Published:2 Dec 2015, 02:33 AM IST
Business NewsTech-newsNewsVoice for the blind

Get Instant Loan up to ₹10 Lakh!

  • Employment Type

    Most Active Stocks

    Tata Steel share price

    139.25
    03:59 PM | 13 NOV 2024
    -4.9 (-3.4%)

    Bharat Electronics share price

    281.45
    03:50 PM | 13 NOV 2024
    -8.8 (-3.03%)

    Tata Power share price

    399.05
    03:59 PM | 13 NOV 2024
    -15.2 (-3.67%)

    Tata Motors share price

    786.40
    03:59 PM | 13 NOV 2024
    1.45 (0.18%)
    More Active Stocks

    Market Snapshot

    • Top Gainers
    • Top Losers
    • 52 Week High

    Suzlon Energy share price

    54.08
    03:59 PM | 13 NOV 2024
    -5.31 (-8.94%)

    Rattanindia Enterprises share price

    62.59
    03:58 PM | 13 NOV 2024
    -5.36 (-7.89%)

    Gujarat Narmada Valley Fertilisers & Chemicals share price

    545.95
    03:44 PM | 13 NOV 2024
    -43.85 (-7.43%)

    Motilal Oswal Financial Services share price

    898.15
    03:58 PM | 13 NOV 2024
    -70.5 (-7.28%)
    More from Top Losers

    KNR Constructions share price

    307.80
    03:58 PM | 13 NOV 2024
    23.65 (8.32%)

    Suven Pharmaceuticals share price

    1,259.00
    03:29 PM | 13 NOV 2024
    55.25 (4.59%)

    Piramal Pharma share price

    259.70
    03:52 PM | 13 NOV 2024
    9.15 (3.65%)

    Medplus Health Services share price

    699.50
    03:29 PM | 13 NOV 2024
    23.85 (3.53%)
    More from Top Gainers

    Recommended For You

      More Recommendations

      Gold Prices

      • 24K
      • 22K
      Bangalore
      76,865.00-440.00
      Chennai
      76,871.00-440.00
      Delhi
      77,023.00-440.00
      Kolkata
      76,875.00-440.00

      Fuel Price

      • Petrol
      • Diesel
      Bangalore
      103.02/L0.10
      Chennai
      100.90/L0.10
      Kolkata
      104.95/L0.00
      New Delhi
      94.77/L0.00

      Popular in Tech-News

        HomeMarketsPremiumInstant LoanMint Shorts