Active Stocks
Fri May 24 2024 15:59:27
  1. Tata Steel share price
  2. 174.80 -0.37%
  1. NTPC share price
  2. 374.85 0.68%
  1. State Bank Of India share price
  2. 828.60 -0.45%
  1. ITC share price
  2. 436.10 -1.16%
  1. Power Grid Corporation Of India share price
  2. 318.50 -0.39%
Business News/ News / World/  AI algorithms far from neutral in India
BackBack

AI algorithms far from neutral in India

Algorithms used in AI systems deliver unfair outcomes when applied in diverse societies such as India’s, says research

Photo: iStockPremium
Photo: iStock

Governments are increasingly using artificial intelligence and machine learning in decision-making. But are their underlying algorithms suitable for countries such as India? A recent study says they may not be, since they were designed for Western societies. For example, such algorithms may fail to recognize religious or caste biases and could treat oppressed minorities unfairly.

The study, by Nithya Sambasivan and others at Google Research, US, is based on interviews with 36 academics from various fields and activists working with marginalized communities.

Many of these algorithms work on the assumption that the available data is representative of the society. But in Indian datasets, those with internet access are overrepresented, which is just 50% of the population. This means safety apps that invite users to identify unsafe areas in a city will mark Dalit and Muslim areas as unsafe, reflecting the prejudices of the app’s middle- and upper-class users.

Using artificial intelligence is aspirational for the Indian government. Since it is seen as futuristic, it is trusted without question. But this trust can be misplaced. The study’s authors point out that when police use facial recognition to identify protestors, and the system is trained on people under trial, they could end up disproportionately targeting Dalits and Muslims. This is because more than half of the undertrials are from these communities.

The authors make several suggestions to correct for these shortcomings. One is to empower marginalized groups with low-cost devices so that they can come online, represent themselves and produce knowledge about their communities. This will make Indian datasets more trustworthy by preventing distortion of data. Another suggestion is to educate journalists, activists and lawyers, so that there is, like in the West, an ecosystem of people who have the technical training to question the use of AI systems and hold practitioners accountable.

Also read: “Re-imagining Algorithmic Fairness in India and Beyond"

Snap Fact features new and interesting reads from the world of research.

You are on Mint! India's #1 news destination (Source: Press Gazette). To learn more about our business coverage and market insights Click Here!

Catch all the Business News, Market News, Breaking News Events and Latest News Updates on Live Mint. Download The Mint News App to get Daily Market Updates.
More Less
Published: 18 Feb 2021, 08:50 AM IST
Next Story footLogo
Recommended For You