The republic of statistical scramble

Straightening out data inconsistencies should be a government priority

Rajrishi Singhal
Updated23 Aug 2017, 08:12 AM IST
Mismatch between data sets from within the government breeds scepticism regarding the statistical robustness of national accounting. Photo: iStock
Mismatch between data sets from within the government breeds scepticism regarding the statistical robustness of national accounting. Photo: iStock

Many a caustic word has been exchanged in the acrimonious debate over the Indian economy’s employment data. One set of numbers claims the current phase of economic growth as jobless. Alternative data sets have accompanied vigorous assertions of rising employment. And then there are many in the middle, trying to make sense of the scant (and outdated) data and wondering how anybody reached any conclusion at all.

Welcome to the republic of statistical scramble in the age of Big Data. The Bharatiya Janata Party’s (BJP’s) 2014 election victory was predicated partly on the promise of enhanced economic well-being; straightening out data inconsistencies should be a priority on the path to fulfilling that promise.

Take a look at labour data. Currently, employment data is collated from different surveys, each one measuring different things using varied methodologies. NITI Aayog’s task force on improving employment data recently released the first draft of its report, which lists how several arms of the government get involved in collecting and mashing up data. The report is unequivocal about the current state of data collection: “The available estimates are either out-dated or based on surveys with design flaws that render them unsuitable for inferring nationwide employment level.”

On the demand side, the National Sample Survey Organization (NSSO), in the ministry of statistics and programme implementation (Mospi), conducts a comprehensive household survey once every five years, with the last one occurring in 2011-12. The labour bureau in the ministry of labour and employment also conducts two household surveys—a quarterly quick employment survey and another on an annual basis. These are in addition to the decadal population census surveys, which measure two variables: a headcount of all types of workers at 10-year intervals and all non-agricultural enterprises, regardless of size.

On the jobs supply side, Mospi conducts a statutory annual industries survey for units registered under the Factories Act, 1948. NSSO also conducts an unorganized units survey; this is in addition to the micro, small and medium enterprises (MSME) census conducted by the MSME ministry. Finally, various government administrative bodies, such as the Employees Provident Fund Organization (EPFO) or Employees’ State Insurance Corporation (ESIC), provide some indication of organized sector employment trends (though this is being increasingly undermined by growing preference for contract labour). In addition, there are some private sector surveys also—for example, by the Centre for Monitoring Indian Economy.

All these measures suffer from some infirmity, whether it’s methodological, unviable sample size, inability to distinguish between different types of employment, long gaps or irregular frequencies. But one thing is common: the findings only provide a partial picture and are therefore useless as a tool for policy design. Part two of the Economic Survey says: “The lack of reliable estimates on employment in recent years has impeded its measurement and thereby the Government faces challenges in adopting appropriate policy interventions.”

The NSSO has, in the meantime, begun a fresh, ambitious annual exercise to map all nature of employment data; a quarterly survey will generate similar estimates for urban areas. In its report, NITI Aayog has recommended, among other things, vast improvements to existing surveys, institutional and legislative changes, overhauling physical and digital infrastructure and more aggressive use of technology to crunch the time-gap. 

But the study might need to extend beyond employment data because statistical distortions also exist in other areas. NITI Aayog provides an example about the state of statistical confusion: each enterprise, while filing returns or statutory information, is assigned a different identification number under Good and Services Tax Network, EPFO, ESIC, Factories Act and Shops and Establishment Act.

This problem is not restricted to enterprise data and exists in other government departments as well. Take the example of estimating the cotton crop. Two separate ministries release two separate estimates every year.

The agriculture ministry’s cotton crop estimate for 2015-16 was 30.15 million bales of 170kg each, while the textile ministry’s estimate for the same year was 33.8 million bales—that’s a difference of 620 million kg! In the previous year, 2014-15, the estimates put out by the two ministries were 34.8 million bales and 38 million bales, respectively. This divergence seems bewildering, especially when acreage estimates from both the ministries broadly tally.

Forget discrepancies between ministries: this paper had reported (goo.gl/vsYGzc) how cotton yield figures differ widely within the agriculture ministry. There have also been reports (goo.gl/fd9adW) about vastly varying data on the number of taxpayers added since demonetization emerging from different parts of the government. Mismatch between data sets from within the government also breeds scepticism regarding the statistical robustness of national accounting, especially when anecdotal evidence seems contra to buoyant gross domestic product data.

India’s magnificent statistical heritage distinguishes the nation from its neighbours, whose growth record is often viewed with scepticism globally. This infrastructure needs an urgent overhaul to maintain credibility, perceive economic trends and deliver appropriate policy prescriptions.

Rajrishi Singhal is a consultant and former editor of a leading business newspaper. His Twitter handle is @rajrishisinghal.

Comments are welcome at views@livemint.com

Catch all the Business News, Market News, Breaking News Events and Latest News Updates on Live Mint. Download The Mint News App to get Daily Market Updates.

MoreLess
First Published:23 Aug 2017, 08:12 AM IST
Business NewsOpinionThe republic of statistical scramble

Get Instant Loan up to ₹10 Lakh!

  • Employment Type

    Most Active Stocks

    Tata Steel share price

    145.85
    11:58 AM | 25 OCT 2024
    -3.15 (-2.11%)

    Bharat Electronics share price

    260.25
    11:58 AM | 25 OCT 2024
    -11.15 (-4.11%)

    Indusind Bank share price

    1,030.85
    11:58 AM | 25 OCT 2024
    -248.05 (-19.4%)

    ITC share price

    489.55
    11:58 AM | 25 OCT 2024
    17.7 (3.75%)
    More Active Stocks

    Market Snapshot

    • Top Gainers
    • Top Losers
    • 52 Week High

    Poly Medicure share price

    2,597.55
    11:47 AM | 25 OCT 2024
    22.6 (0.88%)

    Aster DM Healthcare share price

    442.55
    11:48 AM | 25 OCT 2024
    -0.4 (-0.09%)

    Radico Khaitan share price

    2,291.95
    11:48 AM | 25 OCT 2024
    -2.35 (-0.1%)

    Dixon Technologies (India) share price

    13,292.05
    11:48 AM | 25 OCT 2024
    -1772 (-11.76%)
    More from 52 Week High

    Glenmark Life Sciences share price

    953.35
    11:48 AM | 25 OCT 2024
    -86.05 (-8.28%)

    Chennai Petroleum Corporation share price

    702.60
    11:48 AM | 25 OCT 2024
    -56.35 (-7.42%)

    Motilal Oswal Financial Services share price

    873.85
    11:47 AM | 25 OCT 2024
    -65.15 (-6.94%)

    Finolex Industries share price

    283.50
    11:48 AM | 25 OCT 2024
    -17.15 (-5.7%)
    More from Top Losers

    Laurus Labs share price

    477.80
    11:48 AM | 25 OCT 2024
    31.8 (7.13%)

    Bikaji Foods International share price

    872.80
    11:48 AM | 25 OCT 2024
    36.95 (4.42%)

    PNB Housing Finance share price

    972.10
    11:47 AM | 25 OCT 2024
    38.85 (4.16%)

    ITC share price

    490.00
    11:48 AM | 25 OCT 2024
    18.15 (3.85%)
    More from Top Gainers

    Recommended For You

      More Recommendations

      Gold Prices

      • 24K
      • 22K
      Bangalore
      79,475.00-620.00
      Chennai
      79,481.00-620.00
      Delhi
      79,633.00-620.00
      Kolkata
      79,485.00-620.00

      Fuel Price

      • Petrol
      • Diesel
      Bangalore
      102.86/L0.00
      Chennai
      100.75/L-0.11
      Kolkata
      104.95/L0.00
      New Delhi
      94.72/L0.00

      Popular in Opinion

        HomeMarketsPremiumInstant LoanMint Shorts