Get into data mining

print   ·   T  T  

In this era driven by enormous data, there is so much demand for tools and people to interpret it. Statistics is going to be the profession of the future.

There is a lot of information in numbers.
There is a lot of information in numbers.

In 2009, Hal Varian, chief economist, Google, had said, “I keep saying the sexy job in the next 10 years will be statisticians. People think I'm joking, but who would've guessed that computer engineers would've been the sexy job of the 1990s?” He could not have been more correct. It is the International Year of Statistics, and statisticians across the world are celebrating their subject in today’s data-driven world.

Statistics 30 years ago and statistics today are completely different. For starters, “When I was a student of the Indian Statistical Institute, we had the tools to interpret data, but no data. Now, the scenario is the exactly the opposite, we have enormous data but not all the tools to interpret it,” says Srinivas Bhogle, Director and India Country Manager of TEOCO Software.

Delampady Mohan, professor, Indian Statistical Institute-Bangalore, who defines statistics as the study of uncertainty or variability, says that of all the applications of statistics, it is data analytics which is now gaining momentum. “This is an area of statistics dealing with huge quantities of data where one does ‘data mining’,” he says. “There is a lot of information contained in numbers, and to process that intelligently is statistics. We can draw many inferences from just one number and that is the beauty of statistics,” says Dr. Bhogle.

Data analytics

With collection of data becoming easier, we now have immense data that needs to be analysed. “And we also need a large number of people to do this,” says Dr. Bhogle. Data now is not just in numbers; medical data, text data, voice and video data have emerged in this era of digitisation.

According to Dr. Bhogle, data analytics is the best thing to do in the next 5-10 years.

Another buzzword in the industry is Big Data. According, this refers to large data sets that are collected from every imaginable source and analysed by businesses to discover ways of creating new revenues. The website is run by the global team that is observing the International Year of Statistics. It quotes Peter Sondergaard, head of research at Gartner, one of the world’s leading information technology research and advisory companies, according to whom by 2015, the thirst for Big Data mining experts is expected to create 4.4 million jobs around the world. Listing out the varied applications of statistics, Prof. Mohan says, “Many problems across many fields require modelling variability. Then the model is identified or refined using data, and subsequently used in prediction (or some other inference) like in stock market (financial statistics), clinical trials (biostatistics), wildlife monitoring (ecology) or insurance (actuarial statistics), to name a few.”

Where to study

Where do you gain expertise in statistics to be in the profession of the future? While all major colleges and universities provide degree courses, the Indian Statistical Institute, headquartered in Kolkata with campuses in New Delhi, Bangalore, Chennai and Tezpur, offers bachelor’s and master’s courses in statistics. But the institute does not have a high intake.



Recent Article in EDUCATION PLUS

Enjoy your schooling:Participation in activity without reference to outcome is key to learning.Photo: K.R. Deepak

Attitudes to learning

As long as we look for reasons not to learn, education will elude us. »