SEARCH

Opinion » Comment

Updated: March 9, 2013 02:13 IST

The overuse of rankings

Philip G. Altbach
Comment (2)   ·   print   ·   T  T  
NOT TOP 10: Many outstanding institutions worldwide do not appear in the rankings because they do not fit into the specific criteria measured.
The Hindu NOT TOP 10: Many outstanding institutions worldwide do not appear in the rankings because they do not fit into the specific criteria measured.

Global university ordering is limited in what it measures. The exercise provides only an incomplete perspective on higher education

Prime Minister Manmohan Singh recently chastised Indian universities for having no institutions in the “top 200” of the global higher education rankings. He sees this poor showing as an indication of the low quality of Indian higher education. Indian authorities also said that only overseas universities in the global “top 500” would be permitted to establish a branch campus or joint-degree programme in India. Other countries use the global rankings for internal purposes. Singapore uses them as a benchmark and as an indicator, where scholarship students may be sent. Russia has bemoaned its poor showing, has provided extra funding for selected universities, and is considering major additional resources for a few — in order to ensure that several will be in the top ranks soon. Kazakhstan is committed to having a university in the top tier and looks to rankings as a guideline. At least one American university president has been offered a salary bonus if his university improves its rank. The list goes on.

Anatomy and critique

There are, of course, many rankings. Most are national and some are specialised. The majority are sponsored by magazines and other for-profit organisations. Many, if not most, are worthless, because their methodologies are flawed or there is no methodology at all. Dr. Singh and most of the countries mentioned here refer to the three well-known international rankings. Two of these, the Academic Ranking of World Universities, popularly known as the “Shanghai rankings,” and the World University Rankings of Times Higher Education are methodologically respectable and can be taken seriously.

But these rankings are quite limited in what they measure and thus provide only an incomplete perspective on higher education and on the universities that are ranked. The Shanghai rankings are quite clear in what is assessed — only research, research impact, and a few variables related to research — such as prizes awarded to professors and numbers of Nobel winners associated with the institution. Times Higher Education measures a wider array of variables. Research and its impact is at the top of the list, but reputation is also included as are several other variables — such as teaching quality and internationalisation. But since there is no real way to measure teaching or internationalisation, weak proxies are used. Reputation is perhaps the most controversial element in most of the national and global rankings. Even asking a selected group of academics and university leaders for their opinions about which universities are best yields questionable results. How much will physicists in Bulgaria or university rectors in Germany know about the quality of universities in India or Russia? It is not surprising, therefore, that only the Indian Institutes of Technology are ranked. They are among the few Indian institutions receiving international attention. In general, the more reputation is used as a key variable, the less accurate a ranking is likely to be. Further, respondents filling out reputational surveys for rankings will judge an institution on its research reputation — teaching excellence, national relevance, or university-university linkages are not part of the knowledge base.

In addition, certain kinds of research receive the greatest attention — the research that appears in recognised international refereed journals. The journals that are chosen for inclusion in the Web of Science, Science Citation Index, Social Sciences Citation Index, and a few others are considered “legitimate.” This limitation dramatically privileges publication in English — the language of the vast majority of the internationally recognised journals. Further, research that adheres to the norms and values of editors and peer reviewers, who are mainly in the top Western universities, will tend to get published. The hard sciences receive much more attention than soft fields such as the arts and humanities. Universities that are strong in technology, life sciences, and related fields have significant advantages.

Distortions

Many outstanding institutions worldwide do not appear in the rankings because they do not happen to fit into the specific criteria measured. In general, specialised universities, other than those in technology, do not do well. America’s elite liberal arts colleges, by most accounts offering some of the best-quality education in the world, are nowhere to be found. Universities that do not have engineering or medicine are probably undercounted. Most important, perhaps, is the disadvantages faced by developing and emerging economies. Researchers do not have easy access to the top journals, must write in English, and perhaps most important, the topics and the methodologies of the research must be appealing to editors and reviewers in the central academic powers.

Usefulness of rankings

To an extent, the rankings provide a way of benchmarking for the small number of research universities worldwide. By looking carefully at the structures, governance, funding, and academic cultures of the universities that do well in the rankings, lessons can be learned. Even though the budgets of the research superpowers can seldom be matched and the access of these institutions to top international talent will be impossible for most, there are global academic practices that may yield insights.

Guidelines not models

For India, or other developing countries, to obsess about the rankings is a mistake. There may be lessons, but not rules. It is much more important that a balanced and differentiated academic system emerges, and as part of such a system there may be a few universities that can aspire to the middle or even the upper reaches of the ranking in time. To limit academic cooperation to those universities that are listed in the global rankings is also a mistake, since many outstanding institutions do not fit the rankings model but nonetheless may be excellent global partners. When it comes to universities, one size does not fit all. The global rankings measure just one kind of academic excellence, and even here the tools of measurement are far from perfect.

(Philip G. Altbach is Monan University Professor and director of the Center for International Higher Education at Boston College, U.S.)

More In: Comment | Opinion

On agreeing with the views of the author, it may also be noted that
the graduates from many of the Indian Universities and Higher
Education institutions are of high demand overseas and are successful
in their career. About a decade back, during a survey at India's IT
city Bangalore, we found that more than 50 percent of the top bosses
at the helm of technology based companies having offices in Bangalore
and around the globe have the basic degree from an Indian University
only. The measures differ a lot and many a times our environment is
not conducive to have a ranking. That does not matter. Since the
author cited Singapore's view and criteria, as a professional who
knows their approach in education, the ranking is a tool which they
need to use very much. For the Indian conditions, ranking by an
external agency is not the prime requirement now. What we need is a
cohesive plan for bringing a uniform development in higher education.

from:  Dr MK Radhakrishnan
Posted on: Mar 9, 2013 at 15:53 IST

"Prime Minister Manmohan Singh recently chastised Indian universities for having no
institutions in the “top 200” of the global higher education rankings."

If an Indian University has to be in the 'Top 200', it has to replace one already in it.
The Prime Minister has to pray that at least some Universities already in the 'Top 200'
slow down their progress relative to the progress of such potential Indian
Universities and get themselves out of the list. Isn't it naive to assume that?

from:  Ancheri Sreekumar
Posted on: Mar 9, 2013 at 13:30 IST
This article is closed for comments.
Please Email the Editor
The Hindu presents the all-new Young World


O
P
E
N

close

Recent Article in Comment

An ancient haven for refugees sees signs of strain

A Syrian boy stood on a white stool under a giant Turkish flag in Taksim Square, selling cold water one hot evening last week. His sales... »