The Tempinis diaries

May 26, 2008

The Half Baked Research Assessment Exercise

Filed under: education, malaysia — Tags: , , , — toru @ 2:04 pm

Whoever came up with this Setara nonsense does not understand universities at all (see story below). There are so many things wrong with this entire thing that it seems like an exercise in futility. First, the academics on the panel are all from UKM. Now apart from questions of impartiality, UKM is not exactly a world-class university (to put it mildly). Why then get UKM professors to judge other universities in Malaysia? This really boggles the mind! And isn’t it ironic that the article is called “A Balanced View”? The members of the panel certainly are not balanced since they are all from UKM. Second, not all the academics on the panel are full professors. Are we so short of full professors that we cannot convene a panel with full professors? Third, there does not seem to be any repercussions in being ranked highly or lowly in this exercise. What then is the point of it all? It is just a case of ‘syok sendiri’.

I would propose that the following steps be taken in future exercises: (1) Appoint a completely foreign advisory board comprising of distinguished academics. This will ensure impartiality and also a valuable outsider perspective. The members of the panel can come from reputable universities in this region like NUS, NTU, Melbourne, Sydney, Beida, Fudan, Seoul National, Tokyo University or HKU. (2) Make funding and (possibly) fees correspond with ranking. Universities which are ranked higher should have a more generous funding from the government and possibly charge higher fees. Also, this should translate to the pay of the lecturers as well. Lecturers at higher ranked universities should be paid more. (3) The panel should also make specific recommendations on how Malaysian universities can be improved.

As it stands, this Setara is a complete waste of time and taxpayers’ money where a bunch of UKM academics are given a ‘rombongan sambil belajar’ to various countries. I understand that Setara might be the work of the former Minister for Higher Education. However, in future the Higher Education Ministers (Khaled Nordin, Hou Kok Chung and Idris Haron) should demonstrate that they take this portfolio seriously and display leadership and professionalism in conducting a more meaningful exercise.


Sunday May 25, 2008

A balanced view


The rating system announced recently provides the first objective snapshot of where Malaysian universities stand in relation to each other.

WE now know where Malaysian universities stand, following the release of the Rating System for Malaysian Higher Education Institutions (Setara) 2007.

Mohamed Khaled (fourth from left) holding up a copy of the Setara 2007 report .Looking on are his deputies Datuk Idris Haron (left), Dr Hou Kok Ching (right) and other Setara committee members.

Setara provided a contrast to last year’s Academic Reputation Survey (Ares). Universiti Malaya (UM) got the highest marks under Setara, whlle Universiti Sains Malaysia scored the most marks under Ares.

Higher Education Minister Datuk Seri Mohamed Khaled Nordin, who released the Setara results on May 16, said that a rating system provided a more complete and impartial picture, compared to ranking.

For Setara, a total of 17 public universities were rated in three categories – research, broadbased and specialised. No university earned the highest rating – six stars. UM was the only institution to score five stars in any of the three categories.

Mohamed Khaled said that Setara would enable universities to measure their strengths and weaknesses with a view to improving their standing in international rankings. Funding might also be linked to the universities’ Setara score.

There were six domains of measurement with different weightage for each category of university: academic staff reputation, student selectivity, research, academic programmes, resources and management. (See chart)

The ranking was based on 2006 data and was compiled by a team headed by Prof Dr Che Husna Azahari from Universiti Kebangsaan Malaysia (UKM). It was coordinated by the Malaysian Qualifications Agency (MQA).

The other panel members were Assoc Prof Ir Dr Othman A Karim, Assoc Prof Dr Siti Rahayah Ariffin, Dr Wan Rosmanira Ismail, Wan Mohd Zulkhir Wan Hassan (all from UKM), consultant Dr Zulkifli Senteri (who was formerly from MQA) and Laily Kamariah Mohd Jamil from MQA.

Three universities – Universiti Malaysia Kelantan, Universiti Darul Iman Malaysia and Universiti Pertahanan Nasional Malaysia were not included under Setara because they were new, and did not have sufficient data.

As a benchmark, the compilers also visited the National University of Singapore, University of Melbourne, Indian Institute of Technology, Mahidol University and University of Technology Sydney to test Setara against those institutions.

UM’s Prof Kurunathan Ratnavelu said that the introduction of Setara was a welcome move by the ministry.

“With the ever increasing focus in recent years on the quality of Malaysian universities in rankings like The Times Higher Education Supplement (THES), we should view Setara as part of the process to benchmark ourselves.”

He added that in this age of globalisation, the introduction of a competitive element among local universities was a good thing.

“I think there should be no envy between the universities as our focus is to build world-class institutions.

“This will not happen overnight but within a 15- to 20-year time-frame. The introduction of Ares and Setara are positive steps in this direction.”

However, Prof Kurunathan said that Setara should include ratings for the different disciplines, like Arts and Humanities, Engineering and Information Technology to provide better insight into the quality of research and teaching in these courses.

He said that potential undergraduate and postgraduate students would then be able to use Setara as a guide for applying to the best universities in these disciplines.

“These measures would have a strong spillover effect on creating a truly world-class Malaysian university by 2025.”

Prof Kurunathan added that the process of compiling Setara must be beyond reproach and teams that conduct such exercises must be seen to be transparent and impartial.

USM Academic and Administrative Staff Association president Wan Abdul Manan Wan Muda also brought up the question of neutrality and impartiality.

“We shouldn’t have a majority of people from the same university on the committee. People might question – however unfairly – the validity of Setara’s results because of this.”

Wan Adnan also said that some of the domains evaluated under Setara, such as resources, might unfairly disadvantage smaller and newer universities.

“Things like academic reputation are important to students and parents and it is valid to measure them.

“Ultimately, Setara should play a role in attracting good students and good academics to a university,” he said.

Another academic, however, did not see much point in releasing Setara unless the report came with major changes.

“Now that UM is declared five-star, can it also charge five-star prices?

“Will academics in the highly-ranked universities be paid more, and will students, too, have to pay higher tuition fees to reflect this?” asked the academic, who did not want to be named.


  1. ‘The members of the panel can come from reputable universities in this region like NUS, NTU, Melbourne, Sydney, Beida, Fudan, Seoul National, Tokyo University or HKU’

    UKM panel will pee in their pants when they meet real world class professors.

    Comment by Teoh — May 27, 2008 @ 1:26 am

  2. […] Nordin, the Minister of Higher Education, intends to implement. There’s also mention of the half baked Setara exercise filled with UKM professors. As I have written before, the whole assessment exercise is a […]

    Pingback by Reviewing Khaled Nordin’s Higher Education Plan « The Tempinis diaries — June 9, 2008 @ 1:25 pm

  3. […] Ministry of Higher Education Minister: Mohamed Khaled Nordin (Umno – Pasir Gudang) Deputy: Dr Hou Kok Chung (MCA – Kluang) […]

    Pingback by Quality of education in Johor’s hands | Suthan M — July 19, 2008 @ 7:19 pm

RSS feed for comments on this post. TrackBack URI

Leave a Reply

Fill in your details below or click an icon to log in: Logo

You are commenting using your account. Log Out /  Change )

Google photo

You are commenting using your Google account. Log Out /  Change )

Twitter picture

You are commenting using your Twitter account. Log Out /  Change )

Facebook photo

You are commenting using your Facebook account. Log Out /  Change )

Connecting to %s

Blog at

%d bloggers like this: