Transition Report 2013 Stuck in transition?

CH4 180sq

Facts at a glance

AROUND
37%
The proportion of the population aged 25 and over in the transition region that had completed at least secondary education in 1990 (compared with 35% in advanced economies).

ALMOST 75% of migrants from countries in the transition region emigrated to other countries in the region.

Cover 180sqV2

 

IN 14 transition countries, having an inadequately educated workforce was among the top three (out of 14) business environment obstacles.

10 The number of universities in the transition region among the top 500 universities in the 2013 Shanghai ARWU league table.

Human capital

Annex 4.1. Measuring the quality of education

Primary and secondary education: PISA, TIMSS and PIRLS

The rankings for primary and secondary education shown in Chart 4.2a and 4.2b  in the main text are based on the combined average country scores in three international student assessments: the Progress in International Reading Literacy Study (PIRLS), the Trends in International Mathematics and Science Study (TIMSS) and the Programme for International Student Assessment (PISA).1 Of the transition countries, only Belarus, Kosovo, Tajikistan, Turkmenistan and Uzbekistan have yet to participate in any of these three assessments.

Reading literacy in the fourth grade (PIRLS) is reasonably good in most transition countries. Russia shared the second place with Finland in 2011 (after Hong Kong). However, Azerbaijan and Georgia lagged significantly behind other transition countries.

Proficiency in mathematics in the eighth grade lags only slightly behind the average for advanced economies. Russia was the best performer of the 10 countries in the transition region that participated in the mathematics TIMSS in 2011. It was also ahead of all western European countries, but trailed South Korea, Singapore, Taiwan, Hong Kong and Japan. Countries in the SEMED region lagged behind other transition countries, although Tunisia was roughly on a par with FYR Macedonia and Georgia in 2011.

Transition countries’ average level of attainment in science in the eighth grade was roughly the same as that seen in the advanced economies in 2011. The leading countries were Slovenia and Russia, which performed better than the United States and all EU countries except Finland.

More countries from the transition region participated in the 2006 and 2009 rounds of the PISA programme, which pointed to an increase in the gap between those countries and advanced economies. The order of countries in terms of the achievements of 15-year-old school pupils was similar to that seen for fourth grade pupils. Estonia performed the best in reading, mathematics and science in 2009 – on a par with Switzerland in reading, Germany and Belgium in mathematics and sixth out of all participating countries in science.

Table A.4.1.1

PISA, TIMSS and PIRLS scores

  PISA PIRLS (fourth grade) TIMSS (eighth grade)
Country Reading (2000) Maths (2006) Science (2006) Reading (2009) Maths (2009) Science (2009) 2001 2011 Maths (1999) Science (1999) Maths (2011) Science (2011)
Transition region and Turkey
Albania 348.8     384.8                
Armenia                 478b 461b 467 437
Azerbaijan 352.9c 476 382.3 361.5 431 373.2 462          
Bosnia and Herzegovina                     456d  
Bulgaria 430.4 413.4 434.1 429.1 428.1 439.3 550 532 540a 565a 464d 479b
Croatia 477.4c 467.2 493.2 475.7 459.9 486.4 553          
Czech Republic 491.6 516.5b 512.9 478.2 492.8 500.5 537 545 564a 574a 504d 539
Estonia 500.7c 514.6 531.4 501 512.1 527.8     531b 552b    
FYR Macedonia             442 442c 447 458 426 407
Georgia             471c 488 410d   431 420
Hungary 480 490.0b 503.9 494.2 490.2 502.6 543 539 537a 554a 505 522
Kazakhstan                     487 490
Kyrgyz Republic 284.7c 310.6 322 314 331.2 329.5            
Latvia 458.1 483.4b 489.5 484 482 493.9 545 541c 493a 485a 508 512b
Lithuania 470.1c 486.4 488 468.4 476.6 491.4   557c 477a 476a 502 514
Moldova             492 500c 469 459 460 472b
Montenegro 392.0c 399.3 411.8 407.5 402.5 401.3            
Poland 479.1 490.2b 497.8 500.5 494.8 508.1 519c 526        
Romania 427.9 414.8 418.4 424.5 427.1 428.2 512 502 482a 486a 458 465
Russia 461.8 468.4b 479.5 459.4 467.8 478.3 528 568 535a 538a 539 542
Serbia 411.7b 436.9b 435.6 442 442.4 442.8     477b 468b 486d  
Slovak Republic 469.2b 498.2b 488.4 477.4 496.7 490.3 518 535 547a 544a 508 517b
Slovenia 494.4c 504.5 518.8 483.1 501.5 511.8 502 530 541a 560a 505 543
Turkey 441.0b 423.4b 423.8 464.2 445.5 453.9 449   429 433 452 483
Ukraine                 462d   479 501
SEMED countries            
Egypt                 406b 421b 391d  
Jordan 400.6c 384 422 405 386.7 415.4     428 450 406 449
Morocco             350 310 337 323 371 376
Tunisia 374.6b 358.7b 385.5 403.6 371.5 400.7     448 430 425 439

Source: PISA, PIRLS and TIMSS.
Note: a – 1995; b – 2003; c – 2006; d – 2007.

Tertiary education

This annex presents more detailed information and data on some of the proxies for the quality of tertiary education presented in the main text.

League tables of top universities typically rank the world’s top 500 universities (out of a total of approximately 17,000 universities worldwide). The Academic Ranking of World Universities (ARWU) was first published in 2003 by the Shanghai Jiao Tong University. That was followed by the Times Higher Education (THE) World University Rankings, which were first produced in cooperation with Quacquarelli Symonds (QS) in 2004. In 2010 THE partnered Thomson Reuters in producing new rankings, while QS continued using the same methodology as before in partnership with US News & World Report.

A purely research-based ranking, the Performance Ranking of Scientific Papers for World Universities – also known as the Higher Education Evaluation and Accreditation Council of Taiwan Ranking (HEEACT Ranking) – was first published in 2007. Since 2012 the ranking has been known as the National Taiwan University Ranking (NTU Ranking).2

Table A.4.1.2

Number of top 500 universities in league tables by region

  2004 2005 2006 2007 2008 2009 2010 2011 2012 2013
Transition countries          
ARWU 8 8 7 8 8 8 8 9 10 10
QS   15           12 11  
NTU                 7  
Turkey          
ARWU 0 2 0 1 1 1 1 1 1 1
QS   4           5 2  
NTU                 0  
SEMED          
ARWU 0 0 1 1 0 0 0 1 1 1
QS   1           1 1  
NTU                 0  
Advanced economies          
ARWU 465 459 461 462 451 448 443 439 432 432
QS   429           435 427  
NTU                 455  
Other          
ARWU 29 31 31 38 43 44 48 50 56 56
QS   51           47 60  
NTU                 38  

Source: Authors’ calculations based on ARWU, QS World University Ranking and NTU Ranking.

Table A.4.1.2 shows the number of top 500 universities by region according to the ARWU, QS and NTU rankings, respectively. The number of universities from transition and SEMED countries in the top 500 varies across the rankings; universities from the Czech Republic, Poland and Russia are included in the latest available versions of each ranking.

The 2013 ARWU includes 10 universities from seven transition countries (Croatia, Czech Republic, Hungary, Poland, Russia, Serbia and Slovenia) and one from Turkey. The 2013 ranking also included a university from one SEMED country – Egypt. The 2012 QS ranking contained 11 universities from four countries in the transition region (the Czech Republic, Kazakhstan, Poland and Russia) and two from Turkey, while the SEMED region was again represented by a single Egyptian university. Turkey and the SEMED countries are missing from the 2012 NTU ranking, which features seven universities from six countries in the transition region (Croatia, the Czech Republic, Hungary, Poland, Russia and Slovenia).

Table A.4.1.3 shows, for each year, the number of citable articles published by academic journals in the three previous years, the average h-index for the period 1996-2011 and the number of citations (excluding self-citations) per document. The number of citable documents has increased across the world, particularly in Turkey and the SEMED countries (especially Tunisia). In the transition region, Serbia and Bosnia and Herzegovina have also recorded large rises. This could be due to increases in the number of peer-reviewed journals over time; unfortunately, the aggregate data do not provide any information about this, nor about the quality of journals.

Table A.4.1.3

Number of citable documents published in the three previous years, average h-index and average number of citations per document

  Transition region Turkey SEMED Advanced economies Other
Number of citable documents published in three previous years (thousands)
1997 72.1 5.6 4.7 883.4 90.9
1998 72.9 6.1 4.9 886.1 99.5
1999 72.8 7.1 5.1 887.9 105.3
2000 75.2 7.2 5.4 904.5 113.8
2001 76.6 8.6 5.7 883.3 128.1
2002 79.5 11.1 6.1 921.9 136.2
2003 86.4 13.8 7 1,024.00 161.7
2004 90.7 16.4 7.8 1,061.70 203.3
2005 104 18.7 8.5 1,213.80 274.7
2006 105.7 21.1 9.8 1,343.40 332.9
2007 112.5 23.1 11.1 1,375.00 372.9
2008 120.8 23.4 12.6 1,382.60 429.5
2009 123.7 26.8 15.2 1,414.80 496.7
2010 137.1 29.5 16.9 1,557.70 570.7
2011 142.5 30.2 19 1,588.90 644.6
Average number of citations per document (excluding self-citations)
1996-2011 4.6 4.5 4.3 9.8 7.6
Average h-index          
1996-2011 100.6 193 91 223.3 59.7

Source: Authors’ calculations based on the SCImago Journal and Country Rank portal (www.scimagojr.com).

Advanced economies lead in terms of the average number of citations per document (excluding self-citations), with 9.8 between 1996 and 2011, followed by the transition region, Turkey and SEMED countries with around 4.5. Hungary and Estonia are the two countries that are closest to the advanced economies’ average, with 8.8 and 8.6 citations per document respectively.

The United States leads in terms of the average h-index (with 1,305), followed by the United Kingdom, Germany, France and Canada. Turkish scholars follow relatively closely behind, with an average of 193.0 (similar to the level in Chile), while academics in the transition and SEMED regions trail some way behind with averages of 100.6 and 91.0 respectively. Among the transition countries, the best performers are Russia, Poland and Hungary, while Egypt leads in the SEMED region.

Table A.4.1.4 shows the number of recipients of S&E doctorates at US universities for the period 1982-2011.3 More than half of all doctoral degrees in the United States are awarded in the field of S&E. This yardstick does not take into account recipients of doctorates in other advanced economies, nor the attractiveness of doctoral training in recipients’ home countries. However, it is still likely to be a reasonable proxy for the quality of undergraduate education in recipients’ countries of origin, given the high ranking positions of US universities (which account for half of the world’s top 100 universities and almost half of the world’s top 200 universities according to ARWU). Also, US universities typically offer paid graduate assistantships to the majority of graduate students accepted, making doctoral studies more attractive there than in other countries.

With the exception of students from the former Yugoslavia, S&E doctorate recipients at US universities from the transition region were rare prior to the collapse of communism. This was probably a reflection of restrictions on travel, rather than the quality of tertiary education in those countries. The following two decades saw large increases, due mainly to recipients from Bulgaria, Romania, Serbia, Croatia and Slovenia. Moreover, between 2002 and 2011 Bulgaria was among the top three sources of undergraduate students from transition countries. The number of doctorate recipients from Turkey also increased sharply, while the number of Jordanian recipients declined (albeit from a high level).

Table A.4.1.4

Number of S&E doctorate recipients, undergraduate students and graduate students in the United States per million people of working age in the country of origin

  Recipients of S&E doctorates Undergraduate students Graduate students
Country of origin 1982-91 1992-2001 2002-11 2002-11 2002-11
Transition region     
Albania n/a 10.57 50.74 253.22 128
Bulgaria 1.52 53.12 107.97 339.83 219.3
Czech Republic 2.08 21.1 24.6 68.33 46.77
Hungary 6.16 40.81 35.45 52.77 59.09
Mongolia n/a n/a 28 369.91 123.88
Poland 10.69 17.22 17.56 55.82 31.36
Romania 1.54 38.01 103.84 59.03 118.42
Slovak Republic   13.32 26.86 80.1 52.55
Former Soviet Union 0.38        
Armenia   13.89 60 66.25 109.69
Azerbaijan   1.65 4.39 22.75 24.79
Belarus   2.82 12.44 32.23 25.13
Estonia   22.28 35.23 173.71 91.15
Georgia   8.3 19.92 50.3 66.37
Kazakhstan   1.71 7.21 61.27 29.49
Kyrgyz Republic   0 6.27 31.49 28.98
Latvia   7.36 26.69 155.82 69.97
Lithuania   14.75 27.46 143.17 71.48
Moldova   3.35 14.65 78.7 47.53
Russia   11.89 18.91 20.98 24.76
Tajikistan   6.13 1.45 27.34 12.53
Turkmenistan   n/a 2.58 24.22 16.68
Ukraine   5.05 19.97 21.5 29.22
Uzbekistan   0.98 2.99 14.42 11.54
Former Yugoslavia 32.57        
Bosnia and Herzegovina   12.27 25.13 105.03 43.25
Croatia   52.61 65.8 111.41 91.1
FYR Macedonia   17.85 38.42 116.43 85.9
Kosovo     n/a 392.01 124.56
Serbia and Montenegro (figures for 2002-2006)   67.25 55.85 55.03 59.43
Montenegro     16.67 123.33 55.24
Serbia     44.08 105.48 90.97
Slovenia   36.85 46.08 73.24 63.95
 
Turkey 30.38 50.44 92.18 85.48 149.43
 
SEMED countries     
Egypt 42.47 24.87 24.53 11.75 26.3
Jordan 419.65 302.02 278.11 191.01 342.79
Morocco 12.58 11.24 5.43 43.82 23.05
Tunisia 26.46 41.92 8.5 21.59
20.85

Source: Authors’ calculations based on National Science Foundation (2013) and Institute of International Education (2002-11).
Note: “n/a” stands for “not available”. Data for countries with fewer than five recipients of S&E doctorates in a given time period are not disclosed owing to confidentiality concerns.

  1. See Altinok et al. (2013) for details. PIRLS and TIMSS are conducted by the International Association for the Evaluation of Educational Achievement (IEA), while PISA is conducted by the OECD. PIRLS is designed to measure reading literacy in the fourth grade and is a successor to the IEA’s Reading Literacy Study, which ran from 1970 to 1991. Since 2001 PIRLS has been conducted every five years. TIMSS measures trends in achievement levels for mathematics and science in the fourth and eighth grades. It has been conducted at regular four-year intervals since 1995. PISA has measured the reading, mathematics and science achievements of 15-year-old school pupils at regular three-year intervals since 2000. [back]
  2. See Rauhvargers (2011) for an excellent overview of the existing university rankings. [back]
  3. We would like to thank Mark K. Fiegener from the National Science Foundation for sharing this breakdown of earned S&E doctorates for all countries of origin. [back]

icon-toolsTools