INDICATORS OF THE SCIENTIFIC IMPACT OF NATIONS REVISITED; pp. 231–250Full article in PDF format | https//doi.org/10.3176/tr.2020.2.07
An improved Indicator of a Nation’s Scientific Impact (INSI), which, in addition to citation rates, takes into account how many research areas in which each nation has exceeded the entrance thresholds of the Essential Science Indicators (ESI, Clarivate Analytics), was proposed. This indicator provided a more realistic estimate of nations’ scientific impact, which was better predicted from the societal factors that are related to the quality of scientific output. The strongest predictor of countries’ scientific impact was good governance, while economic wealth and research and development expenditure played a relatively minor role in predicting research impact. We conclude that good governance is needed to create an environment, which can facilitate the translation of money invested into the production of high-impact scientific output.
Albarran, P., I. Ortufno, and J. Ruiz-Castillo (2011) “Average-based versus high- and low-impact indicators for the evaluation of scientific distributions”. Research Evaluation 20, 4, 325-339.
Allesina, S. (2011) “Measuring nepotism through shared last names: the case of Italian Academia”. PLoS ONE 6, 8, e21160.
Allik, J. (2003) “The quality of science in Estonia, Latvia, and Lithuania after the first decade of independence”. Trames 7, 1, 40–52.
Allik, J. (2008) “Quality of Estonian science estimated through bibliometric indicators (1997–2007)”. Proceedings of the Estonian Academy of Sciences 57, 255–264.
Allik, J. (2011) “Estonian science estimated through bibliometric indicators”. In J. Engelbrecht, ed. Research in Estonia: present and future, 456–469. Tallinn: Estonian Academy of Sciences.
Allik, J. (2013) “Factors affecting bibliometric indicators of scientific quality”. Trames 17, 3, 199–214.
Allik, J. (2015) “Progress in Estonian science”. Proceedings of the Estonian Academy of Sciences 64, 2, 125–126.
Allik, J., Lauk, K., and Realo, A. (2020) “Factors predicting the scientific wealth of nations”. Cross-Cultural Research.
Andrews, M., R. Hay, and J. Myers (2010) “Can governance indicators make sense? Towards a new approach to sector-specific measures of governance”. Oxford Development Studies 38, 4, 391–410.
Bornmann, L. (2014) “How are excellent (highly cited) papers defined in bibliometrics? A quantitative analysis of the literature”. Research Evaluation 23, 2, 166–173.
Cimini, G., A. Gabrielli, and F. S. Labini (2014) “The scientific competitiveness of nations”. PLoS ONE 9, 12.
Cole, S. and T. J. Phelan (1999) “The scientific productivity of nations”. Minerva 37, 1, 1–23.
Coyle, D. (2014) GDP: a brief but affectionate history. Princeton and Oxford: Princeton University Press.
Erfanmanesh, M., M. Tahira, and A. Abrizah (2017) “The publication success of 102 nations in Scopus and the performance of their Scopus-indexed journals”. Publishing Research Quarterly 33, 4, 421–432.
Erkkilä, T. and O. Piironen, (2014) “(De)politicizing good governance: the World Bank Institute, the OECD and the politics of governance indicators”. Innovation: The European Journal of Social Science Research 27, 4, 344–360.
Gantman, E. R. (2012) “Economic, linguistic, and political factors in the scientific productivity of countries”. Scientometrics 93, 3, 967–985.
Garfield, E. (1955) “Citation indexes for science: a new dimension in documentation through association of ideas”. Science 122, 3159, 108–111.
Harzing, A. W. and A. Giroud (2014) “The competitive advantage of nations: an application to academia”. Journal of Informetrics 8, 1, 29–42.
HDI (2018) Human development indices and indicators: 2018 statistical update. New York: United Nations Development Programme. Available online at
<http://hdr.undp.org/en/content/human-development-indices-indicators-2018-statistical-update>. Accessed on 11.05.2020.
Henrich, J., S. J. Heine, and A. Norenzayan (2010a) “Most people are not WEIRD”. Nature 466, 7302, 29.
Henrich, J., S. J. Heine, and A. Norenzayan (2010b) “The weirdest people in the world?”. Behavioral and Brain Sciences 33, 2–3, 1–75.
Jaffe, K. (2011) “Do countries with lower self-citation rates produce higher impact papers? Or, does humility pay?”. Interciencia 36, 9, 694–698.
Jurajda, S., S. Kozubek, D. Munich, and S. Skoda (2017) “Scientific publication performance in post-communist countries: still lagging far behind”. Scientometrics 112, 1, 315–328.
Kaufmann, D., A. Kraay, and M. Mastruzzi (2010) “The worldwide governance indicators: methodology and analytical issues”. World Bank Policy Research Working Paper 5430. Available online at
<https://ssrn.com/abstract=1682130>. Accessed on 11.05.2020.
King, D. A. (2004) “The scientific impact of nations”. Nature 430, 6997, 311–316.
Kozak, M., L. Bornmann, and L. Leydesdorff (2015) “How have the Eastern European countries of the former Warsaw Pact developed since 1990? A bibliometric study”. Scientometrics 102, 2, 1101–1117.
Landefeld, J. S. (2000) GDP: One of the great inventions of the 20th century. Maryland: Bureau of Economic Analysis. Available online at
<https://apps.bea.gov/scb/pdf/BEAWIDE/2000/0100od.pdf>. Accessed on 11.05.2020.
Langbein, L. and S. Knack (2010) “The worldwide governance indicators: six, one, or none?”. The Journal of Development Studies 46, 2, 350–370.
Lauk, K. and J. Allik (2018) “A puzzle of Estonian science: how to explain unexpected rise of the scientific impact”. Trames 22, 4, 329–344.
Leydesdorff, L., and C. Wagner (2009) “Macro-level indicators of the relations between research funding and research output”. Journal of Informetrics 3, 4, 353–362.
May, R. M. (1997) “The scientific wealth of nations”. Science 275, 5301, 793–796. doi:10.1126/science.275.5301.793
Monge-Najera, J. and Y. S. Ho (2015) “Bibliometry of Panama publications in the Science Citation Index Expanded: publication type, language, fields, authors and institutions”. Revista De Biologia Tropical 63, 4, 1255–1266.
Mueller, C. (2016) “Accurate forecast of countries’ research output by macro-level indicators”. Scientometrics 109, 2, 1307–1328.
Must, Ü. (2006) “New’countries in Europe – research, development and innovation strategies vs bibliometric data”. Scientometrics 66, 2, 241–248.
Pajic, D. (2015) “Globalization of the social sciences in Eastern Europe: genuine breakthrough or a slippery slope of the research evaluation practice?”. Scientometrics 102, 3, 2131–2150.
Pinar, M. (2015) “Measuring world governance: revisiting the institutions hypothesis”. Empirical Economics 48, 2, 747–778.
Prathap, G. (2017) “Scientific wealth and inequality within nations”. Scientometrics 113, 2, 923–928.
Prosperi, M., I. Buchan, I. Fanti, S. Meloni, P. Palladino, and V. I. Torvik (2016) “Kin of coauthorship in five decades of health science literature”. Proceedings of the National Academy of Sciences of the United States of America 113, 32, 8957–8962.
Rousseau, S. and R. Rousseau (1998) “The scientific wealth of European nations: taking effectiveness into account”. Scientometrics 42, 1, 75–87.
Rushton, J. P. (1991) “Ethnic nepotism in science – authors response”. Behavioral and Brain Sciences 14, 3, 526–527.
Sandstrom, U. and M. Hallsten (2008) “Persistent nepotism in peer-review”. Scientometrics, 74, 2, 175–189.
Schofer, E. (2004) “Cross-national differences in the expansion of science, 1970–1990”. Social Forces 83, 1, 215–248.
Tahamtan, I., A. S. Afshar, and K. Ahamdzadeh (2016) “Factors affecting number of citations: a comprehensive review of the literature”. Scientometrics 107, 3, 1195–1225.
Update Team (2018) Human development indices and indicators: 2018 statistical update. New York: United Nations Development Programme.
van Leeuwen, T. N., H. F. Moed, R. J. W. Tijssen, M. S. Visser, and A. F. J. van Raan (2001) “Language biases in the coverage of the Science Citation Index and its consequences for international comparisons of national research performance”. Scientometrics 5, 1, 335–346.
van Leeuwen, T. N., M. S. Visser, H. F. Moed, T. J. Nederhof, and A. F. J. van Raan (2003) “Holy Grail of science policy: exploring and combining bibliometric tools in search of scientific excellence”. Scientometrics 57, 2, 257-280.
Vinkler, P. (2008) “Correlation between the structure of scientific research, scientometric indicators and GDP in EU and non-EU countries”. Scientometrics 74, 2, 237–254.
Xie, J., K. Gong, J. Li, Q. Ke, H. Kang, and Y. Cheng (2019) “A probe into 66 factors which are possibly associated with the number of citations an article received”. Scientometrics 119, 3, 1429–1454.
Back to Issue