ESTONIAN ACADEMY
PUBLISHERS
eesti teaduste
akadeemia kirjastus
PUBLISHED
SINCE 1997
 
TRAMES cover
TRAMES. A Journal of the Humanities and Social Sciences
ISSN 1736-7514 (Electronic)
ISSN 1406-0922 (Print)
Impact Factor (2022): 0.2
INDICATORS OF THE SCIENTIFIC IMPACT OF NATIONS REVISITED; pp. 231–250
PDF | https//doi.org/10.3176/tr.2020.2.07

Authors
Jüri Allik, Kalmer Lauk, Anu Realo
Abstract

An improved Indicator of a Nation’s Scientific Impact (INSI), which, in addition to citation rates, takes into account how many research areas in which each nation has exceeded the entrance thresholds of the Essential Science Indicators (ESI, Clarivate Analytics), was proposed. This indicator provided a more realistic estimate of nations’ scientific impact, which was better predicted from the societal factors that are related to the quality of scientific output. The strongest predictor of countries’ scientific impact was good governance, while economic wealth and research and development expenditure played a relatively minor role in predicting research impact. We conclude that good governance is needed to create an environment, which can facilitate the translation of money invested into the production of high-impact scientific output. 

References

Albarran, P., I. Ortufno, and J. Ruiz-Castillo (2011) “Average-based versus high- and low-impact indicators for the evaluation of scientific distributions”. Research Evaluation 20, 4, 325-339. 
https://doi.org/10.3152/095820211X13164389670310

Allesina, S. (2011) “Measuring nepotism through shared last names: the case of Italian Academia”. PLoS ONE 6, 8, e21160. 
https://doi.org/10.1371/journal.pone.0021160

Allik, J. (2003) “The quality of science in Estonia, Latvia, and Lithuania after the first decade of independence”. Trames 7, 1, 40–52. 

Allik, J. (2008) “Quality of Estonian science estimated through bibliometric indicators (1997–2007)”. Proceedings of the Estonian Academy of Sciences 57, 255–264. 
https://doi.org/10.3176/tr.2013.3.01

Allik, J. (2011) “Estonian science estimated through bibliometric indicators”. In J. Engelbrecht, ed. Research in Estonia: present and future, 456–469. Tallinn: Estonian Academy of Sciences.

Allik, J. (2013) “Factors affecting bibliometric indicators of scientific quality”. Trames 17, 3, 199–214. 
https://doi.org/10.3176/tr.2013.3.01

Allik, J. (2015) “Progress in Estonian science”. Proceedings of the Estonian Academy of Sciences 64, 2, 125–126. 
http://www.kirj.ee/public/proceedings_pdf/2015/issue_2/Proc-2015-2-125-126.pdf

Allik, J., Lauk, K., and Realo, A. (2020) “Factors predicting the scientific wealth of nations”. Cross-Cultural Research. 
https://doi.org/10.1177/1069397120910982

Andrews, M., R. Hay, and J. Myers (2010) “Can governance indicators make sense? Towards a new approach to sector-specific measures of governance”. Oxford Development Studies 38, 4, 391–410. 
https://doi.org/10.1080/13600818.2010.524696

Bornmann, L. (2014) “How are excellent (highly cited) papers defined in bibliometrics? A quantitative analysis of the literature”. Research Evaluation 23, 2, 166–173. 
https://doi.org/10.1093/reseval/rvu002

Cimini, G., A. Gabrielli, and F. S. Labini (2014) “The scientific competitiveness of nations”. PLoS ONE 9, 12. 
https://doi.org/10.1371/journal.pone.0113470

Cole, S. and T. J. Phelan (1999) “The scientific productivity of nations”. Minerva 37, 1, 1–23. 
https://doi.org/10.1023/A:1004591413630

Coyle, D. (2014) GDP: a brief but affectionate history. Princeton and Oxford: Princeton University Press.
https://doi.org/10.1515/9781400873630

Erfanmanesh, M., M. Tahira, and A. Abrizah (2017) “The publication success of 102 nations in Scopus and the performance of their Scopus-indexed journals”. Publishing Research Quarterly 33, 4, 421–432.
https://doi.org/10.1007/s12109-017-9540-5

Erkkilä, T. and O. Piironen, (2014) “(De)politicizing good governance: the World Bank Institute, the OECD and the politics of governance indicators”. Innovation: The European Journal of Social Science Research 27, 4, 344–360. 
https://doi.org/10.1080/13511610.2013.850020

Gantman, E. R. (2012) “Economic, linguistic, and political factors in the scientific productivity of countries”. Scientometrics 93, 3, 967–985. 
https://doi.org/10.1007/s11192-012-0736-3

Garfield, E. (1955) “Citation indexes for science: a new dimension in documentation through association of ideas”. Science 122, 3159, 108–111. 
https://doi.org/10.1126/science.122.3159.108

Harzing, A. W. and A. Giroud (2014) “The competitive advantage of nations: an application to academia”. Journal of Informetrics 8, 1, 29–42. 
https://doi.org/10.1016/j.joi.2013.10.007

HDI (2018) Human development indices and indicators: 2018 statistical update. New York: United Nations Development Programme. Available online at 
<http://hdr.undp.org/en/content/human-development-indices-indicators-2018-statistical-update>. Accessed on 11.05.2020.

Henrich, J., S. J. Heine, and A. Norenzayan (2010a) “Most people are not WEIRD”. Nature 466, 7302, 29. 
https://doi.org/10.1038/466029a

Henrich, J., S. J. Heine, and A. Norenzayan (2010b) “The weirdest people in the world?”. Behavioral and Brain Sciences 33, 2–3, 1–75. 
https://doi.org/10.1017/S0140525X0999152X

Jaffe, K. (2011) “Do countries with lower self-citation rates produce higher impact papers? Or, does humility pay?”. Interciencia 36, 9, 694–698. 

Jurajda, S., S. Kozubek, D. Munich, and S. Skoda (2017) “Scientific publication performance in post-communist countries: still lagging far behind”. Scientometrics 112, 1, 315–328. 
https://doi.org/10.1007/s11192-017-2389-8

Kaufmann, D., A. Kraay, and M. Mastruzzi (2010) “The worldwide governance indicators: methodology and analytical issues”. World Bank Policy Research Working Paper 5430. Available online at 
<https://ssrn.com/abstract=1682130>. Accessed on 11.05.2020.

King, D. A. (2004) “The scientific impact of nations”. Nature 430, 6997, 311–316. 
https://doi.org/10.1038/430311a

Kozak, M., L. Bornmann, and L. Leydesdorff (2015) “How have the Eastern European countries of the former Warsaw Pact developed since 1990? A bibliometric study”. Scientometrics 102, 2, 1101–1117. 
https://doi.org/10.1007/s11192-014-1439-8

Landefeld, J. S. (2000) GDP: One of the great inventions of the 20th century. Maryland: Bureau of Economic Analysis. Available online at 
<https://apps.bea.gov/scb/pdf/BEAWIDE/2000/0100od.pdf>. Accessed on 11.05.2020.

Langbein, L. and S. Knack (2010) “The worldwide governance indicators: six, one, or none?”. The Journal of Development Studies 46, 2, 350–370. 
https://doi.org/10.1080/00220380902952399

Lauk, K. and J. Allik (2018) “A puzzle of Estonian science: how to explain unexpected rise of the scientific impact”. Trames 22, 4, 329–344. 
https://doi.org/10.3176/tr.2018.4.01

Leydesdorff, L., and C. Wagner (2009) “Macro-level indicators of the relations between research funding and research output”. Journal of Informetrics 3, 4, 353–362. 
https://doi.org/10.1016/j.joi.2009.05.005

May, R. M. (1997) “The scientific wealth of nations”. Science 275, 5301, 793–796. doi:10.1126/science.275.5301.793
https://doi.org/10.1126/science.275.5301.793

Monge-Najera, J. and Y. S. Ho (2015) “Bibliometry of Panama publications in the Science Citation Index Expanded: publication type, language, fields, authors and institutions”. Revista De Biologia Tropical 63, 4, 1255–1266. 
https://doi.org/10.15517/rbt.v63i4.21112

Mueller, C. (2016) “Accurate forecast of countries’ research output by macro-level indicators”. Scientometrics 109, 2, 1307–1328. 
https://doi.org/10.1007/s11192-016-2084-1

Must, Ü. (2006) “New’countries in Europe – research, development and innovation strategies vs bibliometric data”. Scientometrics 66, 2, 241–248. 
https://doi.org/10.1007/s11192-006-0016-1

Pajic, D. (2015) “Globalization of the social sciences in Eastern Europe: genuine breakthrough or a slippery slope of the research evaluation practice?”. Scientometrics 102, 3, 2131–2150. 
https://doi.org/10.1007/s11192-014-1510-5

Pinar, M. (2015) “Measuring world governance: revisiting the institutions hypothesis”. Empirical Economics 48, 2, 747–778. 
https://doi.org/10.1007/s00181-013-0796-0

Prathap, G. (2017) “Scientific wealth and inequality within nations”. Scientometrics 113, 2, 923–928. 
https://doi.org/10.1007/s11192-017-2511-y

Prosperi, M., I. Buchan, I. Fanti, S. Meloni, P. Palladino, and V. I. Torvik (2016) “Kin of coauthorship in five decades of health science literature”. Proceedings of the National Academy of Sciences of the United States of America 113, 32, 8957–8962. 
https://doi.org/10.1073/pnas.1517745113

Rousseau, S. and R. Rousseau (1998) “The scientific wealth of European nations: taking effectiveness into account”. Scientometrics 42, 1, 75–87. 
https://doi.org/10.1007/BF02465013

Rushton, J. P. (1991) “Ethnic nepotism in science – authors response”. Behavioral and Brain Sciences 14, 3, 526–527. 
https://doi.org/10.1017/S0140525X0007117X

Sandstrom, U. and M. Hallsten (2008) “Persistent nepotism in peer-review”. Scientometrics, 74, 2, 175–189. 
https://doi.org/10.1007/s11192-008-0211-3

Schofer, E. (2004) “Cross-national differences in the expansion of science, 1970–1990”. Social Forces 83, 1, 215–248. 
https://doi.org/10.1353/sof.2004.0125

Tahamtan, I., A. S. Afshar, and K. Ahamdzadeh (2016) “Factors affecting number of citations: a comprehensive review of the literature”. Scientometrics 107, 3, 1195–1225. 
https://doi.org/10.1007/s11192-016-1889-2

Update Team (2018) Human development indices and indicators: 2018 statistical update. New York: United Nations Development Programme.

van Leeuwen, T. N., H. F. Moed, R. J. W. Tijssen, M. S. Visser, and A. F. J. van Raan (2001) “Language biases in the coverage of the Science Citation Index and its consequences for international comparisons of national research performance”. Scientometrics 5, 1, 335–346. 
https://doi.org/10.1023/A:1010549719484

van Leeuwen, T. N., M. S. Visser, H. F. Moed, T. J. Nederhof, and A. F. J. van Raan (2003) “Holy Grail of science policy: exploring and combining bibliometric tools in search of scientific excellence”. Scientometrics 57, 2, 257-280. 
https://doi.org/10.1023/A:1024141819302

Vinkler, P. (2008) “Correlation between the structure of scientific research, scientometric indicators and GDP in EU and non-EU countries”. Scientometrics 74, 2, 237–254. 
https://doi.org/10.1007/s11192-008-0215-z

Xie, J., K. Gong, J. Li, Q. Ke, H. Kang, and Y. Cheng (2019) “A probe into 66 factors which are possibly associated with the number of citations an article received”. Scientometrics 119, 3, 1429–1454. 
https://doi.org/10.1007/s11192-019-03094-z

Back to Issue