caa a22 4500 445348585 CHVBK 20180317142837.0 cr unu---uuuuu 170323e20110701xx s 000 0 eng 10.1007/s11192-011-0373-2 doi (NATIONALLICENCE)springer-10.1007/s11192-011-0373-2 National research assessment exercises: the effects of changing the rules of the game during the game [Elektronische Daten] [Giovanni Abramo, Ciriaco D'Angelo, Flavia Di Costa] National research evaluation exercises provide a comparative measure of research performance of the nation's institutions, and as such represent a tool for stimulating research productivity, particularly if the results are used to inform selective funding by government. While a school of thought welcomes frequent changes in evaluation criteria in order to prevent the subjects evaluated from adopting opportunistic behaviors, it is evident that the "rules of the game” should above all be functional towards policy objectives, and therefore be known with adequate forewarning prior to the evaluation period. Otherwise, the risk is that policy-makers will find themselves faced by a dilemma: should they reward universities that responded best to the criteria in effect at the outset of the observation period or those that result as best according to rules that emerged during or after the observation period? This study verifies if and to what extent some universities are penalized instead of rewarded for good behavior, in pursuit of the objectives of the "known” rules of the game, by comparing the research performances of Italian universities for the period of the nation's next evaluation exercise (2004-2008): first as measured according to criteria available at the outset of the period and next according to those announced at the end of the period. Akadémiai Kiadó, Budapest, Hungary, 2011 Performance-based research funding nationallicence Research assessment exercises nationallicence Evaluation criteria nationallicence Bibliometrics nationallicence University nationallicence Italy nationallicence Abramo Giovanni National Research Council of Italy, Rome, Italy aut D'Angelo Ciriaco Laboratory for Studies of Research and Technology Transfer, School of Engineering, Department of Management, University of Rome "Tor Vergata”, Via del Politecnico 1, 00133, Rome, Italy aut Di Costa Flavia Laboratory for Studies of Research and Technology Transfer, School of Engineering, Department of Management, University of Rome "Tor Vergata”, Via del Politecnico 1, 00133, Rome, Italy aut Scientometrics Springer Netherlands 88/1(2011-07-01), 229-238 0138-9130 88:1<229 2011 88 11192 https://doi.org/10.1007/s11192-011-0373-2 text/html Onlinezugriff via DOI 1 research-article jats NATIONALLICENCE 856 40 https://doi.org/10.1007/s11192-011-0373-2 text/html Onlinezugriff via DOI NATIONALLICENCE 700 1- Abramo Giovanni National Research Council of Italy, Rome, Italy aut NATIONALLICENCE 700 1- D'Angelo Ciriaco Laboratory for Studies of Research and Technology Transfer, School of Engineering, Department of Management, University of Rome "Tor Vergata”, Via del Politecnico 1, 00133, Rome, Italy aut NATIONALLICENCE 700 1- Di Costa Flavia Laboratory for Studies of Research and Technology Transfer, School of Engineering, Department of Management, University of Rome "Tor Vergata”, Via del Politecnico 1, 00133, Rome, Italy aut NATIONALLICENCE 773 0- Scientometrics Springer Netherlands 88/1(2011-07-01), 229-238 0138-9130 88:1<229 2011 88 11192 Metadata rights reserved Springer special CC-BY-NC licence nationallicence BK010053 XK010053 XK010000 NATIONALLICENCE NATIONALLICENCE NL-springer