Scholarly communication development as a modernization basis for the research performance assessment and evaluation

Publication Type:

Language:

Transliteration of original Title: 
Razvitie nauchnykh kommunikatsii kak uslovie modernizatsii otsenki nauchnoi rezul'tativnosti
Author(s): 
Mikhail Kogalovsky
Market Economy Institute, Russian Academy of Sciences
Ivan Nevolin
Central Economics and Mathematics Institute, Russian Academy of Sciences
Sergei Parinov
Central Economics and Mathematics Institute, Russian Academy of Sciences
Issue number: 
No.1 (Vol.51)
Pages: 
188-205
Abstract: 

The information technology development significantly influences on the scholarly communication system by means of transformation. Such processes open new opportunities for improvements of the research performance assessment. The first part of the article characterizes the approaches and methods of research performance assessment, adopted in Russia and some European countries to evaluate individual scientists and research teams. The common features and shortcomings are under discussion, while the most notable among them are the following: inability to track the citation motivation, inability to address to the competitiveness of the every individual scientist and the progress of current research. However, we conclude that the modern research information systems with new approaches to research performance indicators calculation and its visualization become a platform for the scholarly communication improvement. They help in preventing research duplication, finding opportunities for research collaboration, etc. The role of such systems, therefore, is dual – first, they provide current monitoring of research activities and, second, suggest transformation path. This transformation, in turn, provides opportunities for improvement of the research performance assessment. The article’s second section analyzes new trends and prospects of the research environment development and scientific communication. We demonstrate how these trends can contribute to the creation of the fundamentally new tools for the research performance assessment. The third section discusses the Russian research information system Socionet, as a particular example of new technological environment for scholarly communication. The transformative impact and the potential of this system, as well as the created new opportunities for the research performance assessment - are all under discussion.

 

Keywords: 
research performance assessment and evaluation, scholarly communication technology, research information system Socionet
References: 

Arutyunov A., Balashov M., Karasev R., Tereshin D. MFTI: voprosy bez otvetov [MPhTI: questions without answers]. In: Troitskii variant, 2015, no.24 (193), p.5. (In Russian)

Eisen, M., Vosshall, L.B. Coupling Pre-Prints and Post-Publication Peer Review for Fast, Cheap, Fair, and Effective Science Publishing, January 21, 2016. [http://www.michaeleisen.org/blog/?p=1820, accessed on 27.03.2016].

Enhancing Public Research Performance through Evaluation, Impact Assessment and Priority Setting. In: OECD Working Party on Innovation and Technology Policy, 2009.  [https://wbc-rti.info/object/document/7862, accessed on 06.03.2016].  

Georgiev G. Chto gubit rossiiskuyu nauku i kak s etim borot'sya. Chast' II [What destroys Russian science and how to oppose this? Part 2]. In: Troitskii variant, 2015, no. 25 (194), pp. 6-7. (In Russian)

Kogalovsky M.R., Parinov S.I. Scholarly Communication in a Semantically Enrichable Research Information System with Embedded Taxonomy of Scientific Relationships. Research Information System with Embedded Taxonomy of Scientific Relationships. In: P. Klinov and D. Mouromtsev (eds.). Knowledge Engineering and Semantic Web. 6th Intern. Conf. KESW 2015. Moscow, Russia, September 30 – October 2, 2015. The Communications in Computer and Information Science series, vol. 518. Berlin, Heidelberg:Springer, 2015, pp. 87-101.

Kogalovsky M.R., Parinov S.I. Taksonomia semanticheskih svyazey informazionnyh ob’ectov kontenta naychnoi elektronnoi biblioteki [Taxonomy of semantic linkages of information objects of a scientific digital library]. In: NTI. Seria 2. Inforamzionnye processi sistemy, 2015, no. 9, pp. 15-23. (In Russian)

Measuring scientific performance for improved policy making (Case studies). Technopolis, May 31, 2013. [https://www.snowballmetrics.com/wp-content/uploads/IPOL-JOIN_ET2014527383_EN.pdf,  accessed on 08.07.2016].

Neylon C. The future of research communication is aggregation. In: Science in the Open Blog, April 10, 2010. [http://cameronneylon.net/blog/the-future-of-research-communication-is-aggregation/, accessed on 24.03.2016].

Neylon C. What would scholarly communications look like if we invented it today? In:  Science in the Open Blog, September 2, 2010. [http://cameronneylon.net/blog/what-would-scholarly-communications-look-like-if-we-invented-it-today/, accessed on 25.03.2016]

Parinov S. Towards a Semantic Segment of a Research e-Infrastructure: necessary information objects, tools and services. In: J. M. Dodero, M. Palomo-Duarte, P. Karampiperis.(eds.). Metadata and Semantics Research, Communications in Computer and Information Science, 2012, vol. 343. Berlin, Heidelberg: Springer. pp. 133-145.

Parinov S., Lyapunov V., Puzyrev R., Kogalovsky M. Semantically Enrichable Research Information System SocioNet. In: P. Klinov and D. Mouromtsev (eds.). Knowledge Engineering and Semantic Web. 6th Intern. Conf. KESW 2015. Moscow, Russia, September 30 – October 2, 2015. The Communications in Computer and Information Science series, vol. 518. Berlin, Heidelberg: Springer, 2015, pp. 147-157. (In Russian)

Parinov S.I., Lypunov V.M., Puzyrev R.L. Sistema Socionet kak platforma dlya razrabotky nauchnyh informazionnyh resursov i onlinovyh servisov [Socionet research information system as a platform for development of information resources and online services]. In: Electronnye biblioteki, 2003, vol. 6, issue 1. [http://www.elbib.ru/index.phtml?page=elbib/rus/journal /2003/part1/PLP, accessed on 10.05.2016]

Waard A, Kircz J. Modeling Scientific Research Articles – Shifting Perspectives and Persistent Issues. In: Proc. of ELPUB 2008 Conf. on Electronic Publishing. Toronto, Canada, June 2008.  [http://elpub.scix.net/data/works/att/234_ elpub2008.content.pdf, accessed on 05.03.2016] 

Wilsdon J. The Metric Tide: Report of the Independent Review of the Role of Metrics in Research Assessment and Management.  2015. [http://www.hefce.ac.uk/pubs/rereports/Year/2015/metrictide/Title,104463,en.html, accessed on 05.07.2016].

Zhurman O., Petrov V. Neeffektivnye VUZy k 2016 godu budut zakryty [Ineffective universities will be closed in 2016]. In: Rossiiskaya gazeta: Nedelya, 2015, no. 6720 (149). (In Russian)

DOI: 
10.5840/eps201751118