Conceptualising dimensions of bibliometric assessment: From resource allocation systems to evaluative landscapes

Fredrik Åström; Björn Hammarfelt

Conceptualising dimensions of bibliometric assessment: From resource allocation systems to evaluative landscapes

Fredrik Åström, Björn Hammarfelt

University of Borås

Research output: Chapter in Book/Report/Conference proceeding › Paper in conference proceeding › peer-review

192 Downloads (Pure)

Abstract

The purpose of this paper is to discuss the conceptualisation of bibliometric analyses in terms of the levels on which they are performed, adding contextual factors to the dimension where the size of the unit being analysed is considered. Based on empirical investigations of resource allocation systems and research evaluation practices, as well as the previous literature conceptualising bibliometric analyses, a framework based on Whitley’s (2000) notion of research fields as ‘reputational work organisations’, is discussed. The results suggest adding a contextual ‘reputational dimension’ to the size-based dimension distinguishing between micro-, meso- and macro-level analyses. Furthermore, we propose that ‘evaluative landscapes’ (Brandter, 2017) might be a fruitful approach for further analysing how complex and multifaceted landscapes of research assessment affects the individual researcher.

Original language	English
Title of host publication	Proceedings of the 17th Conference of the International Society for Scientometrics and Informetrics
Subtitle of host publication	ISSI 2019 with a Special STI Indicators Conference Track
Editors	Giuseppe Catalano, Cinzia Daraio, Martina Gregori, Henk F. Moed, Giancarlo Ruocco
Publisher	International Society for Scientometrics and Informetrics
Pages	1256-1261
Number of pages	6
ISBN (Print)	978-88-3381-118-5
Publication status	Published - 2019
Event	The 17th Conference of the International Society for Scientometrics and Informetrics: ISSI 2019 - Sapienza University, Rome, Italy Duration: 2019 Sept 2 → 2019 Sept 5 Conference number: 17 https://www.issi2019.org/

Conference

Conference	The 17th Conference of the International Society for Scientometrics and Informetrics
Abbreviated title	ISSI 2019
Country/Territory	Italy
City	Rome
Period	2019/09/02 → 2019/09/05
Internet address	https://www.issi2019.org/

Subject classification (UKÄ)

Information Studies

Access to Document

ISSI_paper 218proceedingFinal published version, 142 KB

Cite this

Åström, F., & Hammarfelt, B. (2019). Conceptualising dimensions of bibliometric assessment: From resource allocation systems to evaluative landscapes. In G. Catalano, C. Daraio, M. Gregori, H. F. Moed, & G. Ruocco (Eds.), Proceedings of the 17th Conference of the International Society for Scientometrics and Informetrics: ISSI 2019 with a Special STI Indicators Conference Track (pp. 1256-1261). International Society for Scientometrics and Informetrics.

Åström, Fredrik ; Hammarfelt, Björn. / Conceptualising dimensions of bibliometric assessment: From resource allocation systems to evaluative landscapes. Proceedings of the 17th Conference of the International Society for Scientometrics and Informetrics: ISSI 2019 with a Special STI Indicators Conference Track. editor / Giuseppe Catalano ; Cinzia Daraio ; Martina Gregori ; Henk F. Moed ; Giancarlo Ruocco. International Society for Scientometrics and Informetrics, 2019. pp. 1256-1261

@inproceedings{d03805d26d5e4cfdae03634eb5b0df97,

title = "Conceptualising dimensions of bibliometric assessment: From resource allocation systems to evaluative landscapes",

abstract = "The purpose of this paper is to discuss the conceptualisation of bibliometric analyses in terms of the levels on which they are performed, adding contextual factors to the dimension where the size of the unit being analysed is considered. Based on empirical investigations of resource allocation systems and research evaluation practices, as well as the previous literature conceptualising bibliometric analyses, a framework based on Whitley{\textquoteright}s (2000) notion of research fields as {\textquoteleft}reputational work organisations{\textquoteright}, is discussed. The results suggest adding a contextual {\textquoteleft}reputational dimension{\textquoteright} to the size-based dimension distinguishing between micro-, meso- and macro-level analyses. Furthermore, we propose that {\textquoteleft}evaluative landscapes{\textquoteright} (Brandter, 2017) might be a fruitful approach for further analysing how complex and multifaceted landscapes of research assessment affects the individual researcher.",

author = "Fredrik {\AA}str{\"o}m and Bj{\"o}rn Hammarfelt",

year = "2019",

language = "English",

isbn = "978-88-3381-118-5",

pages = "1256--1261",

editor = "Giuseppe Catalano and Cinzia Daraio and Martina Gregori and Moed, {Henk F.} and Giancarlo Ruocco",

booktitle = "Proceedings of the 17th Conference of the International Society for Scientometrics and Informetrics",

publisher = "International Society for Scientometrics and Informetrics",

note = "The 17th Conference of the International Society for Scientometrics and Informetrics : ISSI 2019, ISSI 2019 ; Conference date: 02-09-2019 Through 05-09-2019",

url = "https://www.issi2019.org/",

}

Åström, F & Hammarfelt, B 2019, Conceptualising dimensions of bibliometric assessment: From resource allocation systems to evaluative landscapes. in G Catalano, C Daraio, M Gregori, HF Moed & G Ruocco (eds), Proceedings of the 17th Conference of the International Society for Scientometrics and Informetrics: ISSI 2019 with a Special STI Indicators Conference Track. International Society for Scientometrics and Informetrics, pp. 1256-1261, The 17th Conference of the International Society for Scientometrics and Informetrics, Rome, Italy, 2019/09/02.

Conceptualising dimensions of bibliometric assessment: From resource allocation systems to evaluative landscapes. / Åström, Fredrik; Hammarfelt, Björn.
Proceedings of the 17th Conference of the International Society for Scientometrics and Informetrics: ISSI 2019 with a Special STI Indicators Conference Track. ed. / Giuseppe Catalano; Cinzia Daraio; Martina Gregori; Henk F. Moed; Giancarlo Ruocco. International Society for Scientometrics and Informetrics, 2019. p. 1256-1261.

Research output: Chapter in Book/Report/Conference proceeding › Paper in conference proceeding › peer-review

TY - GEN

T1 - Conceptualising dimensions of bibliometric assessment: From resource allocation systems to evaluative landscapes

AU - Åström, Fredrik

AU - Hammarfelt, Björn

N1 - Conference code: 17

PY - 2019

Y1 - 2019

N2 - The purpose of this paper is to discuss the conceptualisation of bibliometric analyses in terms of the levels on which they are performed, adding contextual factors to the dimension where the size of the unit being analysed is considered. Based on empirical investigations of resource allocation systems and research evaluation practices, as well as the previous literature conceptualising bibliometric analyses, a framework based on Whitley’s (2000) notion of research fields as ‘reputational work organisations’, is discussed. The results suggest adding a contextual ‘reputational dimension’ to the size-based dimension distinguishing between micro-, meso- and macro-level analyses. Furthermore, we propose that ‘evaluative landscapes’ (Brandter, 2017) might be a fruitful approach for further analysing how complex and multifaceted landscapes of research assessment affects the individual researcher.

AB - The purpose of this paper is to discuss the conceptualisation of bibliometric analyses in terms of the levels on which they are performed, adding contextual factors to the dimension where the size of the unit being analysed is considered. Based on empirical investigations of resource allocation systems and research evaluation practices, as well as the previous literature conceptualising bibliometric analyses, a framework based on Whitley’s (2000) notion of research fields as ‘reputational work organisations’, is discussed. The results suggest adding a contextual ‘reputational dimension’ to the size-based dimension distinguishing between micro-, meso- and macro-level analyses. Furthermore, we propose that ‘evaluative landscapes’ (Brandter, 2017) might be a fruitful approach for further analysing how complex and multifaceted landscapes of research assessment affects the individual researcher.

UR - http://issi-society.org/proceedings/issi_2019/ISSI%202019%20-%20Proceedings%20VOLUME%20I.pdf

M3 - Paper in conference proceeding

SN - 978-88-3381-118-5

SP - 1256

EP - 1261

BT - Proceedings of the 17th Conference of the International Society for Scientometrics and Informetrics

A2 - Catalano, Giuseppe

A2 - Daraio, Cinzia

A2 - Gregori, Martina

A2 - Moed, Henk F.

A2 - Ruocco, Giancarlo

PB - International Society for Scientometrics and Informetrics

T2 - The 17th Conference of the International Society for Scientometrics and Informetrics

Y2 - 2 September 2019 through 5 September 2019

ER -

Åström F, Hammarfelt B. Conceptualising dimensions of bibliometric assessment: From resource allocation systems to evaluative landscapes. In Catalano G, Daraio C, Gregori M, Moed HF, Ruocco G, editors, Proceedings of the 17th Conference of the International Society for Scientometrics and Informetrics: ISSI 2019 with a Special STI Indicators Conference Track. International Society for Scientometrics and Informetrics. 2019. p. 1256-1261

Conceptualising dimensions of bibliometric assessment: From resource allocation systems to evaluative landscapes

Abstract

Conference

Subject classification (UKÄ)

Access to Document

Other files and links

Fingerprint

"Forskningen granskad": Användningen av prestationsindikatorer för att mäta akademisk forskning, praktiker och effekter

Cite this

Conceptualising dimensions of bibliometric assessment: From resource allocation systems to evaluative landscapes

Abstract

Conference

Subject classification (UKÄ)

Access to Document

Other files and links

Fingerprint

Projects

"Forskningen granskad": Användningen av prestationsindikatorer för att mäta akademisk forskning, praktiker och effekter

Cite this