Article-Level Metrics

다국어 초록 (Multilingual Abstract)

In the era of digitization and Open Access, article-level metrics are increasingly employed to distinguish influential research works and adjust research management strategies. Tagging individual articles with digital object identifiers allows exposing them to numerous channels of scholarly communication and quantifying related activities. The aim of this article was to overview currently available article-level metrics and highlight their advantages and limitations. Article views and downloads, citations, and social media metrics are increasingly employed by publishers to move away from the dominance and inappropriate use of journal metrics. Quantitative article metrics are complementary to one another and often require qualitative expert evaluations. Expert evaluations may help to avoid manipulations with indiscriminate social media activities that artificially boost altmetrics. Values of article metrics should be interpreted in view of confounders such as patterns of citation and social media activities across countries and academic disciplines.

참고문헌 (Reference)

1 Eldakar MAM, "Who reads international Egyptian academic articles? An altmetrics analysis of Mendeley readership categories" 121 (121): 105-135, 2019

2 Tahamtan I, "What do citation counts measure? An updated review of studies on citations in scientific documents published between 2006 and 2018" 121 (121): 1635-1684, 2019

3 Hammarfelt B, "Using altmetrics for assessing research impact in the humanities" 101 (101): 1419-1430, 2014

4 Chen B, "Usage pattern comparison of the same scholarly articles between Web of Science(WoS)and Springer" 115 (115): 519-537, 2018

5 Ravikumar SS, "Tweets of an article and its citation : an altmetric study of most prolific authors" 1745-, 2018

6 Haustein S, "Tweeting biomedicine : an analysis of tweets and citations in the biomedical literature" 65 (65): 656-669, 2014

7 Wang X, "Tracking the digital footprints to scholarly articles from social media" 109 (109): 1365-1376, 2016

8 Alshareef AM, "Toward citation recommender systems considering the article impact in the extended nearby citation network" 12 (12): 1336-1345, 2018

9 Azer SA, "Top-cited articles in medical professionalism : a bibliometric analysis versus altmetric scores" 9 (9): e029433-, 2019

10 Powell AJ, "Three decades of citation classics : the most cited articles in the field of physical medicine and rehabilitation" 6 (6): 828-840, 2014

11 Asyyed Z, "The use of Twitter by plastic surgery journals" 143 (143): 1092e-1098e, 2019

12 Moliterno DJ, "The top papers of 2017 : by subsequent citations and online views and downloads" 11 (11): 325-327, 2018

13 Yan KK, "The spread of scientific information : insights from the web usage statistics in PLoS article-level metrics" 6 (6): e19917-, 2011

14 Lopez M, "The social media editor at medical journals : responsibilities, goals, barriers, and facilitators" 94 (94): 701-707, 2019

15 McGillivray B, "The relationship between usage and citations in an open access mega-journal" 121 (121): 817-838, 2019

16 Naik G, "The quiet rise of the NIH's hot new metric" 539 (539): 150-, 2016

17 Ortega JL, "The presence of academic journals on Twitter and its relationship with dissemination(tweets)and research impact(citations)" 69 (69): 674-687, 2017

18 Park P, "The paradox of active users" 2 (2): 1-4, 2015

19 Butler JS, "The evolution of current research impact metrics: from bibliometrics to altmetrics?" 30 (30): 226-228, 2017

20 Du J, "The effects of research level and article type on the differences between citation metrics and F1000 recommendations" 67 (67): 3008-3021, 2016

21 Trueger NS, "The altmetric score : a new measure for article-level dissemination and impact" 66 (66): 549-553, 2015

22 Khan MS, "The Kardashian index of cardiologists. celebrities or experts?" 2 (2): 330-332, 2020

23 Zimba O, "Social media for research, education and practice in rheumatology" 40 (40): 183-190, 2020

24 Ahmed S, "Social media for medical journals" 1 (1): 26-32, 2020

25 Wang X, "Social media attention increases article visits : An investigation on articlelevel referral data of PeerJ" 2 : 11-, 2017

26 Ortega JL, "Reliability and accuracy of altmetric providers : a comparison among Altmetric. com, PlumX and Event Data" 116 (116): 2123-2138, 2018

27 Bornmann L, "Relative citation ratio(RCR) : an empirical attempt to study a new fieldnormalized bibliometric indicator" 68 (68): 1064-1067, 2017

28 Hutchins BI, "Relative citation ratio(RCR) : a new metric that uses citation rates to measure influence at the article level" 14 (14): e1002541-, 2016

29 Singson M, "Relationship between electronic journal downloads and citations in library consortia" 65 (65): 429-444, 2016

30 Neff M, "Quest for publication metrics undermines regional research" 554 (554): 169-, 2018

31 Davis PM, "Public accessibility of biomedical articles from Central reduces journal readership--retrospective cohort analysis" 27 (27): 2536-2541, 2013

32 Armen Yuri Gasparyan, "Preserving the Integrity of Citations and References by All Stakeholders of Science Communication" 대한의학회 30 (30): 1545-1552, 2015

33 Lindsay JM, "PlumX from plum analytics : not just altmetrics" 13 (13): 8-17, 2016

34 Dunaiski M, "On the interplay between normalisation, bias, and performance of paper impact metrics" 13 (13): 270-290, 2019

35 Didegah F, "On the differences between citations and altmetrics : an investigation of factors driving altmetrics versus citations for finnish articles" 69 (69): 832-843, 2018

36 Haunschild R, "Normalization of Mendeley reader counts for impact assessment" 10 (10): 62-73, 2016

37 Bornmann L, "Normalisation of citation impact in economics" 120 (120): 841-884, 2019

38 Kochanek PM, "New developments for pediatric critical care medicine in 2019and beyond" 20 (20): 311-, 2019

39 Gates AJ, "Nature's reach : narrow work has broad impact" 575 (575): 32-34, 2019

40 Waltman L, "NIH's new citation metric: a step forward in quantifying scientific impact?"

41 Armen Yuri Gasparyan, "Multidisciplinary Bibliographic Databases" 대한의학회 28 (28): 1270-1275, 2013

42 Citrome L, "Moving forward with article level metrics : introducing altmetrics" 69 (69): 811-, 2015

43 Zahedi Z, "Mendeley readership as a filtering tool to identify highly cited publications" 68 (68): 2511-2521, 2017

44 Dardas LA, "Measuring the social impact of nursing research : an insight into altmetrics" 75 (75): 1394-1405, 2019

45 Knowlton SE, "Measuring the impact of research using conventional and alternative metrics" 98 (98): 331-338, 2019

46 Murphy LS, "Measuring scholarly productivity : a primer for junior faculty. Part III : understanding publication metrics" 19 (19): 1003-1011, 2018

47 Chavda J, "Measuring research impact : bibliometrics, social media, altmetrics, and the BJGP" 66 (66): e59-e61, 2016

48 Fang Z, "Measuring global research activities using geographic data of scholarly article visits" 35 (35): 822-838, 2017

49 Jamison AM, "Malicious actors on twitter : a guide for public health researchers" 109 (109): 688-692, 2019

50 Chandrashekhar Y, "Journal editors and altmetrics : moth to the flame" 12 (12): 1899-1902, 2019

51 Salahshoori F, "Investigating the social media presence of articles in altmetrics field indexed in Scopus database : an altmetrics study" 2779-, 2019

52 Vaughan L, "Investigating disciplinary differences in the relationships between citations and downloads" 111 (111): 1533-1545, 2017

53 Tregoning J, "How will you judge me if not by impact factor?" 558 (558): 345-, 2018

54 Zahedi Z, "How well developed are altmetrics? A cross-disciplinary analysis of the presence of ‘alternative metrics’ in scientific publications" 101 (101): 1491-1513, 2014

55 Bornmann L, "How to normalize Twitter counts? A first attempt based on journals in the Twitter index" 107 (107): 1405-1422, 2016

56 Erfanmanesh M, "Highly-alted articles in library and information science" 14 (14): 66-77, 2017

57 Vardell E, "F1000Prime : a faculty of 1000 tool" 33 (33): 75-84, 2014

58 Ahlgren P, "Exploring the relation between referencing practices and citation impact : a large-scale study based on Web of Science data" 69 (69): 728-743, 2018

59 Akers KG, "Electronic resources reviews : F1000prime : expert recommendations of journal articles in biology and medicine" 90 : 2018

60 Kohn K, "Effects of Publisher Interface and Google Scholar on HTML and PDF Clicks: Investigating Paths That Inflate Usage" 44 (44): 816-823, 2018

61 Duan Y, "Download patterns of journal papers and their influencing factors" 112 (112): 1761-1775, 2017

62 Lazarev VS, "Don't dismiss citations to journals not published in English" 556 (556): 174-, 2018

63 Fenton JE, "Do citation classics in rhinology reflect utility rather than quality" 43 (43): 221-224, 2005

64 Bornmann L, "Do altmetrics correlate with the quality of papers? A large-scale empirical study based on F1000Prime data" 13 (13): e0197133-, 2018

65 Meschede C, "Cross-metric compatability and inconsistencies of altmetrics" 115 (115): 283-297, 2018

66 Haustein S, "Coverage and adoption of altmetrics sources in the bibliometric community" 101 (101): 1145-1163, 2014

67 Armen Yuri Gasparyan, "Comprehensive Approach to Open Access Publishing: Platforms and Tools" 대한의학회 34 (34): 1-17, 2019

68 Purkayastha A, "Comparison of two article-level, field-independent citation metrics : field-weighted citation impact(FWCI)and relative citation ratio(RCR)" 13 (13): 635-642, 2019

69 Amath A, "Comparing alternative and traditional dissemination metrics in medical education" 51 (51): 935-941, 2017

70 Bornmann L, "Citation score normalized by cited references(CSNCR) : the introduction of a new citation impact indicator" 10 (10): 875-887, 2016

71 Haustein S, "Characterizing social media metrics of scholarly papers : the effect of document properties and collaboration patterns" 10 (10): e0120495-, 2015

72 Hatch A, "Changing how we evaluate research is difficult, but not impossible" 9 : e58654-, 2020

73 Pineda C, "Challenges for social media editors in rheumatology journals : an outlook" 38 (38): 1785-1789, 2019

74 Ortega JL, "Blogs and news sources coverage in altmetrics data providers : a comparative analysis by country, language, and subject" 122 (122): 555-572, 2020

75 Hicks D, "Bibliometrics : the Leiden Manifesto for research metrics" 520 (520): 429-431, 2015

76 Maggio LA, "Beyond citation rates : a real-time impact analysis of health professions education research using altmetrics" 92 (92): 1449-1455, 2017

77 Gorraiz J, "Availability of digital object identifiers(DOIs)in Web of Science and Scopus" 10 (10): 98-109, 2016

78 Boudry C, "Availability of digital object identifiers in publications archived by" 110 (110): 1453-1469, 2017

79 Bohl MA, "Assessing the relevancy of"citation classics"in neurosurgery. Part II : foundational papers in neurosurgery" 104 : 939-966, 2017

80 Ortega JL, "Altmetrics data providers : a meta-analysis review of the coverage of metrics and publication" 29 (29): e290107-, 2020

81 Bornmann L, "Alternative article-level metrics : the use of alternative metrics in research evaluation" 19 (19): e47260-, 2018

82 Dharnidharka VR, "A social media editor for pediatric transplantation" 23 (23): e13343-, 2019

83 Pooladian A, "A longitudinal study of the bookmarking of library and information science literature in Mendeley" 10 (10): 1135-1142, 2016

84 Pagoto S, "A call for a public health agenda for social media research" 21 (21): e16661-, 2019