Skip to Main Content

RILAS Masterguide

This is a private guide for use by Rilas Op Group members to support and populate guides they create relating to research impact metrics, alternative metrics and related topics.

Research Impact - an introduction

Researchers and academic staff are often asked to demonstrate the impact of their research in applications for academic promotions, grant applications and in many other contexts.  

Citation counts, journal impact factors, and h-index are considered standard tools for measuring the impact of research publications within academia. This is based on an assumption that significant research publications will have higher citation counts.

 

Limitations

  • Research impact measures are not comparable across disciplines.
  • No one database will provide a comprehensive measurement of impact.
  • The results between citation databases are not comparable since their coverage varies.
  • Citation counts alone are not an indication of excellent research. They should be used with other qualitative measures such as esteem.

The selection of the most appropriate metrics and/or the optimum method of presenting those metrics is dependent on the discipline, the purpose, the context, the specific research being evaluated, and so on.  Therefore the library advises that you ensure that you understand fully the requirements of the grant, promotion, etc application.  The following are all resources that you should consult to assist in deciding which metrics are appropriate for the specific purpose, and how to use those metrics to demonstrate research impact and engagement:

 

Support

The Library's Research Impact Library Advisory Service (RILAS) focuses on providing various research evaluation measures, including metrics, to University of Melbourne staff and researchers to support their research grant and academic promotion applications.

The specific metrics that are commonly used vary greatly in each discipline, along with the data sources and tools.  The tabs on the left of this guide will link you to University of Melbourne guides created specifically for your discipline.

 

Further information

The use of metrics to demonstrate research impact or to compare researchers or research publications is a topic that has been debated much in recent years.  The following websites and articles are recommended for further information and discussion:

Research Impact - data sources

There are multiple sources of metrics to demonstrate impact of research outputs.   This guide provides step-by-step instructions and general guidance on a range of sources.  It is important to note that the sources will differ markedly from discipline to discipline.  Find below list of most commonly used sources of citation and bibliometric data: 

Source name Description Access

Scopus (Elsevier)

 

Scopus is an abstract and citation database of peer-reviewed literature: scientific journals, books and conference proceedings. Provides the following metrics using data from its own indexed sources:

  • Citations; H-index
  • Field-weighted citation impact; citation benchmarking
  • PlumX metrics
  • Citescore; SJR; SNIP

U of M licensed resource: 

http://cat.lib.unimelb.edu.au/record=e1000421~S31

SciVal (Elsevier) 

SciVal is used mostly to assess an institution’s research performance from a variety of perspectives, using data from Scopus.  Using Overview module, individual researchers can obtain the following metrics:

  • Citations; H-index; H5-index
  • Field-weighted citation impact;
  • Outputs in Top Citation Percentiles 

  • Publications in Top Journal Percentiles 

  • International and academic collaborations

U of M licensed resource: 

http://cat.lib.unimelb.edu.au/record=e1001547~S31

Web of Science (Clarivate)

Web of Science Core Collection provides access to authoritative, multidisciplinary content in over 12,000 journals worldwide, including Open Access journals and over 150,000 conference proceedings. Includes current and retrospective coverage in the sciences, social sciences, arts, and humanities, with coverage to 1900.

Provides the following metrics using data from its own indexed sources:

  • Citation counts; h-index; 
  • Highly cited in field;
  • Journal Impact Factor; 

U of M licensed resource: 

http://cat.lib.unimelb.edu.au/record=e1000043~S31

InCites (Clarivate)

InCites is an analytical tool built on Web of Science index and data. There are 3 components:

Benchmarking and Analytics: a citation-based evaluation tool that can be used to benchmark output against peers and potential peers in a national or international context. 

Essential Science Indicators: compiles performance statistics and trends.

Journal Citation Reports:  evaluate and compare journals using citation data.

U of M licensed resource: 

 

http://cat.lib.unimelb.edu.au/record=e1001628~S31

 

http://cat.lib.unimelb.edu.au/record=e1001653~S31

 

http://cat.lib.unimelb.edu.au/record=e1001652~S31

 

Google Scholar

Google Scholar searches across many disciplines and sources: peer-reviewed papers, theses, books, abstracts and articles, from academic publishers, professional societies, preprint repositories, universities and other scholarly organizations.

http://cat.lib.unimelb.edu.au/record=e1001106~S31

 

Publish or Perish

Publish or Perish is a software program that retrieves and analyzes academic citations, using a variety of data sources (incl. Google Scholar and Microsoft Academic Search) to obtain the raw citations and then analyzes these.  

 

https://harzing.com/resources/publish-or-perish

Altmetrics Explorer

for Institutions

Altmetric Explorer for Institutions captures hundreds of thousands of tweets, blog posts, news stories, policy documents and other content that mention scholarly articles.

  • Twitter; Facebook; blogs
  • News media
  • Government policy
  • Wikipedia
  • Mendeley
  • Web of Science and Scopus data

U of M licensed resource: 

http://cat.lib.unimelb.edu.au/record=e1001710~S31

 

 

Research Impact - Overview

Citation countsjournal impact factors, and h-index are considered standard tools for measuring the impact of the research. This is based on an assumption that significant research output will have higher citation counts.

Limitations

  • Research impact measures are not comparable across disciplines.
  • No one database will provide a comprehensive measurement of impact.
  • The results between citation databases are not comparable since their coverage varies.
  • Citation counts alone are not an indication of excellent research. They should be used with other qualitative measures such as esteem.

Support

Research impact service

The Library's Research Impact Library Advisory Service (RILAS) focuses on providing various research evaluation measures, including metrics, to University of Melbourne staff and researchers to support their research grant and academic promotion applications.  


Library Twitter

Library Instagram

Library Blogs

Library Contacts