Towards Semantometrics: A New Semantic Similarity Based Measure for Assessing a Research Publication's Contribution

,

D-Lib Magazine, 20(11/12) (2014) .


Abstract

We propose Semantometrics, a new class of metrics for evaluating research. As opposed to existing Bibliometrics, Webometrics, Altmetrics, etc., Semantometrics are not based on measuring the number of interactions in the scholarly communication network, but build on the premise that full-text is needed to assess the value of a publication. This paper presents the first Semantometric measure, which estimates the research contribution. We measure semantic similarity of publications connected in a citation network and use a simple formula to assess their contribution. We carry out a pilot study in which we test our approach on a small dataset and discuss the challenges in carrying out the analysis on existing citation datasets. The results suggest that semantic similarity measures can be utilised to provide meaningful information about the contribution of research papers that is not captured by traditional impact measures based purely on citations.



Add your rating and review

If all scientific publications that you have read were ranked according to their scientific quality and importance from 0% (worst) to 100% (best), where would you place this publication? Please rate by selecting a range.


0% - 100%

This publication ranks between % and % of publications that I have read in terms of scientific quality and importance.


Keep my rating and review anonymous
Show publicly that I gave the rating and I wrote the review


Ratings & reviews

  • Towards Semantometrics: A New Semantic Similarity Based Measure for Assessing a Research Publication's Contribution
    100 90 0
100 90 0 1 1

Comments

  • I suggest that when assessing semantometric measures, and comparing them to bibliometric measures, they should use as a reference peer-provided ratings (Florian, 2015), because such measures should validated against what it is that they purport to measure and predict, which is expert evaluation by peers (Harnad, 2008).

    References:

    • Florian, R. V. (2015). A new scale for rating scientific publications. In Proceedings of ISSI 2015: 15th International Society of Scientometrics and Informetrics Conference (p. 419-420). Istanbul, Turkey: Boğaziçi University.
  • 1

Notice: Undefined index: publicationsCaching in /www/html/epistemio/application/controllers/PublicationController.php on line 2240