Elsevier

World Neurosurgery

Volume 130, October 2019, Pages e82-e89
World Neurosurgery

Original Article
Predictors of Citations in Neurosurgical Research

https://doi.org/10.1016/j.wneu.2019.05.226Get rights and content

Objective

The number of citations an article receives is an important measure of impact for published research. There are limited published data on predictors of citations in neurosurgery research. We aimed to analyze predictors of citations for neurosurgical articles.

Methods

All articles published in 14 neurosurgical journals in the year 2015 were examined and data collected about their features. The number of citations for each article was tallied using both Web of Science (WoS) and Google Scholar (GS) 2.5 years after their publication in print. Negative binomial regression was then performed to determine the relationship between article features and citation counts for scientific articles.

Results

A total of 3923 articles were analyzed, comprising 2867 scientific articles (72.6%) and 1056 nonscientific (editorial, commentary, etc.) articles (27.4%). At 2.5 years, scientific articles had a median [interquartile range] number of citations per article of 3.0 [6.0] and 7.0 [9.0] found in WoS and GS, respectively; nonscientific articles had accumulated median 0.0 [2.0] in both WOS and GS. Articles with the study topic “Spine” had the highest citation count at 4.0 [5.0] and 8.0 [10.0] in WoS and GS, respectively. Significant predictors of citation count in scientific articles were level of evidence, number of centers, number of authors, and impact factor.

Conclusions

This is the largest investigation analyzing predictors of citations in the neurosurgical literature. Factors found to be most influential on citation rates in scientific articles included the study's level of evidence, number of participating centers, number of authors, and the publishing journal's impact factor.

Introduction

In recent years there has been an increase in the volume of research, along with multiple efforts to quantify the productivity of researchers and the influence of study results. One long-standing measure of research impact is the journal impact factor, which is calculated based on the number of citations received by an article published in a given journal. Though somewhat controversial for the ways in which this calculation can be skewed, the impact factor is a well-recognized measure of the significance of scientific research. Given the limitations of this one calculation, however, the field of bibliometrics has emerged with many measures and indices developed to analyze research productivity and quality.1 The number of citations an article receives, also referred to as the citation rate, is arguably the most important measure of impact for published research. The citation rate has important bibliometric implications not only for the article itself, but also for that of the authors, the institutions, and the journal.

Researchers have previously investigated features that may predict citation rates in published medical research in many specialties including cardiovascular, emergency medicine, plastic surgery, orthopedic surgery, transplant, and urology.2, 3, 4, 5, 6, 7, 8, 9, 10 In the field of neurosurgery, however, there has yet to be any rigorous published analysis evaluating predictors of citations within neurosurgical publications or the effect of article study design, subject, level of evidence (LOE), or collaboration in obtaining future citations. With the expanding emphasis on bibliometrics, journal impact factor, and research productivity within academic neurosurgery, it is important to establish factors that may influence research impact within our specialty. We therefore sought to examine characteristics of neurosurgical articles, and identify predictive factors for future citations using a previously established database of nearly 4000 neurosurgical publications.

Section snippets

Methods

All articles published in print between January 2015 and December 2015 in 14 English-language neurosurgical journals were reviewed as part of a prior pilot study to capture the LOE and international collaboration present within published neurosurgical literature. Detailed methodology regarding the data collection methods and results can be found elsewhere.11 In brief, data were collected regarding authorship, number of contributing centers, study design, study subject, and LOE for all

Results

A total of 3981 articles were published in the 14 journals in 2015 and were initially reviewed. There were 22 scientific articles and 36 editorial articles with either missing data or that were not traceable in either WoS or GS and were excluded from further analysis. Thus, a total of 3923 articles were analyzed comprising 2867 scientific articles (72.6%) and 1056 editorial articles (27.4%). Descriptive statistics for the articles and citations are shown in Table 1. LOE, study design,

Discussion

The present study is the largest and most comprehensive review of neurosurgical literature citation rates, with nearly 4000 published articles reviewed across 14 journals, and 2.5 years' worth of citation data collected for each article from 2 independent citation search engines. This analysis demonstrates that certain tangible factors are highly predictive of citation rate and include higher levels of evidence, institutional and international collaboration, and publication in a journal with a

Conclusions

This is the largest and most in-depth investigation analyzing predictors of citations for neurosurgical published literature. Factors found to be most influential on citation rates included the study's level of evidence, number of participating centers, number of authors, and the publishing journal's impact factor.

References (23)

  • M. Callaham et al.

    Journal prestige, publication bias, and other characteristics associated with citation of published studies in peer-reviewed journals

    JAMA

    (2002)
  • Cited by (15)

    • An explainable artificial-intelligence-based approach to investigating factors that influence the citation of papers

      2022, Technological Forecasting and Social Change
      Citation Excerpt :

      They examined 19 features of the papers and found that the journal impact factor, journal rank, journal subject quartile, first and corresponding authors' h-index, number of documents produced by the first and corresponding authors, SCImago Journal Rank, and source normalized impact per paper had significant correlations with the citation group. Oravec et al. (2019) collected 3923 papers in 14 neurosurgical journals in 2015 and applied regression analysis to uncover influential factors. They found significant influences in the level of evidence, number of affiliations, number of authors, and impact factor.

    • Copublication improved the dissemination of Cochrane reviews and benefited copublishing journals: a retrospective cohort study

      2022, Journal of Clinical Epidemiology
      Citation Excerpt :

      Fourth, although some studies have found that meta-analyses have higher rates of citation than other articles, which might make it more likely that copublishing a version of Cochrane containing meta-analyses would have more impact on a journal's IF than copublishing any other type of article; other studies have argued that study design does not significantly influence citation rate [18,33]. For example, there may also be important associations with the number of authors [34–36] or their geographic location [37]. These issues should be investigated in further research.

    • Predictors of Citations in Neurosurgical Research: A 5-Year Follow-Up

      2021, World Neurosurgery
      Citation Excerpt :

      2.5 years after publication, level of evidence (LOE), number of participating centers, number of authors, and the impact factor of the journal were most influential on citation rates of scientific articles in Web of Science (WoS) and Google Scholar (GS).3 As a continuation of the findings of Oravec et al.,3 this study seeks to explore the predictors of citation rates of nearly 3000 neurosurgical scientific publications in 13 journals 5 years after being published in print. All scientific articles published in print from January 2015 to December 2015 in 13 English-language neurosurgical journals were included in this review.

    View all citing articles on Scopus

    Conflict of interest statement: The authors declare that the article content was composed in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.

    View full text