Skip to main content

Self-citation policies and journal self-citation rate among Critical Care Medicine journals

Abstract

Background

Inappropriate authors’ self-citation (A-SC) is a growing mal-practice possibly boosted by the raising importance given to author’s metrics. Similarly, also excessive journals’ self-citation (J-SC) practice may factitiously influence journal’s metrics (impact factor, IF). Evaluating the appropriateness of each self-citation remains challenging.

Main body

We evaluated the presence of policies discouraging A-SC in Critical Care Medicine (CCM) journals with IF. We also calculated the J-SC rate of these journals. In order to evaluate if J-SC rates are influenced by the focus of interest of CCM journals, we separated them in three sub-categories (“multidisciplinary”, “broad” or “topic-specific” CCM journals).

We analyzed 35 CCM journals and only 5 (14.3%) discouraged excessive and inappropriate A-SC. The median IF was higher in CCM journals with A-SC policies [4.1 (3–12)] as compared to those without [2.5 (2–3.5); p = 0.02]. The J-SC rate was highly variable (0–35.4%), and not influenced by the presence of A-SC policies (p = 0.32). However, J-SC rate was different according to the focus of interest (p = 0.01): in particular, it was higher in “topic-specific” CCM journals [15.3 (8.8–23.3%)], followed by “broad” CCM [11.8 (4.8–17.9%)] and “multidisciplinary” journals [6.1 (3.6–9.1%)].

Conclusions

A limited number of CCM journals have policies for limiting A-SC, and these have higher IF. The J-SC rate among CCM journals is highly variable and higher in “topic-specific” interest CCM journals. Excluding self-referencing practice from scientific metrics calculation could be valuable to tackle this scientific malpractice.

Background

Inappropriate authors’ self-promoting is a growing mal-practice [1], possibly prompted by the mounting scientific importance of author’s metrics. We recently surveyed the submission guidelines of Anaesthesiology journals for the presence of policies discouraging author self-citations (A-SC) [2]. In parallel, we also evaluated the journals’ self-citation (J-SC) practice, which may hinder attempts of the Editorial Board to increase the journal impact factor (IF).

Although excessive and inappropriate A-SC and J-SC are two independent forms of suboptimal academic practice that have not yet received enough attention, it must be clear from the beginning that not all A-SC and J-SC are synonymous of malpractice.

In the present study, we evaluated the J-SC rate among the Critical Care Medicine (CCM) journals and possible factors influencing it, as well as the presence of policies regarding A-SC in these journals.

Methods

On the 30 October 2020, we evaluated the presence of policies discouraging A-SC in the submission guidelines of CCM journals selected from the InCites Journal Citation Reports 2019 (Clarivate Analytics®) [3]. The J-SC rate was evaluated according to the following formula:

$$ \mathrm{JSC}\ \mathrm{rate}=\frac{\mathrm{IF}-\mathrm{IF}\ \mathrm{without}\ \mathrm{self}\ \mathrm{citations}}{\mathrm{IF}} $$

Our previous investigation suggested that journals focusing on a specific topic of the discipline had a trend towards higher J-SC rate (25% vs 7% as compared to those with broad interest; p = 0.06) [2]. Accordingly, we performed a secondary analysis separating CCM journals in three sub-categories: (1) “multidisciplinary journals” (defined as journals focusing not only on CCM but also on other disciplines as Anaesthesiology, Respiratory Medicine, etc.); (2) “broad interest” CCM journals (defined as those publishing on several aspects of the discipline); (3) “topic-specific” CCM journals (focusing on specific topics of CCM interest). We evaluated also if J-SC is influenced by presence of A-SC policies.

Continuous variables are presented as median (25th–75th percentile), categorical variables as numbers/percentage. Mann-Whitney U test or Kruskal-Wallis test for unrelated samples were performed according to the number of groups. Tests were two-sided; p < 0.05 was considered statistically significant.

Results

A total of 36 CCM journals were found but we removed Human Gene Therapy Clinical Development as its scope clearly falls outside the CCM. Therefore, 35 journals were included. In Table 1, we report J-SC rates and presence of policies regarding A-SC. Five journals (14.3%) discouraged “excessive and inappropriate” self-citations; none proposed an A-SC cut-off. The median IF of CCM journals was 2.7 (2.1–3.8) and was higher in CCM journals with policies on A-SC[4.1 (3–12)] as compared to those without [2.5 (2–3.5); p = 0.02].

Table 1 List of Critical Care Medicine journals according to their rank in Journal Citation Report 2019. For each journal we provide the following: Journal Rank and Full Title, Impact Factor (IF) and IF without self-citation (SC), Journal Self-Citation Rate (J-SC, year 2019), Publisher name, presence and description of policies on limiting SC. Each Journal’s name contains a hyperlink to its “instruction to authors/submission guidelines” so that readers may check them

The J-SC rate was highly variable (0–35.4%) with median 8.8% (5.1–17.4%) and was not different between journals with or without A-SC policies [8.1% (5.1–9.5%) vs 9.4% (5–18.7%), respectively; p = 0.32].

CCM journals were sub-categorized as follows: 11 were considered “multidisciplinary” (Table 1: rank 1-3-4-11-18-20-27-28-29-34-35), 14 were classified as “broad interest” (rank 2-5-6-8-9-12-13-15-19-21-22-23-25-31), and 10 were “topic-specific” CCM journals (rank 7-10-14-16-17-24-26-30-32-33). We found significantly different J-SC rate according to the journal interest (p = 0.01), with higher values in “topic-specific” [15.3 (8.8–23.3%)] followed by “broad interest” [11.8 (4.8–17.9%)] and “multidisciplinary” journals [6.1 (3.6–9.1%)]. Conversely, the IF was not different between journals according to sub-categories (p = 0.35): “topic-specific” [2.4 (1.4–3.2)], “broad interest” [2.5 (1.5–8.3)] and “multidisciplinary” journals [3.0 (2.3–4.7)]. The J-SC rate was not significantly influenced by the presence of policies on A-SC (8.1% [5.1–9.5%]) or not (9.4% [5–18.7%]; p = 0.32).

Discussion

Our investigations follows a similar assessment conducted in Anaesthesiology journals [2] and found lower prevalence of A-SC policies among CCM journals as compared to Anaesthesiology ones (14% vs 22%). This finding reinforces our belief that the argument of limiting the malpractice of inappropriate self-referencing is still at embryonic level. Several forms of research misconduct (fabrication, falsification, plagiarism, ghost-writing) have been recognized [4, 5], but “inappropriate self-citation” and “citation farms” have not yet received widespread editorial attention. In our opinion, it is urgent to embrace a debate on the best approach for limiting inappropriate self-referencing, keeping in mind that it remains challenging to define the appropriateness of each A-SC [6] and that a single cut-off is unlikely to fit all the manuscript types. Interestingly, we found a significantly higher IF in CCM journal with policies on A-SC, and this may be a marker of higher publishing standards. Such finding is new, as we did not report differences in IF among Anaesthesiology journals according to presence of A-SC policies [2]. This result may support larger investigations, as the findings of single disciplines are likely influenced by a reduced sample size investigated.

The J-SC rate and its variability were similar between CCM (8.8%, range 0–35.4%) and Anaesthesiology journals (8.4%, range 1.4–37.2%), and J-SC rate was not different according to the presence of A-SC policies.

Several factors may influence J-SC rate. Although it is possible that an excessive J-SC rate may sometimes hinder a sort of editorial malpractice (requests to reference specific articles with the aim to boost IF) [7], this is difficult to assess. Conversely, it must be noted that J-SC rate is also increased by editorials and commentaries introducing the highlights of important articles published by the journal. Therefore, the interpretation of J-SC rate is another challenging aspect of self-promoting. Importantly, whilst the presence of A-SC policies does not seem to influence the J-SC rate, our secondary analysis showed that the focus of interest of CCM journals is a factor significantly influencing the J-SC rate. Indeed, CCM journals with narrower focus of interest had significantly higher J-SC as compared with “broad CCM interest” and “multidisciplinary” journals. Therefore, while a narrower focus of interest should not be regarded as justification for excessive self-promoting, the interpretation of J-SC rates should be paired, among others, with critical estimation of the journal’s scope. Conversely, we found that the focus of interest does not seem to influence the journal IFs.

Considering all the factors influencing the J-SC rates and also the difficulties in critically evaluating the appropriateness of each A-SC or J-SC, an option could be to calculate author’s and journal’s scientific metrics excluding self-citations. Doing so, inappropriate self-referencing will become a useless practice. Importantly, Scopus® and Web of Science® databases offer the opportunity to exclude A-SC when observing scientific metrics. Similarly, it is feasible to calculate the journal’s IF without J-SC contribution (as shown in Table 1 in our study).

Limitations

Overall, our investigation on A-SC policies and J-SC rates over-simplifies complex issues, since we again reinforce that it is challenging to evaluate the appropriateness of each A-SC as well as to show editorial requests to add specific citations. Furthermore, the lack of policies regarding A-SC and the J-SC rate may be greater in “predatory journals” [8, 9]. Another limitation of this study is that several journals publishing in the field of CCM were not included as not listed in the InCites Journal Citation Reports. For instance, several Anaesthesiology journals have dedicated sections on CCM.

Conclusions

We found a very limited number of CCM journals with policies for limiting A-SC. Journals with A-SC policies had higher IF. The J-SC rate was highly variable and greater in journals with narrower focus of interest. Excluding author’s and journal’s self-referencing from the scientific metrics calculation could be a valuable option to tackle these forms of scientific malpractice.

Availability of data and materials

Available on request and online at the source quoted.

Abbreviations

A-SC:

Author’s self-citation

CCM:

Critical care medicine

IF:

Impact factor

J-SC:

Journals’ self-citation

References

  1. Van Noorden R, Singh Chawla D. Hundreds of extreme self-citing scientists revealed in new database. Nature. 2019;572(7771):578–9.

    Article  Google Scholar 

  2. Anaesth Br J . 2021;126(1):e21–5. https://doi.org/10.1016/j.bja.2020.10.002. Epub 2020 Oct 26.

  3. Trusted insights and analytics – Clarivate https://jcr.clarivate.com/JCRJournalHomeAction.action Accessed October 30 2020

  4. "New Research Misconduct Policies”- NSF National Science Foundation https://www.nsf.gov/oig/_pdf/presentations/session.pdf Accessed November 28, 2020

  5. Ghost Writing Initiated by Commercial Companies - World Assosiation of Medical Editors website (WAME) WAOME http://wame.org/ghost-writing-initiated-commercial-companies Accessed November 28 2020

  6. Hemmat Esfe M, Wongwises S, Asadi A, Karimipour A, Akbari M. Mandatory and Self-citation; Types, Reasons, Their Benefits and Disadvantages. Sci Eng Ethics. 2015;21(6):1581–5.

    Article  Google Scholar 

  7. Tighe P, Rice KJ, Gravenstein N, Rice MJ. Artifactual increase in journal self-citation. Anesth Analg. 2011;113(2):378–82.

    Article  Google Scholar 

  8. Cortegiani A, Longhini F, Sanfilippo F, Raineri SM, Gregoretti C, Giarratano A. Predatory Open-Access Publishing in Anesthesiology. Anesth Analg. 2019;128(1):182–7.

    Article  Google Scholar 

  9. Cortegiani A, Sanfilippo F, Tramarin J, Giarratano A. Predatory open-access publishing in critical care medicine. J Crit Care. 2019;50:247–9.

    Article  Google Scholar 

Download references

Acknowledgements

NoneEthics approval and consent to participate

Not needed

Funding

None

Author information

Authors and Affiliations

Authors

Contributions

FS, PM, and MA had the idea to investigate self-citations; ST and AM downloaded the data; FS and AM analyzed the journal-self-citation rate for each journal; FS and ST conducted the statistical analysis comparing journals according to policies and according to their multidisciplinary, broad or narrow interest in the discipline; FS and PM interpreted the data and wrote the initial draft; ST, AM, and MA revised critically the draft. All authors agreed on the final version of the manuscript. The author (s) read and approved the final manuscript.

Corresponding author

Correspondence to Filippo Sanfilippo.

Ethics declarations

Consent for publication

Not needed

Competing interests

The authors declare that they have no competing interests.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Sanfilippo, F., Tigano, S., Morgana, A. et al. Self-citation policies and journal self-citation rate among Critical Care Medicine journals. j intensive care 9, 15 (2021). https://doi.org/10.1186/s40560-021-00530-2

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s40560-021-00530-2

Keywords