Having an impact

Uncategorized0

Nature Climate Change | Editorial

  • Print
  • Email
  • Share/bookmark

Having an impact

Nature Climate Change
3,
601
(2013)
doi:10.1038/nclimate1952
Published online
25 June 2013

As the journal’s first impact factor is released, it is time to reflect on journal metrics and how Nature Climate Change has been making its mark.

“The impact factor is one of the most recognized metrics and is a measure of a journal’s influence.”

How time flies. The first issue of Nature Climate Change appeared in April 2011, and the journal — a monthly publication — is now well into its third volume. By the time this issue goes to press, we should have received our first impact factor from Thomson Reuters1. The impact factor is one of the most recognized metrics and is a measure of a journal’s influence. It is calculated on two years’ worth of citation data. The impact factor released in 2013 is for 2012; it is calculated on citation counts in 2012 of papers published in 2010–2011, divided by the number of ‘citable items’ published in that period. Citable items — typically considered to be research papers and review articles — may not include all of the journal content that has been cited, Commentary and Policy Watch pieces would be excluded, for example.

The importance of impact factors is much debated, with a feeling that too heavy an emphasis is placed on this single number. A small number of very highly cited papers can strongly influence the final number, and the citation is not rated on being positive or negative, so a highly criticized paper may inflate the value.

Further criticisms of the impact factor include the timeframe — it only looks at the first two years of citations for any given paper, so the longer-term impact of work is not measured; and coverage — citations in books, conferences, reports, policy documents, working papers and the media — is not taken into account. Different dynamics, including publishing timelines and formats, across research disciplines result in different citation rates, meaning that comparison across fields is not possible. The social sciences are not well represented by impact factors; a study has shown that they often have artificially low numbers and are better ranked by other metrics2. Thomson Reuters recognises this and there is a Social Science Citation Index, covering over 4,000 journals and 50 disciplines in the social sciences, for better comparison in these fields3.

Another tool for measuring journal performance is the h5-index used by Google Scholar, which provides greater coverage of citations including books, conference and working papers4, 5. One advantage of the h5-index is that it is based on five years’ worth of data, rather than just two, which should make it more reliable; on the other hand a new journal would have to wait this period of time before receiving its first h5-index ranking.

All metrics have shortcomings, are still used as they provide a value for something that is difficult to define. Regardless, Nature Climate Change papers have attracted attention across the scientific and broader community in ways that might not be captured by a single number.

Nature Climate Change publishes across the climate change disciplines and it is pleasing that papers from all fields are being recognized in the scientific community. Our most cited paper is about coral reefs and ocean acidification6, with another marine ecology paper — ‘Coral and mollusc resistance to ocean acidification adversely affected by warming’7 — also being well cited. A top social science paper is ‘The role of social and decision sciences in communicating uncertain climate risks’8. The physical sciences are also represented, for example ‘Global radiative forcing from contrail cirrus’9 and a paper on the historical interdecadal modulation of El Niño Southern Oscillation10. Citation counts vary between the ISI Web of Science and Google Scholar due to the different coverage. As is to be expected, papers from our first year, 2011 to early 2012, dominate as they have had longer to accumulate citations.

The Nature Climate Change papers that have received the most press coverage are not necessarily those that are the most cited. Papers that have been reported in the media come from many sections of the journal and are varied in subject area. Examples include a paper on the impacts of wind farms on land surface temperature11, a Perspective on shrinking body size as an ecological response to climate change12 and a paper on a hotspot of sea-level rise13. Other top stories picked up by the media include a very highly cited Correspondence on the rapid growth in carbon dioxide emissions after the global financial crisis of 2008–200914, and more recently a paper on intensification of turbulence affecting air travel over the Atlantic, which received worldwide interest15. Many more Nature Climate Change papers have featured in the press, as well as in digital and social media.

The impact of published research on policy and working papers is harder to gauge, however feedback from authors and reviewers indicates that papers from the journal are being referenced outside academia. We expect several papers from the journal to feature in the upcoming Intergovernmental Panel on Climate Change Assessment Report Five, with ‘The Physical Science Basis’ expected in September of this year, followed by ‘Impacts, Adaptation and Vulnerability’ and ‘Mitigation of Climate Change’ early next year and the Synthesis Report in October 2014. Another report, the US National Climate Assessment — currently in draft form but closed for comments16 — references several Nature Climate Change papers.

Nature Climate Change is establishing itself as a resource of climate change information for scientists and the broader community. Although measuring the success of a publication is a complex process, the impact factor represents a key indicator of influence. The release of our first impact factor is therefore an exciting milestone for the journal.

References

  1. http://wokinfo.com/essays/impact-factor/
  2. Koucher, K. & Thelwall, M. J. Am. Soc. Inform. Sci. Technol. 58, 1055–1065 (2007).
  3. http://thomsonreuters.com/social-sciences-citation-index
  4. http://go.nature.com/gmYXl3
  5. Harzing, A. W. & van der Wal, R. A Google Scholar h-index For Journals: A Better Metric to Measure Journal Impact in Economics and Business? (Academy of Management Annual Meeting, 2008); available at http://www.harzing.com/download/hjournals.pdf
  6. Fabricius, K. E. et al. Nature Clim. Change 1, 165–169 (2011).
  7. Rodolfo-Metalpa, R. et al. Nature Clim. Change 1, 308–312 (2011).
  8. Pidgeon, N & Fischhoff, B. Nature Clim. Change 1, 35–41 (2011).
  9. Burkhardt, U. & Kärcher, B. Nature Clim. Change 1, 54–58 (2011).
  10. Li, J. et al. Nature Clim. Change 1, 114–118 (2011).
  11. Zhou, L. et al. Nature Clim. Change 2, 539–543 (2012).
  12. Sheridan, j.A. & Bickford, D. Nature Clim. Change 1, 401–406 (2011).
  13. Sallenger, A. H., Doran, K. S. & Howd, P. A. Nature Clim. Change 2, 884–888 (2012).
  14. Peters, G. P. et al. Nature Clim. Change 2, 2–4 (2012).
  15. Williams, P. D. & Joshi, M. M. Nature Clim. Change 3, 644–648 (2013).
  16. http://ncadac.globalchange.gov/

Download references

Additional data

Leave a Comment

You must be logged in to post a comment.

This site uses Akismet to reduce spam. Learn how your comment data is processed.