Career

How Journal Impact Factor Affects Your Career Career
This post originally appeared on the PeerJ Blog under the title "XXX." It is reposted here under a CC BY 4.0 license.

How Journal Impact Factor Affects Your Career

May 8, 2019 4028

The Journal Impact Factor: few scholars will be unfamiliar with this controversial metric. Appearing on journal websites, academic CVs, and in hiring decisions—it’s both the most widely used and the most criticized research metric that exists.

Although the Journal Impact Factor (JIF) was originally developed to help libraries make indexing and purchasing decisions for their journal collections, it has become a proxy for quality—not just of the journals academics publish in, but of the academics themselves. Many now believe that publishing work in high JIF journals is an essential step to achieving academic success.

Peer J blog logo
This post originally appeared on the PeerJ Blog under the title “The ‘impact’ of the Journal Impact Factor in the review, tenure, and promotion process.” It is reposted here under a CC BY 4.0 license.

And although many have raised concerns about the JIF’s use — and potential misuse — in current academic evaluation systems, little is known about the extent to which the metric features in tenure and promotion decisions.

To find out, we examined more than 860 review, promotion, and tenure (RPT) documents from universities across Canada and the US for mentions of the JIF. Here’s what we found:

How often is the Journal Impact Factor mentioned in tenure guidelines?

The JIF appeared in several of the RPT documents we collected, especially for institutions that prided themselves on their research outputs.

More than 40 percent of research-intensive institutions (R-type) mentioned the JIF, and 18 percent of master’s institutions (M-type) did. We also identified over a dozen terms that alluded to the JIF without mentioning it explicitly, suggesting that our results may be under-representing its use.

Do tenure guidelines support the Journal Impact Factor’s use?

Of the institutions that mentioned the JIF, 87 percent were supportive of its use. Only 13 percent were cautionary about using the metric in tenure considerations. None heavily criticized the JIF or prohibited its use.

For example, guidelines described the JIF as the “most reliable” and “most extensively used” research metric for evaluating faculty performance. Others emphasized that “Publication in respected, highly cited journals… counts for more than publication in unranked journals,” and encouraged candidates to include “information about the Impact Factors or related metrics” in their promotion files.

What do tenure guidelines assume the Journal Impact Factor measures?

Of the research institutions that mentioned the JIF in their tenure guidelines, most described it in one of three ways:

  1. Over 60 percent associated the JIF with quality. This goes against previous research that has questioned this association. We saw statements like, “Markers of quality of publications may include impact factors of journals, number of citations of published work, and audience of journal.”
  2. Some institutions—about 40 percent of our sample—associated it with impact, importance, or significance. Documents stated that “metrics such as citation figures, impact factors, or other such measures of the reach and impact of the candidate’s scholarship” would be considered in the tenure process.
  3. Finally, 20 percent of institutions associated the JIF with prestige, reputation, or status. For example, guidelines emphasized that faculty should “be aware of the prestige rankings of the field’s journals and … publish in the highest-ranked journals possible.”

A long way to go

Together, these findings suggest that the concerns about the JIF’s misuse in academic evaluations are warranted. Not only do universities—especially research-intensive ones—continue to encourage the use of the JIF in RPT evaluations, they also use it to measure aspects of research that it is ill-suited to measure. Until this changes, the potential “impact” of the Impact Factor on our professional futures cannot be underestimated.

Read the full preprint here.


Alice Fleerackers is a freelance writer, a researcher and lab manager at the ScholCommLab, and an editor at Art the Science. With degrees in both psychology and publishing, she is fascinated by the confluence of science and story, and is passionate about bringing research into everyday life. Juan Pablo Alperin is an assistant professor in the School of Publishing at Simon Fraser University, an Associate Director of Research for the Public Knowledge Project, and the co-Director of the ScholCommLab. He is a multi-disciplinary scholar, with training in computer science, geography, and education, whose research focuses on the public’s use of research. Erin McKiernan is a professor in the Department of Physics, Biomedical Physics program at the National Autonomous University of Mexico in Mexico City. She is a researcher in experimental and computational biophysics and neurophysiology, and an advocate for open access, open data, and open science.

View all posts by Alice Fleerackers, Juan Pablo Alperin and Erin McKiernan

Related Articles

Ninth Edition of ‘The Evidence’: Tackling the Gender Pay Gap 
Communication
October 31, 2024

Ninth Edition of ‘The Evidence’: Tackling the Gender Pay Gap 

Read Now
The Conversation Podcast Series Examines Class in British Politics
Communication
October 25, 2024

The Conversation Podcast Series Examines Class in British Politics

Read Now
Emerson College Pollsters Explain How Pollsters Do What They Do
Communication
October 23, 2024

Emerson College Pollsters Explain How Pollsters Do What They Do

Read Now
Diving Into OSTP’s ‘Blueprint’ for Using Social and Behavioral Science in Policy
Bookshelf
October 14, 2024

Diving Into OSTP’s ‘Blueprint’ for Using Social and Behavioral Science in Policy

Read Now
Eighth Edition of ‘The Evidence’: How Sexist Abuse Undermines Political Representation 

Eighth Edition of ‘The Evidence’: How Sexist Abuse Undermines Political Representation 

In this month’s issue of The Evidence newsletter, Josephine Lethbridge explores rising levels of abuse directed towards women in politics, spotlighting research […]

Read Now
Research Assessment, Scientometrics, and Qualitative v. Quantitative Measures

Research Assessment, Scientometrics, and Qualitative v. Quantitative Measures

The creation of the Coalition for Advancing Research Assessment (CoARA) has led to a heated debate on the balance between peer review and evaluative metrics in research assessment regimes. Luciana Balboa, Elizabeth Gadd, Eva Mendez, Janne Pölönen, Karen Stroobants, Erzsebet Toth Cithra and the CoARA Steering Board address these arguments and state CoARA’s commitment to finding ways in which peer review and bibliometrics can be used together responsibly.

Read Now
Paper to Advance Debate on Dual-Process Theories Genuinely Advanced Debate

Paper to Advance Debate on Dual-Process Theories Genuinely Advanced Debate

Sage 829 Impact

Psychologists Jonathan St. B. T. Evans and Keith E. Stanovich have a history of publishing important research papers that resonate for years.

Read Now
0 0 votes
Article Rating
Subscribe
Notify of
guest

This site uses Akismet to reduce spam. Learn how your comment data is processed.

0 Comments
Newest
Oldest Most Voted
Inline Feedbacks
View all comments