Research Ethics Economists Behaving Badly Linked to Pressure to Publish
Remarkably, 1 to 3 percent of economists surveyed admit that in exchange for co-authorship, data, or promotion, they have accepted or offered gifts, money, or sex.
While certain practices clearly represent scientific misbehavior, the justifiability of others is less obvious. What is the bottom line of acceptable behavior? How prevalent are rejected practices? An anonymous online survey among the members of the European Economic Association yields evidence for economics. It is the first study of economists’ research norms and their engagement in a variety of research practices.
This article by Lars Kullman originally appeared on the LSE Impact of Social Sciences blog as “Scientific Misbehavior in Economics: Unacceptable research practice linked to perceived pressure to publish”
Several research practices are often considered “questionable.” Economists’ widespread rejection of the methods indicates that they definitely also represent scientific misbehavior. Economists seem to be aware that such practices can be as damaging to scientific progress as outright fraud. What is worrying is that – in conflict with economists’ convictions – their use seems to be the rule rather than the exception.
Almost every economist reports having engaged in at least one practice considered unacceptable by peers. For example, one third of the participants admit to having cherry-picked results – the selective presentation of empirical results that confirm one’s argument is rejected by 84 percent. Even though 64 percent consider it unacceptable to divide one’s work into small units to maximize the number of publications, 20% confess salami slicing. Strategic behavior in the publication process is considered unjustifiable by two thirds. However, 39 percent admit that they have taken into account suggestions of referees or editors even though they thought that they were wrong. Even 60 percent report that they have cited strategically to raise publication prospects.
Based on about 420 observations except (*) based on about 350 observations
The survey shows that economists have internalized that publishing is crucial for their academic survival. High or very high publication pressure is reported by 83 percent of the participants. Ninety percent perceive that the pressure has increased over the last decade. Economists also worry a lot about the funding for their research. Almost half of the respondents perceive high or very high pressure to raise external funds. How do you proceed if you feel urged to be successful and competition for publication space in top-journals is high? Nice results may increase the likelihood to get the paper published. Bowing to referees and editors may help as well.
In line with that idea, economists’ perceived pressure is found to be positively related to their admission of being involved in several rejected research practices. For example, it is 14 percentage points more likely that an economist perceiving “very high” pressure admits to having cherry-picked results than that an economist perceiving only “moderately high” pressure confesses the deed. Although the results cannot prove causality, they are consistent with the notion that pressure motivates researchers to act dishonestly. In this light, the finding that economists’ belief in norms seems to be unshaken by competitive pressure is not really encouraging.
The importance to deal with serious violations of research integrity has long been recognized. Institutions have been established that handle allegations, e.g., the ombudsman of the German Research Foundation. In contrast, “questionable practices” have received attention only more recently. Lack of evidence should be an important reason. It is difficult to assess whether the actions represent intentional bias. Stopping the analysis when a desired result has been found can also be the consequence of ambiguity about the most reliable model. A researcher himself may re-interpret his wrongdoing accordingly. Whom would you rather take into custody: a colleague faking data or the one presenting only his favorite results? The survey reveals that even of the observed cases of serious misconduct only one fourth is reported.
Surveying large representative samples of researchers to obtain estimates of scientific misbehavior has become an established approach. The approach allows inquiring into which behavior researchers consider wrong – and whether they have nonetheless engaged in them. Of course the results depend on the researchers’ willingness to report misbehavior. They are likely to present a lower bound estimate.
Awareness that several research practices are not “questionable” but represent scientific misbehavior may be essential to get a grip on them. Further research on the prevalence and determinants of all types of research behavior is thus desirable. Like whistle blowers, researchers who study scientific misbehavior may fear negative consequences from accusing colleagues of misconduct. They also face the same incentives as any other researcher: Do editors publish papers telling them that the contents of their journals may be biased? Apparently at least some do. This should provide ample reason to find out more about misbehavior in the academic universe.
