Journal or Book Title
PS: Political Science and Politics
Political science journals have, for good reason, faced increased scrutiny because of the potential for biases in the editorial process. The representation of women lags behind their distribution in the discipline. Given the importance of publication in hiring, tenure, and promotion, if there are biases in the editorial process, it is vital to the discipline that we determine where in the process these occur and do what is necessary to eliminate them.
Political Behavior uses a double-blind review process. When manuscripts are submitted, the editor determines their fit for the journal in terms of both substance and quality to decide if it is going to be sent out for peer review. At this stage, the editor knows the identity of the author(s). This initial screen results in more than one quarter (30% by August 2017) of all submissions being rejected without external review. Obviously, this is one potential location of any potential bias in the process.
If the manuscript is determined to fit the journal and, in the editor’s view, has the potential to be recommended for publication by the reviewers, it is sent out for blind review. At this stage, the reviewers should not know the identity of the author(s). Of course, the review process is less than ideal and there are certainly instances when the reviewers know the identity of the author(s). It is certainly plausible that the reviewer recommendations might also be a source of any bias in the process.
To try to empirically evaluate this, an undergraduate research assistant coded the data for 851 submissions to Political Behavior from January 2015 until August 2017. For each of these manuscripts, she coded the gender of the author(s), the rank of the senior author, and the initial decision.1 For manuscripts that were submitted for external review, the research assistant coded the gender of the reviewer and the categorical rating he or she gave. Other editors have coded the methodological approach of the manuscript. For Political Behavior, this is not a meaningful distinction. All but a handful of the submissions are quantitative or formal.
Following the model used by Ansell and Samuels, this report proceeds as follows. The next section reports the descriptive statistics. I then move to a series of statistical tests to determine if there are any statistically significant differences in the outcomes of the review process based on the gender of the authors. Finally, I examine how the gender of the reviewers results in any differences in either the recommendations of the reviewers or the editorial decision. I find no evidence that the gender of the authors influences the outcome of the review process at Political Behavior.
American Political Science Association
Peterson, David A.M., "Author Gender and Editorial Outcomes at Political Behavior" (2018). Political Science Publications. 47.