The American Journal of Political Science has demonstrated its commitment to data access and research transparency over the past year through its rigorous replication and verification policy. Starting immediately, the AJPS will provide more visible signals of its adherence to these principles by adopting two of the “Badges to Acknowledge Open Practices” from the Center for Open Science (COS). Specifically, we will use the “Open Data” and “Open Materials” badges illustrated below. According to the COS guidelines,”(t)he Open Data badge is earned for making publicly available the digitally-shareable data necessary to reproduce the reported results.” Similarly, the guidelines state that “(t)he Open Materials badge is earned by making publicly available the components of the research methodology needed to reproduce the reported procedure and analysis.” Thus, the badges are intended to be a salient indicator that the articles to which they are awarded conform to the principles and best practices of openness in scientific research.
Any manuscript that has been accepted for publication at the AJPS and successfully completed the data replication and verification process will automatically meet the criteria for the Open Data and Open Materials badges. Therefore, upon release of the replication Dataset on the AJPS Dataverse, these two badges will be added to the metadata of the Dataverse Dataset. The badges appear near the bottom of the main page for the article’s Dataverse Dataset, along with the statement, “The associated article has been awarded Open Materials and Open Data badges. Learn more about Open Practice Badges from the Center for Open Science.” When the article, itself, is published, the badges will appear with the information near the beginning of the electronic version in the Wiley Online library. And they will be included as part of the statement about replication materials on the first page of the article’s print version.
Of course, some articles published in the American Journal of Political Science will not receive the Badges. For example, many formal theory manuscripts and virtually all of the normative theory manuscripts that are submitted to the Journal do not contain any empirical analyses. Such work is exempt from the AJPS Replication Policy, so the Open Practice Badges are not relevant to these manuscripts. And there are certain situations in which a manuscript may be given an exemption from the usual replication requirements due to the use of restricted-access data. In such cases, authors still are asked to explain how interested researchers could gain access to the data and to provide all relevant software code and documentation for replicating their analyses. Manuscripts in this situation would not receive the Open Data Badge, but they would be awarded the Open Materials Badge. Even with allowances for exceptions, we anticipate that the vast majority of the articles published in the American Journal of Political Science will receive both Badges.
The AJPS will be the first journal in political science to award Open Practice Badges to articles. Currently, the Badges are used by five other journals– four in psychology and one in linguistics. The Badges already appear in the AJPS Dataverse Datasets for all qualified articles (i.e., those that have successfully completed the replication and verification process). And starting today (May 10, 2016) they will appear in all articles published online in the Early View queue within the Wiley Online Library. Of course, this carries over to the print versions of the articles. The Open Practice Badges serve a useful purpose by helping to emphasize the distinctive quality of the work that appears in the American Journal of Political Science.