Tag Archives: peer review

„Review the scientific review process“

Peer review is the central mechanism to verify the quality of scientific manuscripts. According to the internet platform SciRev, peer review processes are often lengthy, which delays the distribution of valuable, novel knowledge within the scientific community. To streamline this phase in scientfic knowledge dissemination, SciRev aims to increase transparency of scientific review processes across journals. Therefore, researchers are invited to evaluate their review experience with a journal based on various characteristics, such as duration of review rounds or rejection time or overall satisfaction with the review process. The information provided is aggregated into scores, which feed into a comprehensive database, so that journals become comparable.

Ultimately, researchers can search for journals with an efficient peer review procedure and benefit from timely publication while journal editors have the opportunity to compare their journal’s performance with that of others.

Check out the website to contribute to the database or benefit from your peers’ journal review experiences.

Publons: Get credit for peer review

Reviewers do an important but often underappreciated job in the current publication system. To recognize their invisible and usually unpaid efforts, journals often gratefully publish the name of their reviewers by end of the year. From the perspective of reviewers, these “honorable mentions” are nice, but still somewhat scattered and disconnected.

The online network “publons” offers a more personalized approach of earning credit for reviewing. Once you have created an account, you can forward the “thank-you-for-reviewing”-mails that are automatically generated by submission systems after completion of the process. The information will be verified and added to your profile, thus recording your personal history of peer reviewing. This can be helpful to document your services to the community, e.g. in application processes.

Rückblick: DGS-Sektionstagung “Einheit trotz Vielfalt”

Vom 08.10-09.10.2015 fand eine Herbsttagung der DGS-Sektion Wissenschafts- und Technikforschung in Kooperation mit dem Wissenschaftszentrum Berlin für Sozialforschung (WZB) statt. Das Tagungsthema lautete „Einheit trotz Vielfalt? Die Diversität der Wissenschaft als Herausforderung für die Forschung“. Ziel der Tagung war es, verschiedene Forschungsstrategien des methodologisch anspruchsvollen Fächervergleichs einander gegenüberzustellen und die empirischen Ergebnisse mit Blick auf die soziologische Theorienbildung und forschungspolitische Praxis zu reflektieren.
Dr. Fabian Hattke und ich hatten hierbei die Möglichkeit, unser aktuelles Forschungsthema „Double Blind Peer Review vs. Open Post Publication Review – Publikationspraktiken im Fächervergleich“ vorzustellen und mit diversen Wissenschaftlern aus unterschiedlichen Communities zu diskutieren.
Neben vielen spannenden Vorträgen gab es eine Podiumsdiskussion unter anderem mit Vertretern des Wissenschaftsrats und der Volkswagen Stiftung. Während der Diskussion fiel immer wieder auf, dass Vielfalt nicht erst auf einer übergeordneten Ebene zwischen verschiedenen Fächern entsteht, sondern bereits innerhalb der eigenen Disziplingrenzen. Mit dieser Komplexität umzugehen, stellt auch bei einer Evaluation von Forschungsergebnissen eine besondere Herausforderung dar, die nicht unterschätzt werden sollte. An diesem und weiteren Gedanken möchten wir bei unseren nächsten Forschungsschritten gerne anschließen.

The Hybrid Registered Reports Submission Path

One of the most frequent criticisms regarding the peer review system is a bias towards positive (i.e., confirmative) results, while negative or null findings are less likely to find approval by reviewers (although they may address no less relevant research questions and may result from equally rigorous methods).

The Journal of Business Psychology (JBP) has now announced to roll out an additional manuscript submission path that the editors hope to address the publication bias. In this alternative path, called hybrid registered reports submission path, authors submit the introduction, information on methods and measurement, as well as a plan of analysis, while no results and discussion are provided. Research is then evaluated on the merits, rigor, and quality of the project rather than what was actually found.

How Dinosaur Experts Propose Marriage

A particular interesting way to detect invisible colleges in scientific fields is to study acknowledgements in research publications. Authors usually thank their colleagues who spent time and effort to provide a “friendly review” of earlier drafts of the manuscript, or who have given other forms of support. When these efforts are reciprocated, networks of professional ties among scholars rise to the surface.

Sometimes acknowledgements reveal more than just professional networks. A Canadian paleontologist has recently published a paper in which he gives credit to the support from his colleague Lorma, who holds a PhD from the same university. So far, so good, but the acknowledgements continue surprisingly: “Lorma, will you marry me?” See the full CBC news report.

The Art (and Business) of Fabricating Peer Reviews

The Washington Post reports on a new way of cheating in academic publishing: Dubious agencies offer the service of faking peer reviews during the submission process of academic journals. A scandal revealed in the biomedical sciences suggests that these agencies fabricate contact details for reviewers and then submit favorable reviews from these addresses. Some of these accounts have the names of seemingly real researchers but with fraudulent e-mail addresses, others are completely fictitious. The blog Retraction Watch has counted a total of 170 retractions in the past few years because of fake peer reviews.

Although “fakeries” of this kind may be a threat to the integrity and reputation of academic publishing, the peer review system still enjoys high levels of commitment among researchers across all disciplines. This is a preliminary result of our survey on peer review which we conducted recently – more information soon on this blog.

Survey launched: An inquiry into the peer-review system of academic journals

Peer reviewing is a widespread procedure for evaluating the quality of scholarly manuscripts before publication. As such, it is at the heart of academia. Yet, little is known how scholars percieve the peer-review process.

Today, we initiated our survey into the peer-review system from the perspective of those who submit papers to academic journals. The survey asks questions about general attitudes towards your job, your personal experiences with peer reviews, and possible alternatives to the common pre-publication peer review process. We’ll keep you posted on the results!