<?xml version="1.0" encoding="utf-8"?>
<rss version="2.0" xmlns:atom="http://www.w3.org/2005/Atom">
    <channel>
        <title>Testing Computational Reproducibility Review in editorial workflows of academic journals - Laura Caquelin</title>
        <link>https://video.edu.nl/videos/watch/1a34d2a6-c6c0-4204-9f41-66e0b961f262</link>
        <description>In this talk from the Paul Meehl Graduate School Meta Research Symposium 2026, Laura Caquelin (Karolinska Institutet) talks about computational reproducibility workflows and testing them in practice at journals. Abstract: Objective: Computational reproducibility is vital to research quality but rarely assessed systematically. This study aims to evaluate whether Computational Reproducibility Review (CRR) during the publication process improves reproducibility compared to standard peer review. We hypothesize that this intervention will improve reproducibility, encourage code sharing, and reduce errors. Method: This randomized controlled trial enrolls manuscripts submitted to partnering journals that meet inclusion criteria, including open data availability and inferential analysis. Manuscripts are randomized (1:1) to either peer review with CRR (intervention group) or standard peer review without intervention (control group). The CRR involves reproducing the essential statistical results using shared data (with or without the analysis code). Feedback is provided to authors in the intervention group during the peer review. Computational reproducibility of the control group will be assessed only after publication. The primary outcome is the difference between CRR versus control in the proportion of manuscripts of which we successfully reproduced the essential statistical results after publication. Secondary outcomes include rates of code sharing, overt errors identified, time required for the review, publication timelines, and categorized reproducibility issues. The study protocol was preregistered on the Open Science Framework (doi:10.17605/OSF.IO/3Y8FP). Results: The study commenced in January 2025, with manuscripts inclusion completed in June 2026. This presentation will report the main findings of the study and highlight key insights gained during its implementation. The assessment of computational reproducibility is currently ongoing for the 40 included manuscripts.</description>
        <lastBuildDate>Thu, 19 Nov 2026 23:12:41 GMT</lastBuildDate>
        <docs>https://validator.w3.org/feed/docs/rss2.html</docs>
        <generator>PeerTube - https://video.edu.nl</generator>
        <image>
            <title>Testing Computational Reproducibility Review in editorial workflows of academic journals - Laura Caquelin</title>
            <url>https://video.edu.nl/lazy-static/avatars/41ca21ea-ec0e-425f-b408-b8aafec11537.png</url>
            <link>https://video.edu.nl/videos/watch/1a34d2a6-c6c0-4204-9f41-66e0b961f262</link>
        </image>
        <copyright>All rights reserved, unless otherwise specified in the terms specified at https://video.edu.nl/about and potential licenses granted by each content's rightholder.</copyright>
        <atom:link href="https://video.edu.nl/feeds/video-comments.xml?videoId=1a34d2a6-c6c0-4204-9f41-66e0b961f262" rel="self" type="application/rss+xml"/>
    </channel>
</rss>