This last talk #WoReLa1 before the final keynote is a very original one: Mike Dorin, who is a software engineer, is presenting an attempt to reproduce the findings of a study on an indigenous language spoken in Peru that was originally conducted by his wife when she was a student several decades ago! Mike used an impressive array of ML tools to transcribe and analyse the written and oral recordings that his wife and co-students made as part of their fieldwork. #replication
#WoReLa1 continues with "How replicable are bilingual interactive processing effects? A pre-registered close replication and extension of Dijkstra et al. (1999)" presented by Jurriaan Witteman. #linguistics #replication
Opening the second day of the First Workshop on #Replication (#WoReLa1), we are treated to a keynote about "Research on Bilingualism as Discovery Science" by Anne Beatty-Martínez. Anne has lots of food for thought for us all. #linguistics #metascience
The first day of the Workshop on #Replication in the Language Sciences (#WoReLa1) is closing with a keynote by Timo Roettger provocatively titled... "Against replication"! Timo intends to argue that #linguistics is simply not ready for replications.
Lucía Vieitez Portas is continuing with the topic of grammatical gender with a talk entitled "Grammatical gender and beyond: Uncovering differences across women and men on the interplay between grammatical and emotional processing". So far, Lucía has made clear that the literature has produced very mixed results, using both ERP and behavioural methods motivating future work on this reaction question. #WoReLa1 #linguistics #replication
Tamara Bouso-Rivas's talk on "Mapping links within the network of English Objoid Constructions: A #replication study using T-Maze" was also very interesting and triggered discussions on many different aspects including what "unrelated constructions" in Construction Grammar are (and how degrees of relatedness might be measured) and how long differences in reaction times need to be for us to consider that a priming effect has been detected. @tamarabouso #linguistics #WoReLa1
In conclusion, we need to do more replications (but maybe call them something else) and move away from binary expectations of success vs. failure for findings to replicate. #replication #linguistics #WoReLa1
Angela de Bruin agrees with Nosek and Lakens that "[t]here is no such thing as an exact replication."
She will discuss two major challenges to #replication in the language sciences, with a particular focus on #bilingualism and executive control:
1. Literature does not provide us enough information.
2. Not enough consideration or theoretical understanding of how "changes" matter.
We begin with a keynote by Angela de Bruin on „The importance of both direct and conceptual #replication studies when studying language users from different language backgrounds“. #linguistics #WoReLa1
Brompton and I have made it to the conference venue: very much looking forward to the 1st Workshop on Replication in the Language Sciences! https://sites.google.com/view/worela1/programme #linguistics #replication #WoReLa1
#PostgreSQL folks: I'm seeing a thing where stalled cursor transversal doesn't seem to be subject to #replication timeout cancellation. Which means that a backend with a stalled cursor read can block replication indefinitely. Is that a known problem, or should I start working on a test case?
Does anyone happen to have a PDF copy of this book to hand? https://www.cambridge.org/gb/cambridgeenglish/catalog/teacher-training-development-and-research/replication-research-applied-linguistics 
#ICanHazPDF #replication #OpenAccess
Excited to be part of the first Replication Research Symposium (https://indico.uni-muenster.de/event/3176/) these days which will also shape and define the scope of the upcoming interdisciplinary journal Replication Research (http://replicationresearch.org), which will launch in late 2025.
The (Digital) Humanities, however, seem far behind in this important area of academic work.
#replication #research #digitalhumanities #humanities
What if your app could combine the simplicity of physical replication with the efficiency of logical replication? Meet Graft: lazy, partial, strongly consistent edge replication.
#OpenSource #EdgeComputing #Replication
https://sqlsync.dev/posts/stop-syncing-everything/
Any recommendations on short run #CDDuplication or #CDReplication pressing? 25-50qty. #CD #Replication #Duplication #Music
Very interesting and important #replication experiment by @huggingface, who is building a #deepseek R1 equivalent #opensource model, with all the needed pieces (yes, including the datasets): https://huggingface.co/blog/open-r1
(Strictly speaking: it will not be fully end-to-end reproducible, because the distillation part in step 1 starts from Deepseek, which is itself non-reproducible. But it will be *much* better than the status quo, and will produce as byproducts many useful reasoning datasets.)
New preprint!
Comparing Human-Only, AI-Assisted, and AI-Led Teams on Assessing Research Reproducibility in Quantitative Social Science
https://econpapers.repec.org/paper/zbwi4rdps/195.htm
Brodeur et al (including me and 261 others)
Thread on findings on 
https://bsky.app/profile/i4replication.bsky.social/post/3lgccq376fk2y
Introducing ClusterLite: Transform SQLite into a distributed database with Redpanda!
Simple yet powerful - scale your data across multiple nodes while keeping SQLite's simplicity. Perfect for small to medium workloads.
On the one hand, the #NIH will pay for #replication studies. On the other hand, (1) researchers must nominate their studies for replication and few are interested, and (2) the replication studies will NOT be #OpenAccess, contradicting the pioneering NIH principle to provide public access to publicly-funded research.
https://www.science.org/content/article/nih-launches-initiative-double-check-biomedical-studies
(#paywalled)
On the one hand, this is happening under the #Biden admin NIH. On the other, it has the support of #Trump's nominee to head the NIH, #JayBhattacharya.
Comparing the predicted #replicability of a study with its actual replicability.
https://www.nature.com/articles/s41562-024-01961-1
"Both beginners and more-experienced participants…have some ability to make better-than-chance predictions about the reliability of ‘fast science’ under conditions of high uncertainty."
For more along these lines, esp #PredictionMarkets for #replication, see the Twitter thread I started in 2020, which I plan to continue here in Mastodon. Watch this space.
https://x.com/petersuber/status/1259521012196167681
