By the same authors

From the same journal

From the same journal

Replication in second language research: Narrative and systematic reviews, and recommendations for the field.

Research output: Contribution to journalArticle

Standard

Replication in second language research: Narrative and systematic reviews, and recommendations for the field. / Marsden, Emma Josephine; Morgan-Short, Kara; Thompson, Sophie; Abugaber, David.

In: Language Learning, Vol. 68, No. 2, 01.06.2018, p. 321-391.

Research output: Contribution to journalArticle

Harvard

Marsden, EJ, Morgan-Short, K, Thompson, S & Abugaber, D 2018, 'Replication in second language research: Narrative and systematic reviews, and recommendations for the field.', Language Learning, vol. 68, no. 2, pp. 321-391. https://doi.org/10.1111/lang.12286

APA

Marsden, E. J., Morgan-Short, K., Thompson, S., & Abugaber, D. (2018). Replication in second language research: Narrative and systematic reviews, and recommendations for the field. Language Learning, 68(2), 321-391. https://doi.org/10.1111/lang.12286

Vancouver

Marsden EJ, Morgan-Short K, Thompson S, Abugaber D. Replication in second language research: Narrative and systematic reviews, and recommendations for the field. Language Learning. 2018 Jun 1;68(2):321-391. https://doi.org/10.1111/lang.12286

Author

Marsden, Emma Josephine ; Morgan-Short, Kara ; Thompson, Sophie ; Abugaber, David. / Replication in second language research: Narrative and systematic reviews, and recommendations for the field. In: Language Learning. 2018 ; Vol. 68, No. 2. pp. 321-391.

Bibtex - Download

@article{a7255497b63949208286a5a14802083d,
title = "Replication in second language research: Narrative and systematic reviews, and recommendations for the field.",
abstract = "Despite its critical role for the development of the field, little is known about replication in second language (L2) research. To better understand replication practice, we first provide a narrative review of challenges related to replication, drawing on recent developments in psychology. This discussion frames and motivates a systematic review, building on syntheses of replication in psychology (Makel, Plucker, & Hegarty, 2012), education (Makel & Plucker, 2014), and L2 research (Polio, 2012b). 67 self-labelled L2 replication studies found across 26 journals were coded for 136 characteristics. We estimated a mean rate of 1 published replication study for every 400 articles, with a mean 6.64 years between initial and replication studies, and a mean 117 citations of the initial study before a replication was published. Replication studies had an annual mean 7.3 citations, much higher than averages in linguistics and education. Overlap in authorship between initial and replication studies and the availability of the initial materials both increased the likelihood of the replication supporting the initial findings. Our sample contained no direct (exact) replication attempts, and changes made to initial studies were numerous and wide-ranging, thus obscuring, if not undermining, the interpretability of replication studies. We end by proposing 16 recommendations, relating to rationales, nomenclature, design, infrastructure, and incentivization for collaboration and publication, to improve the amount and quality of L2 replication research.",
author = "Marsden, {Emma Josephine} and Kara Morgan-Short and Sophie Thompson and David Abugaber",
note = "{\circledC} 2018 The Authors.",
year = "2018",
month = "6",
day = "1",
doi = "10.1111/lang.12286",
language = "English",
volume = "68",
pages = "321--391",
journal = "Language Learning",
issn = "0023-8333",
publisher = "Wiley-Blackwell",
number = "2",

}

RIS (suitable for import to EndNote) - Download

TY - JOUR

T1 - Replication in second language research: Narrative and systematic reviews, and recommendations for the field.

AU - Marsden, Emma Josephine

AU - Morgan-Short, Kara

AU - Thompson, Sophie

AU - Abugaber, David

N1 - © 2018 The Authors.

PY - 2018/6/1

Y1 - 2018/6/1

N2 - Despite its critical role for the development of the field, little is known about replication in second language (L2) research. To better understand replication practice, we first provide a narrative review of challenges related to replication, drawing on recent developments in psychology. This discussion frames and motivates a systematic review, building on syntheses of replication in psychology (Makel, Plucker, & Hegarty, 2012), education (Makel & Plucker, 2014), and L2 research (Polio, 2012b). 67 self-labelled L2 replication studies found across 26 journals were coded for 136 characteristics. We estimated a mean rate of 1 published replication study for every 400 articles, with a mean 6.64 years between initial and replication studies, and a mean 117 citations of the initial study before a replication was published. Replication studies had an annual mean 7.3 citations, much higher than averages in linguistics and education. Overlap in authorship between initial and replication studies and the availability of the initial materials both increased the likelihood of the replication supporting the initial findings. Our sample contained no direct (exact) replication attempts, and changes made to initial studies were numerous and wide-ranging, thus obscuring, if not undermining, the interpretability of replication studies. We end by proposing 16 recommendations, relating to rationales, nomenclature, design, infrastructure, and incentivization for collaboration and publication, to improve the amount and quality of L2 replication research.

AB - Despite its critical role for the development of the field, little is known about replication in second language (L2) research. To better understand replication practice, we first provide a narrative review of challenges related to replication, drawing on recent developments in psychology. This discussion frames and motivates a systematic review, building on syntheses of replication in psychology (Makel, Plucker, & Hegarty, 2012), education (Makel & Plucker, 2014), and L2 research (Polio, 2012b). 67 self-labelled L2 replication studies found across 26 journals were coded for 136 characteristics. We estimated a mean rate of 1 published replication study for every 400 articles, with a mean 6.64 years between initial and replication studies, and a mean 117 citations of the initial study before a replication was published. Replication studies had an annual mean 7.3 citations, much higher than averages in linguistics and education. Overlap in authorship between initial and replication studies and the availability of the initial materials both increased the likelihood of the replication supporting the initial findings. Our sample contained no direct (exact) replication attempts, and changes made to initial studies were numerous and wide-ranging, thus obscuring, if not undermining, the interpretability of replication studies. We end by proposing 16 recommendations, relating to rationales, nomenclature, design, infrastructure, and incentivization for collaboration and publication, to improve the amount and quality of L2 replication research.

U2 - 10.1111/lang.12286

DO - 10.1111/lang.12286

M3 - Article

VL - 68

SP - 321

EP - 391

JO - Language Learning

T2 - Language Learning

JF - Language Learning

SN - 0023-8333

IS - 2

ER -