Using the ODD protocol and NetLogo to replicate agent-based models

Volker Grimm; Uta Berger; Justin M. Calabrese; Ainara  Cortés-Avizanda; Jordi  Ferrer; Mathias  Franz; Jürgen  Groeneveld; Florian  Hartig; Oliver  Jakoby; Roger  Jovani; Stephanie Kramer-Schadt; Tamara  Münkemüller; Cyril  Piou; Luke  Premo; Sandro  Pütz; Thomas  Quintaine; Christine  Rademacher; Nadja  Rüger; Jan C.  Thiele; Julia Touza; Steven F.  Railsback

doi:10.1016/j.ecolmodel.2024.110967

Using the ODD protocol and NetLogo to replicate agent-based models

Volker Grimm, Uta Berger, Justin M. Calabrese, Ainara Cortés-Avizanda , Jordi Ferrer, Mathias Franz, Jürgen Groeneveld, Florian Hartig, Oliver Jakoby, Roger Jovani, Stephanie Kramer-Schadt, Tamara Münkemüller , Cyril Piou, Luke Premo, Sandro Pütz, Thomas Quintaine , Christine Rademacher, Nadja Rüger, Jan C. Thiele, Julia TouzaSteven F. Railsback

Environment and Geography

Research output: Contribution to journal › Article › peer-review

Abstract

Replicating existing models and their key results not only adds credibility to the original work, it also allows modellers to start model development from an existing approach rather than from scratch. New theory can then be developed by changing the assumptions or scenarios tested, or by carrying out more in-depth analysis of the model. However, model replication can be challenging if the original model description is incomplete or ambiguous. Here we show that the use of standards can facilitate and speed up replication: the ODD protocol for describing models, and NetLogo, an easy-to-learn but powerful software platform and language for implementing agent-based models. To demonstrate the benefits of this approach, we conducted a replication experiment on 18 agent-based models from different disciplines. The researchers doing the replications had no or little previous experience using ODD and NetLogo. Their task was to rewrite the original model description using ODD, implement the model in NetLogo and try to replicate at least one exemplary main result. They were also asked to produce, if time allowed, some initial new results with the replicated model, and to record the total time spent on the replication exercise. Replication was successful for 15 out of 18 models. The time taken varied between 2 and 12 days, with an average of 5 days. ODD helped to systematically scan the original model description, while NetLogo proved easy and quick to learn, but difficult to debug when implementation problems arose. Although most of the models replicated were relatively simple, we conclude that even for more complex models it can be useful to use ODD and NetLogo for replication, at least for developing a prototype to help decide how to proceed with the replicated model. Overall, the use of both, standard approaches such as ODD and easy to learn but powerful software such as NetLogo, can promote coherence and efficiency within and between different models and modelling communities. Imagine if all modellers spoke ODD and NetLogo as a common language or lingua franca.

Original language	English
Article number	110967
Number of pages	8
Journal	Ecological Modelling
Volume	501
Early online date	6 Dec 2024
DOIs	https://doi.org/10.1016/j.ecolmodel.2024.110967
Publication status	Published - Feb 2025

Bibliographical note

Access to Document

10.1016/j.ecolmodel.2024.110967Licence: CC BY

1-s2.0-S0304380024003557-main
© 2024 The Author(s).
Final published version, 3.12 MBLicence: CC BY

Cite this

Grimm, V., Berger, U., Calabrese, J. M., Cortés-Avizanda , A., Ferrer, J., Franz, M., Groeneveld, J., Hartig, F., Jakoby, O., Jovani, R., Kramer-Schadt, S., Münkemüller , T., Piou, C., Premo, L., Pütz, S., Quintaine , T., Rademacher, C., Rüger, N., Thiele, J. C., ... Railsback, S. F. (2025). Using the ODD protocol and NetLogo to replicate agent-based models. Ecological Modelling, 501, Article 110967. https://doi.org/10.1016/j.ecolmodel.2024.110967

@article{11a8b1f22f1e4b9098d9d050cc4e749d,

title = "Using the ODD protocol and NetLogo to replicate agent-based models",

abstract = "Replicating existing models and their key results not only adds credibility to the original work, it also allows modellers to start model development from an existing approach rather than from scratch. New theory can then be developed by changing the assumptions or scenarios tested, or by carrying out more in-depth analysis of the model. However, model replication can be challenging if the original model description is incomplete or ambiguous. Here we show that the use of standards can facilitate and speed up replication: the ODD protocol for describing models, and NetLogo, an easy-to-learn but powerful software platform and language for implementing agent-based models. To demonstrate the benefits of this approach, we conducted a replication experiment on 18 agent-based models from different disciplines. The researchers doing the replications had no or little previous experience using ODD and NetLogo. Their task was to rewrite the original model description using ODD, implement the model in NetLogo and try to replicate at least one exemplary main result. They were also asked to produce, if time allowed, some initial new results with the replicated model, and to record the total time spent on the replication exercise. Replication was successful for 15 out of 18 models. The time taken varied between 2 and 12 days, with an average of 5 days. ODD helped to systematically scan the original model description, while NetLogo proved easy and quick to learn, but difficult to debug when implementation problems arose. Although most of the models replicated were relatively simple, we conclude that even for more complex models it can be useful to use ODD and NetLogo for replication, at least for developing a prototype to help decide how to proceed with the replicated model. Overall, the use of both, standard approaches such as ODD and easy to learn but powerful software such as NetLogo, can promote coherence and efficiency within and between different models and modelling communities. Imagine if all modellers spoke ODD and NetLogo as a common language or lingua franca.",

author = "Volker Grimm and Uta Berger and Calabrese, {Justin M.} and Ainara Cort{\'e}s-Avizanda and Jordi Ferrer and Mathias Franz and J{\"u}rgen Groeneveld and Florian Hartig and Oliver Jakoby and Roger Jovani and Stephanie Kramer-Schadt and Tamara M{\"u}nkem{\"u}ller and Cyril Piou and Luke Premo and Sandro P{\"u}tz and Thomas Quintaine and Christine Rademacher and Nadja R{\"u}ger and Thiele, {Jan C.} and Julia Touza and Railsback, {Steven F.}",

note = "{\textcopyright} 2024 The Author(s).",

year = "2025",

month = feb,

doi = "10.1016/j.ecolmodel.2024.110967",

language = "English",

volume = "501",

journal = "Ecological Modelling",

issn = "0304-3800",

publisher = "Elsevier",

}

Grimm, V, Berger, U, Calabrese, JM, Cortés-Avizanda , A, Ferrer, J, Franz, M, Groeneveld, J, Hartig, F, Jakoby, O, Jovani, R, Kramer-Schadt, S, Münkemüller , T, Piou, C, Premo, L, Pütz, S, Quintaine , T, Rademacher, C, Rüger, N, Thiele, JC, Touza, J & Railsback, SF 2025, 'Using the ODD protocol and NetLogo to replicate agent-based models', Ecological Modelling, vol. 501, 110967. https://doi.org/10.1016/j.ecolmodel.2024.110967

TY - JOUR

T1 - Using the ODD protocol and NetLogo to replicate agent-based models

AU - Grimm, Volker

AU - Berger, Uta

AU - Calabrese, Justin M.

AU - Cortés-Avizanda , Ainara

AU - Ferrer, Jordi

AU - Franz, Mathias

AU - Groeneveld, Jürgen

AU - Hartig, Florian

AU - Jakoby, Oliver

AU - Jovani, Roger

AU - Kramer-Schadt, Stephanie

AU - Münkemüller , Tamara

AU - Piou, Cyril

AU - Premo, Luke

AU - Pütz, Sandro

AU - Quintaine , Thomas

AU - Rademacher, Christine

AU - Rüger, Nadja

AU - Thiele, Jan C.

AU - Touza, Julia

AU - Railsback, Steven F.

PY - 2025/2

Y1 - 2025/2

N2 - Replicating existing models and their key results not only adds credibility to the original work, it also allows modellers to start model development from an existing approach rather than from scratch. New theory can then be developed by changing the assumptions or scenarios tested, or by carrying out more in-depth analysis of the model. However, model replication can be challenging if the original model description is incomplete or ambiguous. Here we show that the use of standards can facilitate and speed up replication: the ODD protocol for describing models, and NetLogo, an easy-to-learn but powerful software platform and language for implementing agent-based models. To demonstrate the benefits of this approach, we conducted a replication experiment on 18 agent-based models from different disciplines. The researchers doing the replications had no or little previous experience using ODD and NetLogo. Their task was to rewrite the original model description using ODD, implement the model in NetLogo and try to replicate at least one exemplary main result. They were also asked to produce, if time allowed, some initial new results with the replicated model, and to record the total time spent on the replication exercise. Replication was successful for 15 out of 18 models. The time taken varied between 2 and 12 days, with an average of 5 days. ODD helped to systematically scan the original model description, while NetLogo proved easy and quick to learn, but difficult to debug when implementation problems arose. Although most of the models replicated were relatively simple, we conclude that even for more complex models it can be useful to use ODD and NetLogo for replication, at least for developing a prototype to help decide how to proceed with the replicated model. Overall, the use of both, standard approaches such as ODD and easy to learn but powerful software such as NetLogo, can promote coherence and efficiency within and between different models and modelling communities. Imagine if all modellers spoke ODD and NetLogo as a common language or lingua franca.

AB - Replicating existing models and their key results not only adds credibility to the original work, it also allows modellers to start model development from an existing approach rather than from scratch. New theory can then be developed by changing the assumptions or scenarios tested, or by carrying out more in-depth analysis of the model. However, model replication can be challenging if the original model description is incomplete or ambiguous. Here we show that the use of standards can facilitate and speed up replication: the ODD protocol for describing models, and NetLogo, an easy-to-learn but powerful software platform and language for implementing agent-based models. To demonstrate the benefits of this approach, we conducted a replication experiment on 18 agent-based models from different disciplines. The researchers doing the replications had no or little previous experience using ODD and NetLogo. Their task was to rewrite the original model description using ODD, implement the model in NetLogo and try to replicate at least one exemplary main result. They were also asked to produce, if time allowed, some initial new results with the replicated model, and to record the total time spent on the replication exercise. Replication was successful for 15 out of 18 models. The time taken varied between 2 and 12 days, with an average of 5 days. ODD helped to systematically scan the original model description, while NetLogo proved easy and quick to learn, but difficult to debug when implementation problems arose. Although most of the models replicated were relatively simple, we conclude that even for more complex models it can be useful to use ODD and NetLogo for replication, at least for developing a prototype to help decide how to proceed with the replicated model. Overall, the use of both, standard approaches such as ODD and easy to learn but powerful software such as NetLogo, can promote coherence and efficiency within and between different models and modelling communities. Imagine if all modellers spoke ODD and NetLogo as a common language or lingua franca.

U2 - 10.1016/j.ecolmodel.2024.110967

DO - 10.1016/j.ecolmodel.2024.110967

M3 - Article

SN - 0304-3800

VL - 501

JO - Ecological Modelling

JF - Ecological Modelling

M1 - 110967

ER -