Towards an open set of real-world benchmarks for model queries and transformations

Amine Benelellam, Massimo Tisi, István Ráth, Benedek Izsó, Dimitrios S. Kolovos

Research output: Contribution to journalConference articlepeer-review


With the growing size and complexity of systems under design, industry needs a generation of Model-Driven Engineering (MDE) tools, especially model query and transformation, with the proven capability to handle large-scale scenarios. While researchers are proposing several technical solutions in this sense, the community lacks a set of shared scalability benchmarks, that would simplify quantitative assessment of advancements and enable crossevaluation of different proposals. Benchmarks in previous work have been synthesized to stress specific features of model management, lacking both generality and industrial validity. In this paper, we initiate an effort to define a set of shared benchmarks, gathering queries and transformations from real-world MDE case studies. We make these case available to community evaluation via a public MDE benchmark repository.

Original languageEnglish
Pages (from-to)14-22
Number of pages9
JournalCEUR Workshop Proceedings
Publication statusPublished - 2014
Event2nd Workshop on Scalability in Model Driven Engineering, BigMDE 2014, co-located with the Software Technologies: Applications and Foundations Conference, STAF 2014 - York, United Kingdom
Duration: 24 Jul 201424 Jul 2014


  • Benchmarking
  • Model queries
  • Model transformations
  • Very Large Models

Cite this