An Architecture for the Development of Distributed Analytics Based on Polystore Events

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

To balance the requirements for data consistency and availability, organisations increasingly migrate towards hybrid data persistence architectures (called polystores throughout this paper) comprising both relational and NoSQL databases. The EC-funded H2020 TYPHON project offers facilities for designing and deploying such polystores, otherwise a complex, technically challenging and error-prone task. In addition, it is nowadays increasingly important for organisations to be able to extract business intelligence by monitoring data stored in polystores. In this paper, we propose a novel approach that facilitates the extraction of analytics in a distributed manner by monitoring polystore queries as these arrive for execution. Beyond the analytics architecture, we presented a pre-execution authorisation mechanism. We also report on preliminary scalability evaluation experiments which demonstrate the linear scalability of the proposed architecture.

Original languageEnglish
Title of host publicationHeterogeneous Data Management, Polystores, and Analytics for Healthcare - VLDB Workshops, Poly 2020 and DMAH 2020, Revised Selected Papers
EditorsVijay Gadepally, Timothy Mattson, Michael Stonebraker, Tim Kraska, Fusheng Wang, Gang Luo, Jun Kong, Alevtina Dubovitskaya
PublisherSpringer
Pages54-65
Number of pages12
ISBN (Print)9783030710545
DOIs
Publication statusPublished - 4 Mar 2021
EventVLDB workshops: International Workshop on Polystore Systems for Heterogeneous Data in Multiple Databases with Privacy and Security Assurances, Poly 2020, and 6th International Workshop on Data Management and Analytics for Medicine and Healthcare, DMAH 2020 - Virtual, Online
Duration: 31 Aug 20204 Sep 2020

Publication series

NameLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume12633 LNCS
ISSN (Print)0302-9743
ISSN (Electronic)1611-3349

Conference

ConferenceVLDB workshops: International Workshop on Polystore Systems for Heterogeneous Data in Multiple Databases with Privacy and Security Assurances, Poly 2020, and 6th International Workshop on Data Management and Analytics for Medicine and Healthcare, DMAH 2020
CityVirtual, Online
Period31/08/204/09/20

Bibliographical note

Funding Information:
Acknowledgements. This work is funded by the TYPHON project (#780251).

Funding Information:
This work is funded by the European Union Horizon 2020 TYPHON project (#780251).

Publisher Copyright:
© 2021, Springer Nature Switzerland AG.

Keywords

  • Analytics
  • Hybrid databases
  • Polystores
  • Queries

Cite this