TY - GEN
T1 - A Cloud-Agnostic Serverless Architecture for Distributed Machine Learning
AU - Predoaia, Ionut
AU - García-López, Pedro
N1 - This is an author-produced version of the published paper. Uploaded in accordance with the University’s Research Publications and Open Access policy.
PY - 2025/4/8
Y1 - 2025/4/8
N2 - Serverless computing has shown vast potential for big data analytics applications, especially involving machine learning algorithms. Nevertheless, little consideration has been given in the literature to cloud-agnostic serverless architectures that leverage existing parallel implementations of machine learning algorithms. This work bridges this gap by proposing a multi-cloud serverless architecture for distributed machine learning, that enables machine learning engineers without cloud computing expertise to effortlessly port already implemented parallel machine learning algorithms to serverless, whilst overcoming vendor lock-in. In this work, two stateful machine learning algorithms have been ported to serverless, k-means clustering and logistic regression. The serverless implementation of k-means provided superior performance and scalability compared to a serverful implementation when using a number of workers that is equal to or slightly lower than the total number of vCPUs available on the VM running the serverful implementation. Additionally, it achieved an 87-fold speedup compared to a sequential implementation. Moreover, two storage designs of the shared state will be proposed for the serverless implementations, one that requires locks for updating the shared state, and another that is lock-free. Our experimental evaluation demonstrates that the performance of the lock-free serverless implementation of k-means declines with the increase in the number of clusters.
AB - Serverless computing has shown vast potential for big data analytics applications, especially involving machine learning algorithms. Nevertheless, little consideration has been given in the literature to cloud-agnostic serverless architectures that leverage existing parallel implementations of machine learning algorithms. This work bridges this gap by proposing a multi-cloud serverless architecture for distributed machine learning, that enables machine learning engineers without cloud computing expertise to effortlessly port already implemented parallel machine learning algorithms to serverless, whilst overcoming vendor lock-in. In this work, two stateful machine learning algorithms have been ported to serverless, k-means clustering and logistic regression. The serverless implementation of k-means provided superior performance and scalability compared to a serverful implementation when using a number of workers that is equal to or slightly lower than the total number of vCPUs available on the VM running the serverful implementation. Additionally, it achieved an 87-fold speedup compared to a sequential implementation. Moreover, two storage designs of the shared state will be proposed for the serverless implementations, one that requires locks for updating the shared state, and another that is lock-free. Our experimental evaluation demonstrates that the performance of the lock-free serverless implementation of k-means declines with the increase in the number of clusters.
KW - Distributed Machine Learning
KW - Big Data
KW - Serverless Architectures
KW - Cloud Agnostic
KW - Multicloud
KW - Lithops
UR - http://www.scopus.com/inward/record.url?scp=105003155777&partnerID=8YFLogxK
UR - https://www.computer.org/csdl/proceedings-article/bdcat/2024/673000a131/25KnUZmhWGQ
U2 - 10.1109/BDCAT63179.2024.00032
DO - 10.1109/BDCAT63179.2024.00032
M3 - Conference contribution
SN - 979-8-3503-6731-7
T3 - International Symposium on Big Data Computing
SP - 131
EP - 140
BT - Proceedings - 2024 IEEE/ACM International Conference on Big Data Computing, Applications and Technologies, BDCAT 2024
PB - IEEE
T2 - 11th IEEE/ACM International Conference on Big Data Computing, Applications and Technologies, BDCAT 2024
Y2 - 16 December 2024 through 19 December 2024
ER -