Monitoring runtime engine statistics to identifying and manage bottlenecks and resource availability is a current and heavily debated topic in academics as well as in the industry. Due to the application variety and the complexity of distributed computer clusters, this problem is still important, and many proofs of concept emerge to challenge this issue. This paper aims to summarize the system's specification, component design, implementation, and evaluation of chosen infrastructure to develop a monitoring engine for exposing JVM and network-related statistics of the mentioned system using Docker Swarm, Apache Spark, Graphite, and Grafana.

Practical Approach to Monitor Runtime Engine Statistics for Apache Spark and Docker Swarm using Graphite, Grafana, and CollectD / Walter-Tscharf, Franz Frederik Walter Viktor. - ELETTRONICO. - (2021), pp. 91-96. (Intervento presentato al convegno 1st International Conference on Converging Technology in Electrical and Information Engineering, ICCTEIE 2021 tenutosi a Bandar Lampung, Indonesia nel 27-28 Oct. 2021) [10.1109/ICCTEIE54047.2021.9650649].

Practical Approach to Monitor Runtime Engine Statistics for Apache Spark and Docker Swarm using Graphite, Grafana, and CollectD

Walter-Tscharf, Franz Frederik Walter Viktor
2021-01-01

Abstract

Monitoring runtime engine statistics to identifying and manage bottlenecks and resource availability is a current and heavily debated topic in academics as well as in the industry. Due to the application variety and the complexity of distributed computer clusters, this problem is still important, and many proofs of concept emerge to challenge this issue. This paper aims to summarize the system's specification, component design, implementation, and evaluation of chosen infrastructure to develop a monitoring engine for exposing JVM and network-related statistics of the mentioned system using Docker Swarm, Apache Spark, Graphite, and Grafana.
2021
2021 International Conference on Converging Technology in Electrical and Information Engineering (ICCTEIE)
Piscataway, NJ.
Institute of Electrical and Electronics Engineers Inc.
978-1-6654-0081-7
Walter-Tscharf, Franz Frederik Walter Viktor
Practical Approach to Monitor Runtime Engine Statistics for Apache Spark and Docker Swarm using Graphite, Grafana, and CollectD / Walter-Tscharf, Franz Frederik Walter Viktor. - ELETTRONICO. - (2021), pp. 91-96. (Intervento presentato al convegno 1st International Conference on Converging Technology in Electrical and Information Engineering, ICCTEIE 2021 tenutosi a Bandar Lampung, Indonesia nel 27-28 Oct. 2021) [10.1109/ICCTEIE54047.2021.9650649].
File in questo prodotto:
File Dimensione Formato  
Practical_Approach_to_Monitor_Runtime_Engine_Statistics_for_Apache_Spark_and_Docker_Swarm_using_Graphite_Grafana_and_CollectD (1).pdf

Solo gestori archivio

Descrizione: Paper
Tipologia: Versione editoriale (Publisher’s layout)
Licenza: Tutti i diritti riservati (All rights reserved)
Dimensione 2.39 MB
Formato Adobe PDF
2.39 MB Adobe PDF   Visualizza/Apri

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/11572/332032
Citazioni
  • ???jsp.display-item.citation.pmc??? ND
  • Scopus 4
  • ???jsp.display-item.citation.isi??? ND
  • OpenAlex ND
social impact