TY - GEN
T1 - Understanding and Preparing Data of Industrial Processes for Machine Learning Applications
AU - Fleck, Philipp
AU - Kügel, Manfred
AU - Kommenda, Michael
N1 - Publisher Copyright:
© 2020, Springer Nature Switzerland AG.
PY - 2020
Y1 - 2020
N2 - Industrial applications of machine learning face unique challenges due to the nature of raw industry data. Preprocessing and preparing raw industrial data for machine learning applications is a demanding task that often takes more time and work than the actual modeling process itself and poses additional challenges. This paper addresses one of those challenges, specifically, the challenge of missing values due to sensor unavailability at different production units of nonlinear production lines. In cases where only a small proportion of the data is missing, those missing values can often be imputed. In cases of large proportions of missing data, imputing is often not feasible, and removing observations containing missing values is often the only option. This paper presents a technique, that allows to utilize all of the available data without the need of removing large amounts of observations where data is only partially available. We do not only discuss the principal idea of the presented method, but also show different possible implementations that can be applied depending on the data at hand. Finally, we demonstrate the application of the presented method with data from a steel production plant.
AB - Industrial applications of machine learning face unique challenges due to the nature of raw industry data. Preprocessing and preparing raw industrial data for machine learning applications is a demanding task that often takes more time and work than the actual modeling process itself and poses additional challenges. This paper addresses one of those challenges, specifically, the challenge of missing values due to sensor unavailability at different production units of nonlinear production lines. In cases where only a small proportion of the data is missing, those missing values can often be imputed. In cases of large proportions of missing data, imputing is often not feasible, and removing observations containing missing values is often the only option. This paper presents a technique, that allows to utilize all of the available data without the need of removing large amounts of observations where data is only partially available. We do not only discuss the principal idea of the presented method, but also show different possible implementations that can be applied depending on the data at hand. Finally, we demonstrate the application of the presented method with data from a steel production plant.
KW - Data preprocessing
KW - Machine learning
KW - Missing values
UR - http://www.scopus.com/inward/record.url?scp=85083970126&partnerID=8YFLogxK
U2 - 10.1007/978-3-030-45093-9_50
DO - 10.1007/978-3-030-45093-9_50
M3 - Conference contribution
SN - 9783030450922
T3 - Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
SP - 413
EP - 420
BT - Computer Aided Systems Theory – EUROCAST 2019 - 17th International Conference, Revised Selected Papers
A2 - Moreno-Díaz, Roberto
A2 - Quesada-Arencibia, Alexis
A2 - Pichler, Franz
PB - Springer
T2 - 17th International Conference on Computer Aided Systems Theory, EUROCAST 2019
Y2 - 17 February 2019 through 22 February 2019
ER -