SEA4DQ '23: "Challenges for Predictive ..."
Challenges for Predictive Quality in Multi-stage Manufacturing: Insights from Literature Review
Beatriz Bretones Cassoli and Joachim Metternich
(TU Darmstadt, Germany)
This paper investigates data quality challenges in applying predictive quality solutions for multi stage discrete manufacturing. Through an analysis of existing research via systematic literature search, we highlight key obstacles that affect the implementation of machine learning approaches for quality control, such as the quantity and quality of available datasets for model training and testing and available quality labels for supervised training. Our findings underscore the necessity of addressing these challenges to enhance the accuracy and scalability of predictive quality models.
@InProceedings{SEA4DQ23p16,
author = {Beatriz Bretones Cassoli and Joachim Metternich},
title = {Challenges for Predictive Quality in Multi-stage Manufacturing: Insights from Literature Review},
booktitle = {Proc.\ SEA4DQ},
publisher = {ACM},
pages = {16--23},
doi = {10.1145/3617573.3618030},
year = {2023},
}
Publisher's Version
SEA4DQ '23: "Enhancing Data Quality in ..."
Enhancing Data Quality in Large-Scale Software Systems for Industrial Automation
Valentina Golendukhina, Lisa Sonnleithner, and Michael Felderer
(University of Innsbruck, Austria; JKU Linz, Austria; DLR, Germany)
Modern industrial systems have become highly automated and data-driven, generating large volumes of data through sophisticated machinery. However, the quality of the collected data is not always optimal, whereas monitoring data quality is challenging due to real-time data constraints. While significant research has been done on data validation of the exported and prepared data, there is no research on implementing data quality practices with programming languages and tools that directly interact with hardware in the domain of cyber-physical production systems (CPPSs), such as IEC 61499 and IEC 61131-3, i.e., software on level 1 of the automation pyramid. By examining a plant-building company, this short paper explores the challenges and opportunities for data quality management at L1 including knowledge transfer, data compression, and metadata formulation, and suggests possible data validation techniques.
@InProceedings{SEA4DQ23p5,
author = {Valentina Golendukhina and Lisa Sonnleithner and Michael Felderer},
title = {Enhancing Data Quality in Large-Scale Software Systems for Industrial Automation},
booktitle = {Proc.\ SEA4DQ},
publisher = {ACM},
pages = {5--8},
doi = {10.1145/3617573.3618028},
year = {2023},
}
Publisher's Version
SEA4DQ '23: "Enhancing Data Quality in ..."
Enhancing Data Quality in Large-Scale Software Systems for Industrial Automation
Valentina Golendukhina, Lisa Sonnleithner, and Michael Felderer
(University of Innsbruck, Austria; JKU Linz, Austria; DLR, Germany)
Modern industrial systems have become highly automated and data-driven, generating large volumes of data through sophisticated machinery. However, the quality of the collected data is not always optimal, whereas monitoring data quality is challenging due to real-time data constraints. While significant research has been done on data validation of the exported and prepared data, there is no research on implementing data quality practices with programming languages and tools that directly interact with hardware in the domain of cyber-physical production systems (CPPSs), such as IEC 61499 and IEC 61131-3, i.e., software on level 1 of the automation pyramid. By examining a plant-building company, this short paper explores the challenges and opportunities for data quality management at L1 including knowledge transfer, data compression, and metadata formulation, and suggests possible data validation techniques.
@InProceedings{SEA4DQ23p5,
author = {Valentina Golendukhina and Lisa Sonnleithner and Michael Felderer},
title = {Enhancing Data Quality in Large-Scale Software Systems for Industrial Automation},
booktitle = {Proc.\ SEA4DQ},
publisher = {ACM},
pages = {5--8},
doi = {10.1145/3617573.3618028},
year = {2023},
}
Publisher's Version
SEA4DQ '23: "A Nearest Neighbor-Based Concept ..."
A Nearest Neighbor-Based Concept Drift Detection Strategy for Reliable Tool Condition Monitoring
Nicolas Jourdan and Joachim Metternich
(TU Darmstadt, Germany)
Condition monitoring is one of the most prominent industrial use cases for machine learning today. As condition monitoring applications are commonly developed using static training datasets, their long-term performance is vulnerable to concept drift in the form of time-dependent changes in environmental and operating conditions as well as data quality problems or sensor drift. When the data distribution changes, machine learning models can fail catastrophically. We show that two-sample tests of homogeneity, which form the basis of most of the available concept drift detection strategies, fail in this domain, as the live data is highly correlated and does not follow the assumption of being independent and identically distributed (i.i.d.) that is often made in academia. We propose a novel drift detection approach called Localized Reference Drift Detection (LRDD) to address this challenge by refining the reference set for the two-sample tests. We demonstrate the performance of the proposed approach in a preliminary evaluation on a tool condition monitoring case study.
@InProceedings{SEA4DQ23p1,
author = {Nicolas Jourdan and Joachim Metternich},
title = {A Nearest Neighbor-Based Concept Drift Detection Strategy for Reliable Tool Condition Monitoring},
booktitle = {Proc.\ SEA4DQ},
publisher = {ACM},
pages = {1--4},
doi = {10.1145/3617573.3618027},
year = {2023},
}
Publisher's Version
SEA4DQ '23: "Data Pre-processing and Sensor-Fusion ..."
Data Pre-processing and Sensor-Fusion for Multivariate Statistical Process Control of an Extrusion Process
Frank Westad, Lars Lodgaard, and Torbjørn Pedersen
(Idletechs, Norway; Norwegian University of Science and Technology, Norway; Benteler Automotive, Norway)
In most manufacturing processes, data related to a product are collected across several process steps. Ensuring good data quality is essential for subsequent process modeling, monitoring, and control. Although data for a given process might already be available in digitized form in the process control systems or industrial databases, it is in most cases not so that the data can directly be used in its original form for process modeling. Pre-processing is often needed before modeling, which may include operations such as time alignment by handling different sampling frequencies and lag time, handling of missing values, and detection of sample outliers. Specific considerations must be made for processes with both continuous and batch process steps due to different data structures. This paper describes an industrial use case for extrusion monitoring starting from structured raw data and ending up with real-time multivariate statistical process control (MSPC) applying a sensor-fusion approach and feature extraction. The MSPC also enables in-depth analysis for identifying process variables in the case of samples lying outside of the normal operating conditions (NOC).
@InProceedings{SEA4DQ23p9,
author = {Frank Westad and Lars Lodgaard and Torbjørn Pedersen},
title = {Data Pre-processing and Sensor-Fusion for Multivariate Statistical Process Control of an Extrusion Process},
booktitle = {Proc.\ SEA4DQ},
publisher = {ACM},
pages = {9--15},
doi = {10.1145/3617573.3618029},
year = {2023},
}
Publisher's Version
SEA4DQ '23: "Challenges for Predictive ..."
Challenges for Predictive Quality in Multi-stage Manufacturing: Insights from Literature Review
Beatriz Bretones Cassoli and Joachim Metternich
(TU Darmstadt, Germany)
This paper investigates data quality challenges in applying predictive quality solutions for multi stage discrete manufacturing. Through an analysis of existing research via systematic literature search, we highlight key obstacles that affect the implementation of machine learning approaches for quality control, such as the quantity and quality of available datasets for model training and testing and available quality labels for supervised training. Our findings underscore the necessity of addressing these challenges to enhance the accuracy and scalability of predictive quality models.
@InProceedings{SEA4DQ23p16,
author = {Beatriz Bretones Cassoli and Joachim Metternich},
title = {Challenges for Predictive Quality in Multi-stage Manufacturing: Insights from Literature Review},
booktitle = {Proc.\ SEA4DQ},
publisher = {ACM},
pages = {16--23},
doi = {10.1145/3617573.3618030},
year = {2023},
}
Publisher's Version
SEA4DQ '23: "A Nearest Neighbor-Based Concept ..."
A Nearest Neighbor-Based Concept Drift Detection Strategy for Reliable Tool Condition Monitoring
Nicolas Jourdan and Joachim Metternich
(TU Darmstadt, Germany)
Condition monitoring is one of the most prominent industrial use cases for machine learning today. As condition monitoring applications are commonly developed using static training datasets, their long-term performance is vulnerable to concept drift in the form of time-dependent changes in environmental and operating conditions as well as data quality problems or sensor drift. When the data distribution changes, machine learning models can fail catastrophically. We show that two-sample tests of homogeneity, which form the basis of most of the available concept drift detection strategies, fail in this domain, as the live data is highly correlated and does not follow the assumption of being independent and identically distributed (i.i.d.) that is often made in academia. We propose a novel drift detection approach called Localized Reference Drift Detection (LRDD) to address this challenge by refining the reference set for the two-sample tests. We demonstrate the performance of the proposed approach in a preliminary evaluation on a tool condition monitoring case study.
@InProceedings{SEA4DQ23p1,
author = {Nicolas Jourdan and Joachim Metternich},
title = {A Nearest Neighbor-Based Concept Drift Detection Strategy for Reliable Tool Condition Monitoring},
booktitle = {Proc.\ SEA4DQ},
publisher = {ACM},
pages = {1--4},
doi = {10.1145/3617573.3618027},
year = {2023},
}
Publisher's Version
SEA4DQ '23: "Data Pre-processing and Sensor-Fusion ..."
Data Pre-processing and Sensor-Fusion for Multivariate Statistical Process Control of an Extrusion Process
Frank Westad, Lars Lodgaard, and Torbjørn Pedersen
(Idletechs, Norway; Norwegian University of Science and Technology, Norway; Benteler Automotive, Norway)
In most manufacturing processes, data related to a product are collected across several process steps. Ensuring good data quality is essential for subsequent process modeling, monitoring, and control. Although data for a given process might already be available in digitized form in the process control systems or industrial databases, it is in most cases not so that the data can directly be used in its original form for process modeling. Pre-processing is often needed before modeling, which may include operations such as time alignment by handling different sampling frequencies and lag time, handling of missing values, and detection of sample outliers. Specific considerations must be made for processes with both continuous and batch process steps due to different data structures. This paper describes an industrial use case for extrusion monitoring starting from structured raw data and ending up with real-time multivariate statistical process control (MSPC) applying a sensor-fusion approach and feature extraction. The MSPC also enables in-depth analysis for identifying process variables in the case of samples lying outside of the normal operating conditions (NOC).
@InProceedings{SEA4DQ23p9,
author = {Frank Westad and Lars Lodgaard and Torbjørn Pedersen},
title = {Data Pre-processing and Sensor-Fusion for Multivariate Statistical Process Control of an Extrusion Process},
booktitle = {Proc.\ SEA4DQ},
publisher = {ACM},
pages = {9--15},
doi = {10.1145/3617573.3618029},
year = {2023},
}
Publisher's Version
SEA4DQ '23: "Enhancing Data Quality in ..."
Enhancing Data Quality in Large-Scale Software Systems for Industrial Automation
Valentina Golendukhina, Lisa Sonnleithner, and Michael Felderer
(University of Innsbruck, Austria; JKU Linz, Austria; DLR, Germany)
Modern industrial systems have become highly automated and data-driven, generating large volumes of data through sophisticated machinery. However, the quality of the collected data is not always optimal, whereas monitoring data quality is challenging due to real-time data constraints. While significant research has been done on data validation of the exported and prepared data, there is no research on implementing data quality practices with programming languages and tools that directly interact with hardware in the domain of cyber-physical production systems (CPPSs), such as IEC 61499 and IEC 61131-3, i.e., software on level 1 of the automation pyramid. By examining a plant-building company, this short paper explores the challenges and opportunities for data quality management at L1 including knowledge transfer, data compression, and metadata formulation, and suggests possible data validation techniques.
@InProceedings{SEA4DQ23p5,
author = {Valentina Golendukhina and Lisa Sonnleithner and Michael Felderer},
title = {Enhancing Data Quality in Large-Scale Software Systems for Industrial Automation},
booktitle = {Proc.\ SEA4DQ},
publisher = {ACM},
pages = {5--8},
doi = {10.1145/3617573.3618028},
year = {2023},
}
Publisher's Version
SEA4DQ '23: "Data Pre-processing and Sensor-Fusion ..."
Data Pre-processing and Sensor-Fusion for Multivariate Statistical Process Control of an Extrusion Process
Frank Westad, Lars Lodgaard, and Torbjørn Pedersen
(Idletechs, Norway; Norwegian University of Science and Technology, Norway; Benteler Automotive, Norway)
In most manufacturing processes, data related to a product are collected across several process steps. Ensuring good data quality is essential for subsequent process modeling, monitoring, and control. Although data for a given process might already be available in digitized form in the process control systems or industrial databases, it is in most cases not so that the data can directly be used in its original form for process modeling. Pre-processing is often needed before modeling, which may include operations such as time alignment by handling different sampling frequencies and lag time, handling of missing values, and detection of sample outliers. Specific considerations must be made for processes with both continuous and batch process steps due to different data structures. This paper describes an industrial use case for extrusion monitoring starting from structured raw data and ending up with real-time multivariate statistical process control (MSPC) applying a sensor-fusion approach and feature extraction. The MSPC also enables in-depth analysis for identifying process variables in the case of samples lying outside of the normal operating conditions (NOC).
@InProceedings{SEA4DQ23p9,
author = {Frank Westad and Lars Lodgaard and Torbjørn Pedersen},
title = {Data Pre-processing and Sensor-Fusion for Multivariate Statistical Process Control of an Extrusion Process},
booktitle = {Proc.\ SEA4DQ},
publisher = {ACM},
pages = {9--15},
doi = {10.1145/3617573.3618029},
year = {2023},
}
Publisher's Version