Roßteutscher, Immanuel; Drese, Klaus Stefan; Uphues, Thorsten (2025)
Institute of Electrical and Electronics Engineers.
DOI: 10.1109/ACCESS.2025.3644232
We investigated the adaptation and performance of Masked Autoencoders (MAEs) with Vision Transformer (ViT) architectures for self-supervised representation learning on one-dimensional (1D) ultrasound signals. Although MAEs have demonstrated significant success in computer vision and other domains, their use for 1D signal analysis, especially for raw ultrasound data, remains largely unexplored. Ultrasound signals are vital in industrial applications such as nondestructive testing (NDT) and structural health monitoring (SHM), where labeled data are often scarce and signal processing is highly task-specific. We propose an approach that leverages MAE to pre-train on unlabeled synthetic ultrasound signals, enabling the model to learn robust representations that enhance performance in downstream tasks, such as time-of-flight (ToF) classification. This study systematically investigated the impact of model size, patch size, and masking ratio on pre-training efficiency and downstream accuracy. Our results show that pre-trained models significantly outperform models trained from scratch and strong convolutional neural network (CNN) baselines optimized for the downstream task. Additionally, pre-training on synthetic data demonstrates superior transferability to real-world measured signals compared with training solely on limited real datasets. This study underscores the potential of MAEs for advancing ultrasound signal analysis through scalable, self-supervised learning.
Roßteutscher, Immanuel; Blaschke, Oliver; Dötzer, Florian; Uphues, Thorsten; Drese, Klaus Stefan (2024)
Roßteutscher, Immanuel; Blaschke, Oliver; Dötzer, Florian; Uphues, Thorsten...
Sensors 2024/24 (22), 7114.
DOI: 10.3390/s24227114
This study is focused on optimizing electromagnetic acoustic transducer (EMAT) sensors for enhanced ultrasonic guided wave signal generation in steel cables using CAD and modern manufacturing to enable contactless ultrasonic signal transmission and reception. A lab test rig with advanced measurement and data processing was set up to test the sensors’ ability to detect cable damage, like wire breaks and abrasion, while also examining the effect of potential disruptors such as rope soiling. Machine learning algorithms were applied to improve the damage detection accuracy, leading to significant advancements in magnetostrictive measurement methods and providing a new standard for future development in this area. The use of the Vision Transformer Masked Autoencoder Architecture (ViTMAE) and generative pre-training has shown that reliable damage detection is possible despite the considerable signal fluctuations caused by rope movement.
Fakultät Angewandte Naturwissenschaften und Gesundheit (FNG)
Friedrich-Streib-Str. 2
96450 Coburg
T 09561317751 Thorsten.Uphues[at]hs-coburg.de
ORCID iD: 0000-0003-3423-4510