Not logged in.

Contribution Details

Type Journal Article
Scope Discipline-based scholarship
Title A Methodology for Evaluating the Robustness of Anomaly Detectors to Adversarial Attacks in Industrial Scenarios
Organization Unit
Authors
  • Ángel L Perales Gómez
  • Lorenzo Fernández Maimó
  • Félix J García Clemente
  • Javier A Maroto Morales
  • Alberto Huertas Celdran
  • Gérôme Bovet
Item Subtype Original Work
Refereed Yes
Status Published in final form
Language
  • English
Journal Title IEEE Access
Publisher Institute of Electrical and Electronics Engineers
Geographical Reach international
ISSN 2169-3536
Volume 10
Number 1
Page Range 124582 - 124594
Date 2022
Abstract Text Anomaly Detection systems based on Machine and Deep learning are the most promising solutions to detect cyberattacks in the industry. However, these techniques are vulnerable to adversarial attacks that downgrade prediction performance. Several techniques have been proposed to measure the robustness of Anomaly Detection in the literature. However, they do not consider that, although a small perturbation in an anomalous sample belonging to an attack, i.e., Denial of Service, could cause it to be misclassified as normal while retaining its ability to damage, an excessive perturbation might also transform it into a truly normal sample, with no real impact on the industrial system. This paper presents a methodology to calculate the robustness of Anomaly Detection models in industrial scenarios. The methodology comprises four steps and uses a set of additional models called support models to determine if an adversarial sample remains anomalous. We carried out the validation using the Tennessee Eastman process, a simulated testbed of a chemical process. In such a scenario, we applied the methodology to both a Long-Short Term Memory (LSTM) neural network and 1-dimensional Convolutional Neural Network (1D-CNN) focused on detecting anomalies produced by different cyberattacks. The experiments showed that 1D-CNN is significantly more robust than LSTM for our testbed. Specifically, a perturbation of 60% (empirical robustness of 0.6) of the original sample is needed to generate adversarial samples for LSTM, whereas in 1D-CNN the perturbation required increases up to 111% (empirical robustness of 1.11).
Free access at DOI
Digital Object Identifier 10.1109/ACCESS.2022.3224930
Other Identification Number merlin-id:23173
PDF File Download from ZORA
Export BibTeX
EP3 XML (ZORA)