Reproducibility

On Challenging Aspects of Reproducibility in Deep Anomaly Detection, 13 Jul. 2022 (papers)
Our companion paper On Challenging Aspects of Reproducibility in Deep Anomaly Detection has been accepted for presentation on the Fourth Workshop on Reproducible Research in Pattern Recognition (satellite event of ICPR 2022). In it, we discuss aspects of reproducibility for our anomaly detection algorithm MCHAD, as well as anomaly detection with deep neural networks in general. In particular, we discussed the following challenges for the reproducibility: Nondeterminism: conducting the same …
Categories: Anomaly Detection · Reproducibility
212 Words, Tagged with: RRPR · Anomaly Detection · Reproducibility
Thumbnail for On Challenging Aspects of Reproducibility in Deep Anomaly Detection
Addressing Randomness in Evaluation Protocols for Out-of-Distribution Detection, 13 Jul. 2021 (papers)
Our Paper Addressing Randomness in Evaluation Protocols for Out-of-Distribution Detection has been accepted at the ICJAI 2021 Workshop for Artificial Intelligence for Anomalies and Novelties. In summary, we investigated the following phenomenon: when you train neural networks several times, and then measure their performance on some task, there is a certain variance in the performance measurements, since the results of experiments may vary based on several factors (that are effectively …
Categories: Anomaly Detection · Reproducibility
252 Words, Tagged with: AI4AN · Anomaly Detection · Reproducibility
Thumbnail for Addressing Randomness in Evaluation Protocols for Out-of-Distribution Detection