Moeller, Michael
Now showing 1 - 2 of 2
- Some of the metrics are blocked by yourconsent settings
Publication Access status: Metadata only , An Evaluation of Zero-Cost Proxies - from Neural Architecture Performance Prediction to Model RobustnessZero-cost proxies are nowadays frequently studied and used to search for neural architectures. They show an impressive ability to predict the performance of architectures by making use of their untrained weights. These techniques allow for immense search speed-ups. So far the joint search for well performing and robust architectures has received much less attention in the field of NAS. Therefore, the main focus of zero-cost proxies is the clean accuracy of architectures, whereas the model robustness should play an evenly important part. In this paper, we analyze the ability of common zero-cost proxies to serve as performance predictors for robustness in the popular NAS-Bench-201 search space. We are interested in the single prediction task for robustness and the joint multi-objective of clean and robust accuracy. We further analyze the feature importance of the proxies and show that predicting the robustness makes the prediction task from existing zero-cost proxies more challenging. As a result, the joint consideration of several proxies becomes necessary to predict a model’s robustness while the clean accuracy can be regressed from a single such feature. Our code is available at https://github.com/jovitalukasik/zcp_eval .Source Type:Article3 - Some of the metrics are blocked by yourconsent settings
Publication Access status: Metadata only , Robustness and exploration of variational and machine learning approaches to inverse problems: An overviewThis paper provides an overview of current approaches for solving inverse problems in imaging using variational methods and machine learning. A special focus lies on point estimators and their robustness against adversarial perturbations. In this context results of numerical experiments for a one‐dimensional toy problem are provided, showing the robustness of different approaches and empirically verifying theoretical guarantees. Another focus of this review is the exploration of the subspace of data‐consistent solutions through explicit guidance to satisfy specific semantic or textural properties.Source Type:Article1
