Artificial Intelligence |
Authors: Hassan Touayouch, Rabie Najem, Mohammed Benjelloun
Neural Architecture Search (NAS) automates the design of neural networks but faces the prohibitive cost of evaluating eachcandidate architecture through full training. Zero-cost proxies estimate architecture quality in seconds without training, yetindividual proxies remain noisy, and no existing method jointly exploits proxy signals and the topological structure of architectureswithin an active-learning framework. We propose ZAPS (Zero-cost Active Proxy Search), a four-component pipeline that addressesthese limitations. ZAPS first selects a compact, non-redundant subset of proxies via PROXYFIT, a greedy anti-redundancy algorithm; initializes the search with a hybrid K-means strategy balancing exploitation and exploration; dynamically refines proxy selection using bootstrapped MRMR; and predicts architecture quality with an XGBoost ensemble fed by proxy ranks and one-hot topological encodings, guided by an Upper Confidence Bound (UCB) acquisition function. On NAS-Bench-201 with a budget ofB =200evaluations, ZAPS identifies 53.8% of the top-100 architectures on CIFAR-10 and 66.8% on CIFAR-100 (P@100), while maintaining a Regret of 0.04% on CIFAR-10. ZAPS outperforms comparable-budget methods — REA, BANANAS, and TPE — on both metrics evaluated on CIFAR-10 and CIFAR-100 of NAS-Bench-201.
Comments: 9 Pages.
Download: PDF
[v1] 2026-08-30 22:04:21
Unique-IP document downloads: 17 times
ai.Vixra.org is a AI assisted e-print repository rather than a journal. Articles hosted may not yet have been verified by peer-review and should be treated as preliminary. In particular, anything that appears to include financial or legal advice or proposed medical treatments should be treated with due caution. ai.Vixra.org will not be responsible for any consequences of actions that result from any form of use of any documents on this website.
Add your own feedback and questions here:
You are equally welcome to be positive or negative about any paper but please be polite. If you are being critical you must mention at least one specific error, otherwise your comment will be deleted as unhelpful.