Advances in neural architecture search

web

Oxford Academic(peer-reviewed)·academic.oup.com/nsr/article/11/8/nwae282/7740455

Credibility Rating

5/5

Gold(5)

Gold standard. Rigorous peer review, high editorial standards, and strong institutional reputation.

Rating inherited from publication venue: Oxford Academic

Relevant to AI safety discussions around automated capability improvement and intelligence explosion hypotheses; NAS represents a concrete instantiation of machines improving machine learning systems, though this paper focuses on technical advances rather than safety implications.

Metadata

Importance: 35/100journal articlereference

Summary

This academic survey reviews progress in Neural Architecture Search (NAS), covering automated methods for designing neural network architectures. It examines search strategies, performance estimation techniques, and applications across various domains, highlighting how NAS enables automated discovery of architectures that rival or surpass hand-designed models.

Key Points

•NAS automates the design of neural network architectures, reducing reliance on human expertise and enabling systematic exploration of architectural space.
•Key NAS strategies include reinforcement learning, evolutionary algorithms, gradient-based methods, and Bayesian optimization.
•Performance estimation techniques like weight sharing and proxy tasks have dramatically reduced the computational cost of NAS.
•NAS is increasingly applied to specialized domains including computer vision, NLP, and hardware-aware deployment.
•Automated architecture discovery is a form of recursive capability improvement, raising questions about the pace and controllability of AI advancement.

Cited by 2 pages

Page	Type	Quality
Self-Improvement and Recursive Enhancement	Capability	69.0
Novel / Unknown Approaches	Capability	53.0

Cached Content Preview

HTTP 200Fetched Mar 20, 20261 KB

[Skip to Main Content](https://academic.oup.com/nsr/article/11/8/nwae282/7740455#skipNav)

Article Navigation

Close mobile search navigation

Article Navigation

Article Navigation


Article Navigation


- [![pdf](https://oup.silverchair-cdn.com/UI/app/svg/pdf.svg)PDF](https://academic.oup.com/nsr/article-pdf/11/8/nwae282/59087212/nwae282.pdf)
- Split View

- Views






  - Article contents
  - Figures & tables
  - Video
  - Audio
  - Supplementary Data
- ![Annotate icon](https://academic.oup.com/UI/shared/SCM.SharedControls/img/annotate.svg)
Annotate

- _Share Icon_Share  - Bluesky
  - Facebook
  - X
  - LinkedIn
  - Email

[Download all slides](https://academic.oup.com/DownloadFile/DownloadImage.aspx?image=&PPTtype=SlideSet&ar=7740455&xsltPath=~/UI/app/XSLT&siteId=5332)

Highlights visible

Hypothesis

![Hypothesis](https://hypothes.is/organizations/__default__/logo)NSR annotation

Sign up

/

Log in

## Annotations

AnnotationsPage Notes

There are no annotations in this group.

Create one by selecting some text and clicking the  button.

Annotate

Highlight

reCAPTCHA

Resource ID: d1a3f270ea185ba1 | Stable ID: ZGIzYmFlZm