We provide some examples on how to use NATS-Bench in the following notebooks:
create-query-sss.ipynb: create the size search space and query the performance of some architectures.find-largest.ipynb: find the largest model and report its performance on each dataset.random-search.ipynb: use random search on the topology search space of NATS-Benchissue-7.ipynb: show how to usefind_bestfunction.issue-11.ipynb: show how to useget_more_infofunction.issue-12.ipynb: show the unique string of each candidate and remove duplicated candidates.issue-21.ipynb: create the PyTorch model instance of an architecture candidate.
FYI, to open and run them in your machine, execute jupyter notebook under the NATS-Bench/notebooks folder.