Doubt about the Imagenet results with extra modules.

[orashi]

Both Top-1 and Top-5 accuracies of three distinct models are being improved uniformely with respect to the baseline accuracies after the introduction of the swish activation and SE modules:
AtomNAS-A:74.6->76.3 (+1.7), 92.1->93.0 (+0.9)
AtomNAS-B:75.5->77.2 (+1.7), 92.6->93.5 (+0.9)
AtomNAS-C:75.9->77.6 (+1.7), 92.7->93.6 (+0.9)
which is an eye-catching uniformity that rarely appears. Is there a reasonable explaination for this?
Thanks very much for your reply!

[skylian]

I would say that is a coincidence. If you run the code again, the results are likely different.