[RLlib] Require ApeX LR schedule test to produce learner info. (ray-p…

…roject#27557)

Signed-off-by: Stefan van der Kleij <[email protected]>

rllib/algorithms/apex_dqn/tests/test_apex_dqn.py

@@ -124,6 +124,8 @@ def test_apex_lr_schedule(self):
             )
             .reporting(
                 min_sample_timesteps_per_iteration=10,
+                # Make sure that results contain info on default policy
+                min_train_timesteps_per_iteration=10,
                 # 0 metrics reporting delay, this makes sure timestep,
                 # which lr depends on, is updated after each worker rollout.
                 min_time_s_per_iteration=0,