[Bug] TorchPolicy doesn't report stats anymore

[roireshef]

Search before asking

• I searched the issues and found no similar issues.

Ray Component

RLlib

What happened + What you expected to happen

I'm using APPO with Torch and setting num_multi_gpu_tower_stacks > 0 (I'm not sure this is the problem, though). The policy's stats_fn is pointing to a method that fills in learner stats. These stats aren't shown in the summary output to the screen, neither in the loggers (e.g. Tensorboard). Last time I checked (in v1.3.0) they showed well.

Reproduction script

Ray 1.7.0
APPO with Torch (and setting num_multi_gpu_tower_stacks > 0)

Anything else

No response

Are you willing to submit a PR?

• Yes I am willing to submit a PR!

[roireshef]

This is apparently a dup of #18116. Closing.