[Question] Batch Size Selection for a Finite MDP

[DavidLudl]

❓ Question

Hello.

I would like to ask if I have a finite MDP, where each episode has a same fixed timestep $T$. Then during the training, do I have to choose batch size with $n\times T$? Or any other batch size is also OK?

Thank you for your time,

Best regards,

Checklist

• I have checked that there is no similar issue in the repo
• I have read the documentation
• If code there is, it is minimal and working
• If code there is, it is formatted using the markdown code blocks for both code and stack traces.