-
Notifications
You must be signed in to change notification settings - Fork 5.8k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
[RLlib; Docs overhaul] Docstring cleanup: Evaluation #19783
[RLlib; Docs overhaul] Docstring cleanup: Evaluation #19783
Conversation
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
just 1 quick question.
I like the renaming a lot.
@@ -200,29 +242,55 @@ def last_action_for(self, | |||
@DeveloperAPI | |||
def prev_action_for(self, | |||
agent_id: AgentID = _DUMMY_AGENT_ID) -> EnvActionType: | |||
"""Returns the previous action for the specified agent.""" | |||
"""Returns the previous action for the specified agent, or zeros. |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
actually what's the diff between last_action_for and prev_action_for?
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Good question:
last_action = action taken most recently by agent X.
prev_action = action taken one before the most recent one by agent X.
I'll add this explanation. ...
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
done
…_docstring_cleanup_evaluation # Conflicts: # rllib/agents/callbacks.py # rllib/policy/policy.py # rllib/policy/tf_policy.py
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
nice!
…_docstring_cleanup_envs # Conflicts: # rllib/agents/callbacks.py
…_docstring_cleanup_evaluation
…_docstring_cleanup_evaluation # Conflicts: # rllib/agents/callbacks.py # rllib/evaluation/rollout_worker.py # rllib/evaluation/worker_set.py
…ject#19783)" This reverts commit 9c73871.
Docstring cleanup: rllib/evaluation folder.
Why are these changes needed?
Related issue number
Checks
scripts/format.sh
to lint the changes in this PR.