Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

doc: clarify "Reviewed-By" iff "LGTM" #7183

Closed
wants to merge 1 commit into from
Closed

Conversation

bengl
Copy link
Member

@bengl bengl commented Jun 6, 2016

Checklist
  • documentation is changed or added
  • the commit message follows commit guidelines
Affected core subsystem(s)

doc

Description of change

As per conversation with @Trott, make it clear that Reviewed-By lines
should only be added for collaborators who've actually put a LGTM on the
PR.

As per conversation with @Trott, make it clear that Reviewed-By lines
should only be added for collaborators who've actually put a LGTM on the
PR.
@nodejs-github-bot nodejs-github-bot added the doc Issues and PRs related to the documentations. label Jun 6, 2016
@MylesBorins
Copy link
Contributor

LGTM

@evanlucas
Copy link
Contributor

lgtm

@cjihrig
Copy link
Contributor

cjihrig commented Jun 7, 2016

LGTM

2 similar comments
@jasnell
Copy link
Member

jasnell commented Jun 7, 2016

LGTM

@JacksonTian
Copy link
Contributor

LGTM

@mscdex mscdex added the meta Issues and PRs related to the general management of the project. label Jun 7, 2016
@rvagg
Copy link
Member

rvagg commented Jun 7, 2016

I've been pretty liberal in the past including others who have reviewed and I know add value to the process yet are not collaborators. This is particularly helpful when you have specialist issues that require an understanding not widely shared across the team but you want assurance. It's also helpful getting bug reporters reviewing stuff.

I don't mind the "at least one collaborator must sign off" rule, but I don't see a reason not to include outsiders in the review process and acknowledge them as such in the commits.

@Trott
Copy link
Member

Trott commented Jun 7, 2016

I don't mind the "at least one collaborator must sign off" rule, but I don't see a reason not to include outsiders in the review process and acknowledge them as such in the commits.

News to me! (Not saying it's wrong; just saying I was unaware!) Perhaps that's a sufficiently atypical edge-case that it doesn't need to be covered in onboarding? Maybe it can be mentioned in the onboarding_extras doc for people who like to read everything?

@Fishrock123
Copy link
Contributor

Likewise, I've sometimes included people who have reviewed it in a clearly positive way once others have given lgtm signoff.

@jasnell
Copy link
Member

jasnell commented Jun 7, 2016

Given that there have been several complaints made (generally via private conversations) about overly "liberal" use of sign off, I think being clearer and stricter about this is generally a good thing. One possible way to allow for additional recognition is to use a separate metadata label for others who helped with the review but aren't collaborators who gave a LGTM. For instance, Thanks: ...

@mhdawson
Copy link
Member

mhdawson commented Jun 7, 2016

Would those complaints have been addressed with "at least N L.G.T.Ms from collaborators" ?. I'd lean towards updating to require at least some number of collaborators and then possibly identifying them by adding (collaborator) after their entry in the Reviewed-by.

@Trott
Copy link
Member

Trott commented Jun 7, 2016

Would those complaints have been addressed with "at least N L.G.T.Ms from collaborators" ?

The current ground rules are that one LGTM from a collaborator is enough, but more is always better. I think it should stay that way because there are a few dark corners of the code where it is difficult to get more than one collaborator to confidently pronounce on it if there is anything complex being changed/added.

The ground rules are also that no matter how many LGTMs you amass, one objection from a collaborator is enough to stop the PR from merging. (There's always the escalate-to-CTC option if there's an impasse, but we strongly encourage messy consensus seeking first.)

@jasnell
Copy link
Member

jasnell commented Jun 7, 2016

Would those complaints have been addressed with "at least N L.G.T.Ms from collaborators" ?

I don't believe so. The complaints were about the "quality" of the LGTM's. Without going into too much detail, the gist is that several individuals felt that "Reviewed-By" sign-offs should only be given by people who were "qualified" to fix any potential issues / regressions that occur as a result of the PR.

@bengl
Copy link
Member Author

bengl commented Jun 7, 2016

The intent of this PR was not to establish who has reviewing/LGTM rights, but simply to confirm that "Reviewed-By" sign-offs should only be added for a person when they have LGTM'd, rather than having simply commented. To that end, would a simple s/collaborators/those/ suffice, deferring the qualifications for reviewership to be handled elsewhere?

@jasnell
Copy link
Member

jasnell commented Jun 7, 2016

My vote is for this PR as it is currently worded: Reviewed-By is for collaborator LGTM's only. To recognize non-collaborator reviews, let's use a different label (e.g. the Thanks: ... I suggested)

@reqshark
Copy link

reqshark commented Jun 7, 2016

as a non-collaborator, LGTM! :neckbeard:

@rvagg
Copy link
Member

rvagg commented Jun 8, 2016

A Thanks: line works for me, but we'd better updating tooling to do this because keeping track of who is and who isn't a collaborator is becoming very difficult and the GitHub UI isn't much help on this either. I'll try and get https://github.com/rvagg/iojs-tools/tree/master/pr-metadata updated, @evanlucas I think you have something similar too?

@MylesBorins
Copy link
Contributor

@rvagg I think you are referring to https://github.com/evanlucas/core-get-reviewers

@saghul
Copy link
Member

saghul commented Jun 8, 2016

I'd just like to point out (as a collaborator), that my judgement in ~80% of Node would be meaningless. I just don't have enough kowledge to take the judgement call. Using common sense, I just don't LGTM things that I don't feel qualified to, but it looks like this is already a problem. That said, a non-collaborator could be a lot more qualified to detrmine if something is right or not that an actual collaborator.

As an example, in libuv I (pretty much blindly, when I can't make sense of it) trust Alexis (not a collaborator) for Windows related reviews. His LGTM is a lot more valuable than mine on that realm.

Alas, I also don't have an answer for a better system, but I thought I had to get this in writing.

@Fishrock123
Copy link
Contributor

Almost need both Signed-off-by and reviewed-by now by the sounds of it, lol

@Trott
Copy link
Member

Trott commented Jun 16, 2016

Can we land this as is and punt the "what metadata to use for non-collaborators" to another issue?

This clarifies a rather important gap in the onboarding doc. As longtime collaborators. most of the folks commenting here have simply internalized that an LGTM by a collaborator translates into a Reviewed-by: in the metadata. Let's get that fact explicitly into the onboarding doc because (as demonstrated by the fact that @bengl had to ask in IRC about this) it's not necessarily obvious to newcomers.

The whole "whether and how to note non-collaborators who provide significant review" issue is important. But for the onboarding document, that is a bikeshed conversation in comparison to the hole this plugs.

@Trott
Copy link
Member

Trott commented Jun 16, 2016

@bengl: Maybe remove the word Only so it says: include collaborators who have commented "LGTM"? That would accommodate the apparent diversity of opinion about whether non-collaborators should be included and how.

I'd also consider moving it to the first thing in that bulleted list.

jasnell pushed a commit that referenced this pull request Aug 5, 2016
As per conversation with @Trott, make it clear that Reviewed-By lines
should only be added for collaborators who've actually put a LGTM on the
PR.

PR-URL: #7183
Reviewed-By: Myles Borins <[email protected]>
Reviewed-By: Evan Lucas <[email protected]>
Reviewed-By: Colin Ihrig <[email protected]>
Reviewed-By: James M Snell <[email protected]>
Reviewed-By: JacksonTian - Jackson Tian <[email protected]>
@jasnell
Copy link
Member

jasnell commented Aug 5, 2016

Landed as is in 5d6d3ee. @Trott, i know you had some additional suggestions but those can be handled in a separate PR.

@jasnell jasnell closed this Aug 5, 2016
@@ -169,6 +169,7 @@ Landing a PR
* `Reviewed-By: human <email>`
* Easiest to use `git log` then do a search
* (`/Name` + `enter` (+ `n` as much as you need to) in vim)
* Only include collaborators who have commented "LGTM"
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Does CTC members should be included as well?

Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Yes, certainly. All of the ctc members are also collaborators.

On Saturday, August 6, 2016, Yorkie Liu [email protected] wrote:

In doc/onboarding.md
#7183 (comment):

@@ -169,6 +169,7 @@ Landing a PR
* Reviewed-By: human <email>
* Easiest to use git log then do a search
* (/Name + enter (+ n as much as you need to) in vim)

  •  \* Only include collaborators who have commented "LGTM"
    

Does CTC members should be included as well?


You are receiving this because you modified the open/close state.
Reply to this email directly, view it on GitHub
https://github.com/nodejs/node/pull/7183/files/f645b4c8da57891c7cf5b59987548e87e32479fb#r73786541,
or mute the thread
https://github.com/notifications/unsubscribe-auth/AAa2eXgC6ANpp1R5Da2oSUQu7NEtHcdmks5qdJUvgaJpZM4Ivauh
.

Copy link
Contributor

@yorkie yorkie Aug 6, 2016

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

But currently the CTC members & collaborators are different lists in our README.md#Current Project Team Members, I thought that might have something confused to new comers :-)

Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Oh good point! I hadn't considered that. It might be worthwhile clarifying
that in the readme, I think :)

On Saturday, August 6, 2016, Yorkie Liu [email protected] wrote:

In doc/onboarding.md
#7183 (comment):

@@ -169,6 +169,7 @@ Landing a PR
* Reviewed-By: human <email>
* Easiest to use git log then do a search
* (/Name + enter (+ n as much as you need to) in vim)

  •  \* Only include collaborators who have commented "LGTM"
    

But currently the CTC members & collaborators are different lists in our README.md#Current
Project Team Members
https://github.com/nodejs/node#current-project-team-members, I thought
that might be have something confused to new comers :-)


You are receiving this because you modified the open/close state.
Reply to this email directly, view it on GitHub
https://github.com/nodejs/node/pull/7183/files/f645b4c8da57891c7cf5b59987548e87e32479fb#r73786660,
or mute the thread
https://github.com/notifications/unsubscribe-auth/AAa2eQ5zIYoRSJARismkpHzT-BoE0xn2ks5qdJhUgaJpZM4Ivauh
.

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Oh good point! I hadn't considered that. It might be worthwhile clarifying
that in the readme, I think :)

@jasnell submitted a pull-request #7996 for this.

Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

How about expanding it as well?

  • Only include collaborators who have commented "LGTM" (Looks Good To Me)

yorkie added a commit to yorkie/node that referenced this pull request Aug 8, 2016
inspired by this conversation
nodejs#7183 (comment)

PR-URL: nodejs#7996
Reviewed-By: James M Snell <[email protected]>
Reviewed-By: Rich Trott <[email protected]>
Reviewed-By: Сковорода Никита Андреевич <[email protected]>
Reviewed-By: Evan Lucas <[email protected]>
Reviewed-By: Colin Ihrig <[email protected]>
yorkie added a commit that referenced this pull request Aug 8, 2016
inspired by this conversation
#7183 (comment)

PR-URL: #7996
Reviewed-By: James M Snell <[email protected]>
Reviewed-By: Rich Trott <[email protected]>
Reviewed-By: Сковорода Никита Андреевич <[email protected]>
Reviewed-By: Evan Lucas <[email protected]>
Reviewed-By: Colin Ihrig <[email protected]>
@cjihrig cjihrig mentioned this pull request Aug 8, 2016
cjihrig pushed a commit that referenced this pull request Aug 10, 2016
As per conversation with @Trott, make it clear that Reviewed-By lines
should only be added for collaborators who've actually put a LGTM on the
PR.

PR-URL: #7183
Reviewed-By: Myles Borins <[email protected]>
Reviewed-By: Evan Lucas <[email protected]>
Reviewed-By: Colin Ihrig <[email protected]>
Reviewed-By: James M Snell <[email protected]>
Reviewed-By: JacksonTian - Jackson Tian <[email protected]>
cjihrig pushed a commit that referenced this pull request Aug 10, 2016
inspired by this conversation
#7183 (comment)

PR-URL: #7996
Reviewed-By: James M Snell <[email protected]>
Reviewed-By: Rich Trott <[email protected]>
Reviewed-By: Сковорода Никита Андреевич <[email protected]>
Reviewed-By: Evan Lucas <[email protected]>
Reviewed-By: Colin Ihrig <[email protected]>
@cjihrig cjihrig mentioned this pull request Aug 11, 2016
MylesBorins pushed a commit that referenced this pull request Sep 9, 2016
As per conversation with @Trott, make it clear that Reviewed-By lines
should only be added for collaborators who've actually put a LGTM on the
PR.

PR-URL: #7183
Reviewed-By: Myles Borins <[email protected]>
Reviewed-By: Evan Lucas <[email protected]>
Reviewed-By: Colin Ihrig <[email protected]>
Reviewed-By: James M Snell <[email protected]>
Reviewed-By: JacksonTian - Jackson Tian <[email protected]>
MylesBorins pushed a commit that referenced this pull request Sep 9, 2016
inspired by this conversation
#7183 (comment)

PR-URL: #7996
Reviewed-By: James M Snell <[email protected]>
Reviewed-By: Rich Trott <[email protected]>
Reviewed-By: Сковорода Никита Андреевич <[email protected]>
Reviewed-By: Evan Lucas <[email protected]>
Reviewed-By: Colin Ihrig <[email protected]>
MylesBorins pushed a commit that referenced this pull request Sep 28, 2016
As per conversation with @Trott, make it clear that Reviewed-By lines
should only be added for collaborators who've actually put a LGTM on the
PR.

PR-URL: #7183
Reviewed-By: Myles Borins <[email protected]>
Reviewed-By: Evan Lucas <[email protected]>
Reviewed-By: Colin Ihrig <[email protected]>
Reviewed-By: James M Snell <[email protected]>
Reviewed-By: JacksonTian - Jackson Tian <[email protected]>
MylesBorins pushed a commit that referenced this pull request Sep 28, 2016
inspired by this conversation
#7183 (comment)

PR-URL: #7996
Reviewed-By: James M Snell <[email protected]>
Reviewed-By: Rich Trott <[email protected]>
Reviewed-By: Сковорода Никита Андреевич <[email protected]>
Reviewed-By: Evan Lucas <[email protected]>
Reviewed-By: Colin Ihrig <[email protected]>
rvagg pushed a commit that referenced this pull request Oct 18, 2016
As per conversation with @Trott, make it clear that Reviewed-By lines
should only be added for collaborators who've actually put a LGTM on the
PR.

PR-URL: #7183
Reviewed-By: Myles Borins <[email protected]>
Reviewed-By: Evan Lucas <[email protected]>
Reviewed-By: Colin Ihrig <[email protected]>
Reviewed-By: James M Snell <[email protected]>
Reviewed-By: JacksonTian - Jackson Tian <[email protected]>
rvagg pushed a commit that referenced this pull request Oct 18, 2016
inspired by this conversation
#7183 (comment)

PR-URL: #7996
Reviewed-By: James M Snell <[email protected]>
Reviewed-By: Rich Trott <[email protected]>
Reviewed-By: Сковорода Никита Андреевич <[email protected]>
Reviewed-By: Evan Lucas <[email protected]>
Reviewed-By: Colin Ihrig <[email protected]>
MylesBorins pushed a commit that referenced this pull request Oct 26, 2016
As per conversation with @Trott, make it clear that Reviewed-By lines
should only be added for collaborators who've actually put a LGTM on the
PR.

PR-URL: #7183
Reviewed-By: Myles Borins <[email protected]>
Reviewed-By: Evan Lucas <[email protected]>
Reviewed-By: Colin Ihrig <[email protected]>
Reviewed-By: James M Snell <[email protected]>
Reviewed-By: JacksonTian - Jackson Tian <[email protected]>
MylesBorins pushed a commit that referenced this pull request Oct 26, 2016
inspired by this conversation
#7183 (comment)

PR-URL: #7996
Reviewed-By: James M Snell <[email protected]>
Reviewed-By: Rich Trott <[email protected]>
Reviewed-By: Сковорода Никита Андреевич <[email protected]>
Reviewed-By: Evan Lucas <[email protected]>
Reviewed-By: Colin Ihrig <[email protected]>
@MylesBorins MylesBorins mentioned this pull request Oct 26, 2016
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
doc Issues and PRs related to the documentations. meta Issues and PRs related to the general management of the project.
Projects
None yet
Development

Successfully merging this pull request may close these issues.