AQAvit Meeting Feb 24, 2021

[smlambert]

AQAvit Meeting Feb 24, 2021
Wednesday, Feb 24 11:30am – 12:00pm EST (+5hrs for Hursley/London)
Description: Bi-weekly meeting to discuss AdoptOpenJDK Quality Assurance (AQA) topics.

Join with Google Meet
meet.google.com/pbn-ijez-avs

Proposed Agenda:

• Halfway through the term, let's check in with the CanOSP W21 work (Canadian university students from the Canada Open-source Projects program) whose focus in this Winter 2021 term is on delivering change-based testing solutions and automated workflows - @AdoptOpenJDK/canosp_w21 @llxia @sophia-guo

Completed:

• comment-triggered workflow (Add comment-triggered PR build action #2222) - @Icohedron
• directory-changed workflow (Add certain directories trigger for PR/push testing #2241 and Workflow job triggered by a change to the buildenv directory #2204) - @xichen1, @patkarns, @xfxcwynlc
• jcov utilities investigation, resurrection of jcov jobs (Re-enable code coverage testing #2205) - @sophia-guo @yanshan24

Near-term:

• Tweaks/enhancements to newly added workflows:
  • comment-triggered workflow enhancments (Comment triggered PR builds enhancements #2296)
  • directory-changed workflow updates:
    • Use correct openjdk_testRepo (Workflow directoriesFilesChangePR.yml failed with the wrong openjdk_testRepo #2291)
    • Update trigger (not just for 'ready to review' events, Revisions and improvements to PR workflows #2299)
• renaissance benchmark:
  • update version (Update Renaissance suite to latest release v0.11.0 #2298)
  • visualization (Add Renaissance widget to Dashboard aqa-test-tools#366)
• diffcoverage PR review helper workflow (Investigate the diffCoverage story for JDK #2297)

---

• Heads up, to improve clarity, updating playlist tag from subset to version (Convert subset to version TKG#152) - @renfeiw
• AOB

[smlambert]

Minutes essentially track the agenda above quite closely.

Additional questions asked:

• how to know what are proper parameters for using the comment triggered test workflow? answer: type "run aqa -h" or "run aqa -simon" and it will return with Usage (and an error that it can not recognize parameter "simon"
• for jcov & diffcoverage workflow, what about changes to GC classes, where all tests hit them, where does that leave us? answer: for those cases, it leaves us where we currently are, running a large set of tests against a PR. There are some PRs where this will be unavoidable, but other PRs where a great reduction of testing may be seen
  • will we track this to see what kind of reduction of testing we see per PR? answer: we will have the ability to track it (as the testlist will be present in the console output and at the end of a run in the TKG summary
• as the TRSS widget enhancements mentioned may be more detailed than this dashboard issue, should we close the dashboard issue? answer: yes, we can reference it in the other item and close it (less duplicate or near-duplicate issues is best)

Recording link for Feb 24, 2021 meeting

Thanks for @Icohedron and @xfxcwynlc for joining, and for the workflow updates. I will also note that students are spread across many timezones (some not feasible to attend this meeting), and students have other classes to attend during the term). We are very fortunate to be working with such a great group of dedicated students, thanks @AdoptOpenJDK/canosp_w21 team!! Looking forward to seeing all that can be accomplished in the upcoming last half of the term!

[smlambert]

Next meeting (March 10, 2021) - Details and proposed agenda at #2306