Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Taskcluster] run Chrome and Firefox beta daily #19212

Closed
wants to merge 1 commit into from

Conversation

foolip
Copy link
Member

@foolip foolip commented Sep 22, 2019

To mitigate #19206.

@foolip
Copy link
Member Author

foolip commented Sep 22, 2019

There are downsides to this:

  • More resources used, and the beta results aren't part of anyone's workflow (every time I try I run into a lack of runs)
  • More work in a single task group, currently if any task fails none of the runs will end up on wpt.fyi

@jgraham
Copy link
Contributor

jgraham commented Sep 23, 2019

I don't mind landing this, but if the beta runs are failing as often as not it seems like some work to address underlying causes (e.g. making us retry network errors) would be worthwhile.

In particular the downside of making stable runs more vunerable to failure seems worrying. I wonder if we should reduce the number of chunks also, now that we have better reliability. That's less overhead and less chance of network errors affecting a subset of chunks.

@foolip
Copy link
Member Author

foolip commented Sep 23, 2019

Yeah, I think improving robustness in the face of network errors would be good and likely would get us beta runs on most weeks. At this point I don't even know what the reliability is, exactly how to set up #14210 isn't clear. If we knew how often each type of run failed and the reasons, it would be easier to make a judgement.

I'll close this in favor of #14210 for now.

@foolip foolip closed this Sep 23, 2019
@foolip foolip deleted the foolip/daily-beta branch September 23, 2019 12:31
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants