-
Notifications
You must be signed in to change notification settings - Fork 90
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Filter (all tests) by failure message #462
Comments
@mdittmer - can you confirm whether the |
I can't say for certain, but in multiple discussions with @mdittmer I recall the answer being no. |
No. And it'd either increase our memory requirement by several magnitudes or decrease the number of runs in the cache by several magnitudes. |
FWIW, failure messages were included in my experiment fitting all runs into a few GB of memory. |
This would have come in handy in web-platform-tests/wpt#20036 (comment). |
Actually, it's probably about once a week that I find I'd want this but because I know it doesn't work I just move on. Another case today was web-platform-tests/wpt#20109, where I submitted a PR mostly to understand which tests had the subtests in question. I could have just searched by subtest name if it was possible. @stephenmcgruer FYI in case you also find a recurring need for this. |
In https://adam.orphis.net/~orphis/wpt.html @Orphis built in the ability to filter tests by failure messages, as "Output filter". wpt.fyi should be able to do this, for example searching for "message:TypeError" (strawman!) at the root level should filter to tests where that shows up in the output, such as:
https://wpt.fyi/results/webrtc/RTCRtpParameters-codecs.html?sha=6aef6676d2&label=stable (in Chrome + Edge)
This issue is very similar to #81, but that is about making search work on the results page for a specific tests, while this is about searching for tests that fail in a certain way.
The text was updated successfully, but these errors were encountered: