Web Platform Tests coverage tracking issue

[lucacasonato]

In #8990 we added a WPT runner, and the entire WPT test suite to the repo. We are now able to run web platform tests. Currently only a very limited amount of tests is enabled, and many tests will fail once we enable testing them. We would like to get more coverage for our built in Web APIs. I have listed all of the suites that are potentially relevant for us below.

• Compression (once we add CompressionStream and DecompressionStream)
• Broadcast Channel API (feat(extensions): Broadcast Channel API #10527)
• Console API (tests(wpt/console): Enables web platform tests for console #9013)
• DOM APIs
  • abort/event.any.js
• Encoding (fix: align Encoding APIs to spec using WPT #9004)
• HR Time
  • monotonic-clock.any.js
  • window-worker-timeOrigin.window.js requires blob URL support for workers
• HTML
  • webappapis/atob
  • webappapis/timers
  • webappapis/microtask-queuing
  • various tests from browsers/the-window-object
• Fetch API (ignore tests related to same site policy, like CORS)
  • Requires relative fetch (feat: Add --location=<href> and globalThis.location #7369)
  • Headers (chore: align Headers to spec #10199)
  • Request (chore: align fetch to spec #10203)
  • Response (chore: align fetch to spec #10203)
  • fetch (chore: align fetch to spec #10203)
• File API
• WHATWG Stream API
• URL API (tests: enable wpt for url #9046)
• User Timing (self.perfomance)
• WebGPU (once we land it)
• WebSockets
• Workers (not the SharedWorker tests)
• WASM

If you would like to enable one of these suites (and fix the resulting issues), please comment on the issue so we don't have multiple people working on the same suites.

[lucacasonato]

I am going to start work on the URL test suite.

[lucacasonato]

I will also take Encoding, because this being correct is a prerequisite for URL.

[nayeemrmn]

I am going to start work on the URL test suite.

If you're interested in looking into it, at some point we really should replace URL's implementation with rust-url since it was literally made for that for Servo/Firefox IIRC.

[lucacasonato]

If you're interested in looking into it, at some point we really should replace URL's implementation with rust-url since it was literally made for that for Servo/Firefox IIRC.

Can you open a new issue?

[tarikeshaq]

Hello! Pretty new here, but I can take the console tests if that's okay. I'll add the test suites and open a PR to see if we'd like to fix any failing tests!

[vishalvibes]

@lucacasonato I would like to add wasm, I am new here, so I may take a little time!

[caspervonb]

So, atob seem to only have a fuzzy html test which should be patched upstream to be js.
I'll try to get it patched upstream and then enable it for us.

Same goes for timers.

[kt3k]

WPT seems having the test cases for DOMExcpetion class at WebIDL/ecmascript-binding/es-exceptions/. I'd like to add it and align the API to the spec.

[satyarohith]

I'm working on WebSockets.

[lucacasonato]

@satyarohith Please hold on that until we merge #9046.

[lucacasonato]

Should enable:

fetch/api/body/formdata.any.js
fetch/api/redirect/redirect-upload.h2.any.html
fetch/api/request/request-structure.any.html
fetch/api/request/request-headers.any.html
fetch/api/request/request-error.any.html
fetch/api/request/request-disturbed.any.html
fetch/api/headers/header-values.any.html
fetch/api/headers/header-values-normalize.any.html
fetch/content-length/api-and-duplicate-headers.any.html
fetch/content-encoding/bad-gzip-body.any.html

[crowlKats]

all tasks besdies webgpu seem to have been addressed, so will close.