You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
We need a perf measure comparing calling methods with and without input validation, to demonstrate that using the method schemas will not cause significant slowdown.
Ideally we'd do this w/o relying on end-to-end testing, because there is so much machinery involved it can be difficult to tell what the impact is.
The text was updated successfully, but these errors were encountered:
Tartuffo
changed the title
Determine performance impact of Method Schemas implementation
Determine performance impact of enforcing Method Schemas
Aug 31, 2022
We need a perf measure comparing calling methods with and without input validation, to demonstrate that using the method schemas will not cause significant slowdown.
This is not a sensible comparison. We should compare methods using interface guards for input validation vs methods that do input validation themselves with manually written code. No matter what the perf says, we do not have the option of exposing methods that are not doing input validation somehow.
If you can make the code-under-test self-contained enough to survive bundleSource, then we can build a harness to run it under XS (but outside of a vat: no SwingSet). I think that will give us the most meaningful results.
Regarding our desire to benchmark manual input validation vs pattern-based input validation, #6114 (comment) is an extreme but realistic example. All the input validation it did was mandatory.
We need a perf measure comparing calling methods with and without input validation, to demonstrate that using the method schemas will not cause significant slowdown.
Ideally we'd do this w/o relying on end-to-end testing, because there is so much machinery involved it can be difficult to tell what the impact is.
The text was updated successfully, but these errors were encountered: