Commits on Aug 14, 2024

1. Refactor implements to support secondary dispatch …

   Summary:
   Some popular ops like linear will get a lot of implementations based on
   the different characteristics of input and weight, e.g. int8 act + int8 weight, int8 act + int4 weight
   etc. For `AffineQuantizedTensor` rigth now all of these implementations are added to the main body of the implementation of linear dispatch, this makes the code hard to read and extend. In this PR we supported
   a secondary dispatch condition check for `implements` function:
   
   ```
   def disptch_condition(func, types, args, kwargs):
       ...
   
   @implements(torch.nn.functional.linear, dispatch_condition)
   def _(func, types, args, kwargs):
       # implementation for inputs that passes the dispatch_condition
       ...
   
   @implements(torch.nn.functional.linear)
   def _(func, types, args, kwargs):
       ...
   ```
   
   Test Plan:
   regression tests
   python test/quantization/test_quant_api.py
   python test/integration/test_integration.py
   
   python tutorials/quantize_vit/run_vit_b_quant.py
   
   Reviewers:
   
   Subscribers:
   
   Tasks:
   
   Tags:

   

   jerryzh168 committed Aug 14, 2024
   Configuration menu

   • View commit details
   • Copy full SHA for b4ee5c0
   • Browse repository at this point

   Copy the full SHA

   b4ee5c0 View commit details

   Browse the repository at this point in the history