[i will merge] Upgrade python version to 3.9

[msaroufim]

We're trying to upgrade from 3.8 to a more modern Python version to use some newer features like

• https://medium.com/@aniscampos/python-dataclass-inheritance-finally-686eaf60fbb5 in 3.10
• and StrEnum in 3.11

3.8 is reaching EOL imminently so we must upgrade to at least 3.9 https://devguide.python.org/versions/

If we were to do what PyTorch does we'd simply upgrade to 3.9 and try to avoid using 3.10+ features pytorch/rfcs#65

Upgrading to 3.9
This also works and is probably the least controversial thing to merge

Upgrading to 3.10
This just works, CI is green so we can merge this PR as is

Upgrading to 3.11
This made the dora optimizer crash - cc @jeromeku in case you're interested

  FAILED test/dora/test_dora_fusion.py::test_dora_column_norm[4096x4096x16-False-True-True-True-torch.float32] - AttributeError: 'CudaDriver' object has no attribute 'active'
  FAILED test/dora/test_dora_fusion.py::test_dora_column_norm[4096x4096x16-False-True-True-True-torch.float16] - AttributeError: 'CudaDriver' object has no attribute 'active'
  FAILED test/dora/test_dora_fusion.py::test_dora_column_norm[4096x4096x16-False-True-True-True-torch.bfloat16] - AttributeError: 'CudaDriver' object has no attribute 'active'
  FAILED test/dora/test_dora_fusion.py::test_dora_matmul[512x4096x4096-torch.float32-True-True] - triton.compiler.errors.CompilationError: at 69:29:            _0 = tl.zeros((1, 1), dtype=C.dtype.element_ty)
              a = tl.load(A, mask=rk[None, :] < k_remaining, other=_0)
              b = tl.load(B, mask=rk[:, None] < k_remaining, other=_0)
          if AB_DTYPE is not None:
              a = a.to(AB_DTYPE)
              b = b.to(AB_DTYPE)
          if fp8_fast_accum:
              acc = tl.dot(
                  a, b, acc, out_dtype=acc_dtype, input_precision=input_precision
              )
          else:
              acc += tl.dot(a, b, out_dtype=acc_dtype, input_precision=input_precision)
                               ^
  TypeError("dot() got an unexpected keyword argument 'input_precision'")
  FAILED test/dora/test_dora_fusion.py::test_dora_matmul[512x4096x4096-torch.float16-True-True] - triton.compiler.errors.CompilationError: at 69:29:            _0 = tl.zeros((1, 1), dtype=C.dtype.element_ty)
              a = tl.load(A, mask=rk[None, :] < k_remaining, other=_0)
              b = tl.load(B, mask=rk[:, None] < k_remaining, other=_0)
          if AB_DTYPE is not None:
              a = a.to(AB_DTYPE)
              b = b.to(AB_DTYPE)
          if fp8_fast_accum:
              acc = tl.dot(
                  a, b, acc, out_dtype=acc_dtype, input_precision=input_precision
              )
          else:
              acc += tl.dot(a, b, out_dtype=acc_dtype, input_precision=input_precision)
                               ^
  TypeError("dot() got an unexpected keyword argument 'input_precision'")
  FAILED test/dora/test_dora_fusion.py::test_dora_matmul[512x4096x4096-torch.bfloat16-True-True] - triton.compiler.errors.CompilationError: at 69:29:            _0 = tl.zeros((1, 1), dtype=C.dtype.element_ty)
              a = tl.load(A, mask=rk[None, :] < k_remaining, other=_0)
              b = tl.load(B, mask=rk[:, None] < k_remaining, other=_0)
          if AB_DTYPE is not None:
              a = a.to(AB_DTYPE)
              b = b.to(AB_DTYPE)
          if fp8_fast_accum:
              acc = tl.dot(
                  a, b, acc, out_dtype=acc_dtype, input_precision=input_precision
              )
          else:
              acc += tl.dot(a, b, out_dtype=acc_dtype, input_precision=input_precision)
                               ^
  TypeError("dot() got an unexpected keyword argument 'input_precision'")

[pytorch-bot]

🔗 Helpful Links

🧪 See artifacts and rendered test results at hud.pytorch.org/pr/pytorch/ao/488

• 📄 Preview Python docs built from this PR

Note: Links to docs will display an error until the docs builds have been completed.

✅ No Failures

As of commit 7e2c6bc with merge base 12ac498 ():
💚 Looks good so far! There are no failures yet. 💚

This comment was automatically generated by Dr. CI and updates every 15 minutes.

[msaroufim]

FYI @ebsmothers for now just decided to drop 3.8, I think we will end up being conservating with upgrading python versions but will revisit with the rest of the ao team if this ends up being a controversial decisision