Release Upper Limit on Torch, Transformers, Accelerate, and Others

[fabianlim]

Currently the torch dependency in framework is upper bounded as "< 2.3", however in accelerate versions has problems supporting torch 2.2. The latest numpy versions (>=2.0) also has incompatibilities with the current torch version and is bounded here in #42. Hence, we should consider releasing the upper bound soon.

Also can consider releasing the upper limit on transformers and accelerate

[fabianlim]

we found out there is really no need to upper bound this torch dependency, as for us we are getting stuck only beause of this commit pytorch/pytorch#121635.

• so the workaround for us can be just to downgrade to nvidia-nccl-cu12==2.19.3 Update: This is due to a NCCL_BUFFSIZE wrong setting.

Also for transformers, we just have to be weary of the sliding window mask issue of SPDA, and keep track of it to see when it will be fixed.

[fabianlim]

FMS has fixed the TRL issue foundation-model-stack/fms-hf-tuning#213

[fabianlim]

I think we need a lower limit on the bitsandbytes version that supports quant_storage. I have encourted that 0.41 didnt work, but 0.43 is ok.

Update: we also upper bound to 0.43.1 now as we encounted seg problems with the newer verisions. It could be that newer versions have certain CUDA or torch dependencies

[achew010]

GPTQModel has a lower bound on transformers here but framework is bounded at transformers<4.40. This discrepancy should be resolved.

[fabianlim]

We have removed the upper bound on transformers in #58