Relative Content

Tag Archive for pythonfine-tuningpeft

The issue of bitsandbytes package supporting CUDA 12.4 version

when running the peft fine-tuning program, execute the following code:
model = get_peft_model(model, peft_config)
report errors:
Could not find the bitsandbytes CUDA binary at WindowsPath(‘D:/Users/1/anaconda3/Lib/site-packages/bitsandbytes/libbitsandbytes_cuda124.dll’)
The installed version of bitsandbytes was compiled without GPU support. 8-bit optimizers, 8-bit multiplication, and GPU quantization are unavailable.
The latest bitsandbytes package has been installed, version bitsandbytes-0.43.1
I also checked on GitHub, and the latest version supports CUDA 12.4, but
D:/Users/1/anaconda3/Lib/site-packages/bitsandbytes/
There is still no libbitsandbytes_cuda124.dll in the directory, but there are 117 to 123
Please answer my questions, Gods and Masters. Thank you very much