Install¶
Unsloth.ai¶
On GPSC7
- Set proxies(http and https) and correct
tmp
directories in.profile
nrc_profile.sh -c
: To update the profile- Created user directory and set symlinks for
.cache
and.conda
conda create --name unsloth_env python=3.10
source activate unsloth_env
: I didn't load moniconda module because that was introducing python 3.9 in the system path and I was not able to remove it.conda install pytorch-cuda=12.1 pytorch cudatoolkit xformers -c pytorch -c nvidia -c xformers
pip install "unsloth[colab-new] @ git+https://github.com/unslothai/unsloth.git"
pip install --no-deps trl peft accelerate bitsandbytes
- I still got torch not found error, even though Step 7 was successful, so I just reinstalled it and then it worked.
- Launch jupyter in a job with
partition=gpu_a100
,account=nrc_ict__gpu_a100
andqos=low