Any recommendations for fine-tuning on two 40GB A100s?
#31
by
omarabb315
- opened
Can I fine tune the model on two A100 GPUs with 40GB each?
Yes, that should be possible! Hugging Face has a few tutorials on fine-tuning - https://huggingface.co/docs/transformers/v4.44.2/training and https://huggingface.co/docs/peft/en/index can be a good starting point.
alexrs
changed discussion status to
closed