Freezing at AutoModelForSeq2SeqLM function call
#20
by
mrwalters
- opened
I am running the sample code given on the model card tab. However, whenever I run it freezes at this line and then stops without any exceptions or errors. Is there another way I can load the model? Or could there be something wrong with my system configuration?
Stops at this line:
aya_model = AutoModelForSeq2SeqLM.from_pretrained(checkpoint)
Probably the same issue as on here: https://huggingface.co/CohereForAI/aya-101/discussions/7
The issue is with a lack of RAM memory to load the 46 GB model.