google

/

gemma-2-9b

like 552

Hi @AsirAsir , Please provide some more details on the issue like which environment you are using or reproducible code to replicate the error. Thank you

@AsirAsir this worked for me pip install --upgrade torch torchvision torchaudio

@gpu-poor Please share your torch version

@ccbbdd torch==2.4.0

Have you been able to find any different solutions for this topic instead of upgrading torch?

What we need is torch.version >= 2.3.0, because the newer transformers use cache_utils.py which include torch._dynamo.