GPTQ 4 bit 128 groupsize quantization of https://huggingface.co/digitous/13B-HyperMantis
- Downloads last month
- 25
Inference API (serverless) is not available, repository is disabled.
GPTQ 4 bit 128 groupsize quantization of https://huggingface.co/digitous/13B-HyperMantis