tiiuae

/

falcon-mamba-7b-instruct

like 52

There is an open issue to add FalconMamba support for GGUF: https://github.com/ggerganov/llama.cpp/issues/9009, we will push GGUF models as soon as there is a llama.cpp support for this architecture!

llama.cpp support is coming soon :) https://github.com/ggerganov/llama.cpp/pull/9074

We just added GGUF support, please check out all checkpoints here: https://huggingface.co/collections/tiiuae/falconmamba-7b-66b9a580324dd1598b0f6d4a