Edit model card

StableLM-2-Zephyr-1.6B-GGUF

Original Model

stabilityai/stablelm-2-zephyr-1_6b

Run with Gaianet

Prompt template:

prompt template: llama-2-chat

Context size:

chat_ctx_size: 4096

Run with GaiaNet:

Downloads last month
74
GGUF
Model size
1.64B params
Architecture
stablelm

5-bit

Inference Examples
Inference API (serverless) is not available, repository is disabled.

Model tree for gaianet/stablelm-2-zephyr-1.6b-GGUF

Quantized
this model

Datasets used to train gaianet/stablelm-2-zephyr-1.6b-GGUF