Edit model card

license: cc-by-nc-4.0

Project Baize


What's Baize?

Baize is an open-source chat model fine-tuned with LoRA. It uses 100k dialogs generated by letting ChatGPT chat with itself. We also use Alpaca's data to improve its performance. This repo contains 13B model.

Why it's called Baize?

Baize (白泽) is a mythical creature in Chinese folklore, who speaks human languages and knows everything. This is exactly what we expect from a chat model.

Training Parameters

  • Base Model: LLaMA-13B
  • Training Epoch: 1
  • Batch Size: 64
  • Maximum Input Length: 512
  • Learning Rate: 1e-4
  • LoRA Rank: 8
  • Updated Modules: All Linears

Training Dataset

More details can be found in the Baize GitHub

Downloads last month

-

Downloads are not tracked for this model. How to track
Inference API
Unable to determine this model's library. Check the docs .