Hugging Face's logo

01-ai
/
Yi-Coder-9B-Chat

Text Generation
Transformers
Safetensors
llama
conversational
text-generation-inference
Inference Endpoints
Model card Files Community
11

Autocomplete?

#5
by wcde - opened
Discussion
wcde

It is support FIM-compatible autocomplete? I don't see any FIM tokens in tokenizer. With generic chat/instruct template autocomplete obviously doesn't work.

CISCai

There are FIM tokens (see my GGUFs), however they do not appear to have been used during training as they are not giving very good results, and only with SPM infill, which might suggest the model is just doing regular generation continuation.

lorinma
 01-ai org

yup, it's not very good at FIM tasks because it has some negative effects during training, thus we didn't talk about it in our blog and README. Something we'll need to figure out

Sign up or log in to comment