adds `hidden_act` to config to bring parity with gemma-2-2b
#18
by
scale-ai-service-acct
- opened
We are seeing errors when trying to run completions, specifically:
[rank0]: AttributeError: 'Gemma2Config' object has no attribute 'hidden_act'. Did you mean: 'hidden_size'?
which should be addressed by adding this field. The field is present in the gemma-2-2b config : https://huggingface.co/google/gemma-2-2b/blob/main/config.json
Thanks for the fix. That said, we do not recommend using ShieldGemma for completions, only for scoring.
RyanMullins
changed pull request status to
merged