Efficient Exact Optimization
Collection
SFT & Reward Models used in the experiments of the ICML 2024 paper "Towards Efficient Exact Optimization of Language Model Alignment"
•
2 items
•
Updated
Towards Efficient Exact Optimization of Language Model Alignment
model: exo-imdb-sft-model
- Finetuned from model: gpt2-large
dataset: imdb (original stanford version)
SFT model used in the imdb experiment of the ICML'24 paper Towards Efficient Exact Optimization of Language Model Alignment.
For details of the dataset, training and inference of this model, please refer to https://github.com/haozheji/exact-optimization/blob/main/exp/imdb_exp/README.md
- Downloads last month
- 1
Inference API (serverless) is not available, repository is disabled.