Reward Model Ensembles Help Mitigate Overoptimization
Paper
•
2310.02743
•
Published
•
1
1.4b Pythia model after SFT on the AlpacaFarm dataset 'sft' split.
Policy model from 'Reward Model Ensembles Mitigate Overoptimization'