The 120B Model Learned the Bad Parts Too
More capacity did not repair the old GLaDOS corpus; it reproduced its shortcuts more convincingly.
Continue reading// THE BLOG
Training
Why 95.75% Reward Accuracy Hid a Bad Model
The preference evaluation looked excellent while the archived model had learned that refusing could sound very much like GLaDOS.
Continue readingNo posts on this page match that filter.