This term is at
https://rollingedition.com/language-models-from-the-ground-up/glossary#dpo-loss
.