This section is at https://rollingedition.com/small-open-models/quantize-and-measure#keep-the-score-head-in-float32.