New options for preference tuning: rpo alpha, logprobs normalization, reference-free, simpo gamma#327

timofeev1995 merged 13 commits into

maintogethercomputer/together-python:mainfrom

egor/dpo-improvementstogethercomputer/together-python:egor/dpo-improvementsCopy head branch name to clipboard