berkeley-nest/Nectar
Viewer • Updated • 183k • 1.4k • 295
LM Preference datas
-
-
mlabonne/chatml_dpo_pairs
Viewer • Updated • 12.9k • 69 • 55 -
HuggingFaceH4/ultrachat_200k
Viewer • Updated • 515k • 69.1k • 726 -
Intel/orca_dpo_pairs
Viewer • Updated • 12.9k • 1.84k • 322 -
argilla/ultrafeedback-binarized-preferences-cleaned
Viewer • Updated • 60.9k • 15.1k • 162 -
argilla/distilabel-math-preference-dpo
Viewer • Updated • 2.42k • 3.81k • 88 -
PKU-Alignment/PKU-SafeRLHF
Viewer • Updated • 164k • 13.9k • 187 -
lvwerra/stack-exchange-paired
Viewer • Updated • 31.3M • 2k • 150 -
Anthropic/hh-rlhf
Viewer • Updated • 169k • 38.5k • 1.77k -
jondurbin/truthy-dpo-v0.1
Viewer • Updated • 1.02k • 719 • 136 -
neovalle/H4rmony
Viewer • Updated • 2.02k • 74 • 15 -
peiyi9979/Math-Shepherd
Viewer • Updated • 445k • 1.02k • 103 -
nvidia/HelpSteer
Viewer • Updated • 37.1k • 1.94k • 249 -
argilla/dpo-mix-7k
Viewer • Updated • 7.5k • 1.06k • 173 -
microsoft/ms_marco
Viewer • Updated • 1.11M • 19k • 242 -
openbmb/UltraInteract_sft
Viewer • Updated • 289k • 1.26k • 127 -
allenai/olmo-2-0325-32b-preference-mix
Updated • 173 • 15 -
PrimeIntellect/SYNTHETIC-2-Base-Answer-Critique
Viewer • Updated • 50k • 10 • 2