ContextualAI/HALOs

A library with extensible implementations of DPO, KTO, PPO, ORPO, and other human-aware loss functions (HALOs).

Training & fine-tuningPython Apache-2.0 50created 2023-12-03

Stars

909

1-day growth

7-day growth

—

30-day growth

—

Star history

Tracked since 2026-11-13

#alignment#dpo#halos#kto#ppo#rlhf

Top contributors

Not collected yet (contributors job).

ContextualAI/HALOs · AI Repo Stats