Side-by-side comparison

ByteDance's flexible reinforcement learning library for LLM post-training (PPO, GRPO) at scale.

Fast, memory-efficient LoRA/QLoRA fine-tuning and RL for open LLMs on a single consumer GPU.

Unified fine-tuning toolkit with a web UI supporting 100+ LLMs and VLMs across SFT, DPO and more.

Hugging Face library for post-training LLMs with SFT, DPO, GRPO and other RL-based methods.