Skip to content

Pull requests: huggingface/trl

New pull request New
Clear current search query, filters, and sorts
75 Open 2,166 Closed
75 Open 2,166 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Assigned to nobody Loading
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

🐯 [Liger] add native liger-kernel ORPO loss
#2482 opened Dec 15, 2024 by kashif Loading…
21
[Liger] Integrate Liger CPO & SimPO
#2506 opened Dec 20, 2024 by Mecoli1219 Loading…
1 of 6 tasks
4
Add special token to PRM vocabulary if not present
#2646 opened Jan 24, 2025 by plaguss • Draft
5 tasks
5
GRPOTrainer adds support for OpenAI API-compatible servers to models that generate samples
#2901 opened Feb 19, 2025 by ZYM66 • Draft
2 of 5 tasks
6
Add the metrics completion_length_max and completion_length_min
#2930 opened Feb 22, 2025 by dignfei Loading…
4 tasks
4
Support ReMax Algorithm
#2955 opened Feb 25, 2025 by liziniu Loading…
3 tasks done
8
Fixing GRPO reward_func being a model with DeepSpeed ZeRO-3
#2984 opened Feb 28, 2025 by jamesbraza Loading…
4
[WIP] Iterative training scripts for SPIN and SPPO
#3011 opened Mar 5, 2025 by jkx19 • Draft
3 of 5 tasks
[WIP] PEFT 🤝 Liger DPO
#3065 opened Mar 12, 2025 by SalmanMohammadi • Draft
5 tasks
2
🚀 Enhance GRPO VLLM server from sync to async and accelerate training
#3182 opened Mar 30, 2025 by binary-husky Loading…
5
GRPO: Scalable training with one LLM/node
#3186 opened Mar 31, 2025 by jglaser Loading…
3 of 5 tasks
5
Support for Models With Pre-Finetuned LoRA Adapters in GRPO: Add use_peft_as_reference Flag
#3196 opened Mar 31, 2025 by LoganVegnaSHOP Loading…
5 tasks done
1
7
Support iterable datasets in GRPO
#3226 opened Apr 3, 2025 by wilrop Loading…
5 tasks
1
12
Add a raw generate API to the vLLM server
#3227 opened Apr 3, 2025 by wilrop Loading…
5 tasks
4
add vllm support for token ids as input
#3280 opened Apr 11, 2025 by wybryan Loading…
4
Allow for saving the PPOTrainer value model (critic model)
#3308 opened Apr 16, 2025 by AMindToThink Loading…
[Feat] Suppport SGLang as rollout engine of GRPO trainer
#3370 opened Apr 27, 2025 by ryang-max Loading…
2 of 8 tasks
26
Reintroduce generate method for PPOTrainer
#3374 opened Apr 27, 2025 by CloseChoice Loading…
4 tasks done
5
Fix GRPO/DAPO/Dr.GRPO documentation: formula corrections and KL divergence clarification
#3395 opened Apr 30, 2025 by JenWei0312 Loading…
1 of 5 tasks
10
Reintroducing step method in ppo_trainer
#3410 opened May 3, 2025 by jskaf34 Loading…
2 of 5 tasks
1
@shirinyamani
5
Fix logging docs
#3447 opened May 14, 2025 by xingyaoww • Draft
2 of 5 tasks
1
Add async tool-enabled vLLM server for GRPO training via OpenAI-compatible interface
#3469 opened May 19, 2025 by BjarniHaukur Loading…
5 tasks
1
2
Allow an user to train from a local dataset
#3470 opened May 19, 2025 by gogo2464 Loading…
1 of 5 tasks
30
[GKD] Use vllm for the student model
#3475 opened May 21, 2025 by kashif Loading…
5 tasks
11
[GRPO] Pad per minibatch instead of per generation batch
#3495 opened May 26, 2025 by edbeeching • Draft
3 tasks
18
ProTip! Type g p on any issue or pull request to go back to the pull request listing page.