Skip to content

Pull requests: huggingface/trl

New pull request New
Clear current search query, filters, and sorts
75 Open 2,166 Closed
75 Open 2,166 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Assigned to nobody Loading
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

[WIP] Iterative training scripts for SPIN and SPPO
#3011 opened Mar 5, 2025 by jkx19 • Draft
3 of 5 tasks
Allow for saving the PPOTrainer value model (critic model)
#3308 opened Apr 16, 2025 by AMindToThink Loading…
Remove attention mask when position ids is returned
#3997 opened Sep 2, 2025 by qgallouedec • Draft
Online-dpo-ben
#4252 opened Oct 10, 2025 by burtenshaw • Draft
5 tasks
[DRAFT] Refactor DPO
#3906 opened Aug 15, 2025 by qgallouedec • Draft
6 tasks
Gold refactor
#4373 opened Oct 29, 2025 by qgallouedec • Draft
5 tasks
Fix logging docs
#3447 opened May 14, 2025 by xingyaoww • Draft
2 of 5 tasks
1
Updated OpenEnv docs
#4418 opened Oct 31, 2025 by sergiopaniego • Draft
8 tasks
Tool call
#4300 opened Oct 18, 2025 by qgallouedec • Draft
5 tasks
[WIP] vllm-server-spec-dec-support
#3643 opened Jun 24, 2025 by shirinyamani Loading…
5 tasks
1
dynamic temperature
#3844 opened Aug 4, 2025 by shirinyamani • Draft
5 tasks
1
ClearML logging of visualization in RewardTrainer evaluation
#3602 opened Jun 16, 2025 by ioverho Loading…
2 of 5 tasks
1
Test in distributed setting
#3902 opened Aug 15, 2025 by qgallouedec Loading…
5 tasks
1
wip - env
#4320 opened Oct 22, 2025 by qgallouedec Loading…
5 tasks
1
feat: Add Multi-Token Prediction (MTP) support to SFTTrainer
#4290 opened Oct 15, 2025 by KLGR123 Loading…
1
GRPO: Pack Responses within the same group.
#3642 opened Jun 24, 2025 by pramodith • Draft
4 of 5 tasks
1
[ALST/Ulysses] Added ALST/Ulysses documentation
#4420 opened Nov 1, 2025 by kashif • Draft
5 tasks
1
[#3647] Fix: Assign default values in the GKDTrainer's constructor only when …
#3851 opened Aug 5, 2025 by seungduk-yanolja Loading…
2 of 5 tasks
1
2
feat: Initial implementation of RePO trainer and components
#3655 opened Jun 26, 2025 by celsowm Loading…
5 tasks
2
Add tip for logging evaluation metrics during regular evaluations
#4367 opened Oct 29, 2025 by cam1llynha Loading…
1
2
Remove FSDP1 support: use FSDP2 exclusively
#4260 opened Oct 11, 2025 by behroozazarkhalili Loading…
2
[WIP] PEFT 🤝 Liger DPO
#3065 opened Mar 12, 2025 by SalmanMohammadi • Draft
5 tasks
2
Fix: ignore precompute_ref_log_probs when use_liger_loss=True
#4008 opened Sep 4, 2025 by ginkyenglee Loading…
5 tasks
2
Create "Talks" subsection
#4414 opened Oct 31, 2025 by sergiopaniego Loading…
5 tasks
2
Use explicit tiny-Qwen2ForCausalLM-2.5 model_id param in CI tests
#4331 opened Oct 23, 2025 by albertvillanova Loading…
2
ProTip! Type g p on any issue or pull request to go back to the pull request listing page.