Skip to content

Pull requests: huggingface/trl

New pull request New
92 Open 2,419 Closed
92 Open 2,419 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Assigned to nobody Loading
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

fix(grpo-trainer): init self.args before use
#4801 opened Jan 9, 2026 by carlyou Loading…
1 of 5 tasks
1
Remove DbrxForCausalLM support
#4799 opened Jan 9, 2026 by qgallouedec Loading…
1
Monkey patch for HybridCache in Liger-Kernel with transformers v5
#4798 opened Jan 9, 2026 by qgallouedec Loading…
1
Updat examples to new OpenEnv version
#4796 opened Jan 9, 2026 by sergiopaniego • Draft
5 tasks
forward_masked_logits in SFTTrainer
#4794 opened Jan 8, 2026 by qgallouedec • Draft
5 tasks
1
Refactor KTO coordinated with DPO [a/N]: Remove encoder-decoder support
#4792 opened Jan 8, 2026 by albertvillanova Loading…
9
Temporarily Work Around init_communicator self.device Initialization Failure with vLLM-Ascend Server and TRL 0.26.2 in Training
#4789 opened Jan 8, 2026 by ShareableXue Loading…
1
Refactor KTO [3/N]: Extract dataset processing to _prepare_dataset method
#4788 opened Jan 8, 2026 by albertvillanova Loading…
3
Refactor KTO [2/N]: Improve config validation in KTOConfig
#4787 opened Jan 8, 2026 by albertvillanova Loading…
4
add support for GDPO: Group reward-Decoupled Normalization Policy Optimization for Multi-reward RL Optimization
#4785 opened Jan 7, 2026 by nbasyl Loading…
3
fix xpu vllm client server
#4780 opened Jan 7, 2026 by jiqing-feng Loading…
1
Set dtype default to float32
#4778 opened Jan 6, 2026 by albertvillanova Loading…
3
Add reward shaping to PPOTrainer
#4774 opened Jan 5, 2026 by derivative2002 Loading…
5 tasks
1
make dpo compatible with qwen3vl
#4773 opened Jan 4, 2026 by flutist Loading…
7
feat(sft): add generation-based evaluation support to SFTTrainer
#4768 opened Jan 2, 2026 by CodersAcademy006 Loading…
1
2
Add a config to limit the number of tool calling iterations.
#4761 opened Dec 29, 2025 by pramodith Loading…
4 of 5 tasks
1
1
Extend CLI to orpo trainer
#4757 opened Dec 27, 2025 by murilo-cunha Loading…
3 of 5 tasks
fix: handle None eval_dataset in example code
#4756 opened Dec 27, 2025 by ciaoyizhen Loading…
1 of 4 tasks
1
perf: avoid output_hidden_states when only last_hidden_state is used
#4755 opened Dec 27, 2025 by ciaoyizhen Loading…
2 of 5 tasks
1
vllm parameter passthrough for stop sequences
#4754 opened Dec 26, 2025 by kdubovikov Loading…
1
Fix GRPO scale_rewards type specification to fix __post_init__ validation
#4752 opened Dec 26, 2025 by apalmas-saifh Loading…
1 of 5 tasks
1
Clarify Accelerate usage in SFTTrainer documentation
#4744 opened Dec 23, 2025 by Likhita-17 Loading…
1 task done
2
fix minillm trainer
#4743 opened Dec 23, 2025 by t1101675 Loading…
5 tasks
3
[GRPOTrainer]: Agent Training Supports Async Tool Calls
#4742 opened Dec 23, 2025 by pramodith Loading…
5 tasks done
9
feat: Bidirectional masked importance sampling ratio (MIS) for IcePop
#4732 opened Dec 20, 2025 by casinca Loading…
5 tasks
5
ProTip! no:milestone will show everything without a milestone.