Skip to content

Pull requests: huggingface/trl

New pull request New
104 Open 2,810 Closed
104 Open 2,810 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Assigned to nobody Loading
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

Clean up model update group on worker exit
#5325 opened Mar 20, 2026 by AmineDiro Loading…
5 tasks
4
Support multimodal tool responses in environment_factory for VLM training
#5323 opened Mar 20, 2026 by sergiopaniego • Draft
5 tasks
1
(5/5) async grpo metrics
#5322 opened Mar 20, 2026 by AmineDiro Loading…
6
(4/5) async grpo break out of generation loop (is_done)
#5321 opened Mar 20, 2026 by AmineDiro Loading…
4
(3/5) Cancel Stale inflight tasks
#5320 opened Mar 20, 2026 by AmineDiro Loading…
4
(1/5) Add callback to sync weights before training begins
#5319 opened Mar 20, 2026 by AmineDiro Loading…
4
(2/5) Refactor RolloutCompletion in Async Rollout Worker
#5318 opened Mar 20, 2026 by AmineDiro Loading…
4
Expand the list of attention implementations compatible with packing
#5316 opened Mar 19, 2026 by mariosasko Loading…
1 of 5 tasks
Add truncation to SFT DataCollatorForLanguageModeling
#5315 opened Mar 19, 2026 by albertvillanova Loading…
7
fix: fix a bug in vLLM weight synchronization when vllm_enable_sleep_mode=True
#5313 opened Mar 19, 2026 by muupan Loading…
1 of 5 tasks
1
4
Show conversations instead of decoded text in the completions table
#5309 opened Mar 19, 2026 by qgallouedec Loading…
7
Add support for logging extra columns in reward functions and update related tests
#5308 opened Mar 19, 2026 by qgallouedec Loading…
4
fix: skip ref adapter when peft config uses target_parameters
#5292 opened Mar 16, 2026 by gambletan Loading…
3 tasks
1
2
docs: clarify PPO entropy metrics in PPO trainer docs
#5289 opened Mar 14, 2026 by biefan Loading…
1
Add reference to DeepSeekMath in accuracy_reward docstring
#5287 opened Mar 13, 2026 by qgallouedec Loading…
5 tasks
4
Add Cursor rules from AGENTS.md
#5280 opened Mar 12, 2026 by qgallouedec Loading…
8
Add Nemotron 3 to tests via tiny model
#5278 opened Mar 12, 2026 by sergiopaniego Loading…
5 tasks
11
Centralize AI agent templates in .ai
#5268 opened Mar 10, 2026 by qgallouedec Loading…
5
Introduce backend rollout-completions interface and decouple OpenEnv helper from vLLM internals
#5256 opened Mar 10, 2026 by rycerzes Loading…
1
2
async streaming grpo w prefetch
#5250 opened Mar 9, 2026 by winglian Loading…
5 tasks
6
batch params together in weight sync and async update the weights
#5249 opened Mar 9, 2026 by winglian Loading…
5 tasks
5
Introduce minimal generation backend interface for GRPO and RLOO trainers
#5244 opened Mar 8, 2026 by rycerzes Loading…
1
6
feat: log raw importance ratios and fraction of truncation/masking in vLLM importance sampling correction
#5243 opened Mar 8, 2026 by muupan Loading…
1 of 5 tasks
1
5
Update openenv examples to use environment_factory
#5235 opened Mar 6, 2026 by sergiopaniego Loading…
3 of 8 tasks
15
vLLM Server Sync via LoRA Adapter Reload (avoid merge + full weight sync) for GRPO
#5188 opened Feb 26, 2026 by lfranceschetti Loading…
2
1
ProTip! Find all pull requests that aren't related to any open issues with -linked:issue.