Search results

Add adapter-only vLLM LoRA sync for GRPO and AsyncGRPO

Status: Open.

#5975 In huggingface/trl;

· rycerzes opened on Jun 8, 2026

RFC: Rollout sources — a unified seam for environment & agent RL

Status: Open.

#5974 In huggingface/trl;

· adithya-s-k opened on Jun 8, 2026

trackio ProfilingContext support

Status: Open.

#5973 In huggingface/trl;

· VikramRangarajan opened on Jun 8, 2026

RFC: Environment-owned reward

Status: Open.

#5912 In huggingface/trl;

· qgallouedec opened on Jun 2, 2026

RFC: Agent RL training with environment: environment-owned dataset, if any

Status: Open.

#5903 In huggingface/trl;

· qgallouedec opened on Jun 1, 2026

bug(rloo): KL penalty uses first-order log ratio instead of Schulman approximation (inconsistent with GRPOTrainer)

Status: Open.

#5889 In huggingface/trl;

· Sumu004 opened on May 30, 2026

RDPO support in GRPOTRainer

Status: Open.

#5886 In huggingface/trl;

· JishnuKR opened on May 29, 2026

AsyncGRPO: make NCCL weight sync robust on PCIe-only GPUs (auto fallback from P2P/SHM)

Status: Open.

#5865 In huggingface/trl;

· rycerzes opened on May 27, 2026

[AsyncGRPO] Loading from checkpoint recomputes all vLLM past requests

Status: Open.

#5863 In huggingface/trl;

· ggcr opened on May 27, 2026

[AsyncGRPO] aiohttp limits to 100 reqs when max_inflight_tasks > 100

Status: Open.

#5847 In huggingface/trl;

· ggcr opened on May 26, 2026

Add missing AsyncGRPOTrainer features present in GRPOTrainer

Status: Open.

#5831 In huggingface/trl;

· rycerzes opened on May 25, 2026

GRPOTrainer silently uses near-greedy decoding when temperature=1.0 (transformers >= 4.50 + Qwen2.5)

Status: Open.

#5783 In huggingface/trl;

· timwei0801 opened on May 18, 2026