Issues

• reward_correct/reward_format grade the whole completion instead of the <answer> span, so an empty or prose-only <answer> scores the same +2.25 as a correct answer

  lsdefine/simple_GRPO#57 · Filter by author shaurya416 opened on Sep 30, 2026

• rollout进程的oom bug

  lsdefine/simple_GRPO#56 · Filter by author AragornHorse opened on Dec 12, 2025

• simple_grpo_v1怎么画图

  lsdefine/simple_GRPO#55 · Filter by author zqxie77 opened on Nov 27, 2025

• 论文

  lsdefine/simple_GRPO#52 · Filter by author liuguanyi1227 opened on Nov 12, 2025
  2

• 关于Auto_Program项目

  lsdefine/simple_GRPO#51 · Filter by author AuroraH1 opened on Oct 29, 2025
  4

• [Security Issue] Remote Code Execution by torch.load Deserialization via ref_server_regroup.py /bytes_to_tensor() in lsdefine/simple_GRPO

  lsdefine/simple_GRPO#48 · Filter by author Chenpinji opened on Sep 29, 2025

• DEPENDENCY ISSUE

  lsdefine/simple_GRPO#47 · Filter by author hhh2210 opened on Aug 5, 2025
  2

• 训练崩溃

  lsdefine/simple_GRPO#46 · Filter by author AragornHorse opened on Jul 23, 2025
  4

• 请教参数设定

  lsdefine/simple_GRPO#44 · Filter by author AragornHorse opened on Jul 22, 2025
  9

• 想问一下这个支持多模态模型吗

  lsdefine/simple_GRPO#43 · Filter by author lcy80366872 opened on Jun 9, 2025
  1

• About reference server

  lsdefine/simple_GRPO#42 · Filter by author liunian-Jay opened on Jun 6, 2025
  1

• 采样过程模型参数更新的问题

  lsdefine/simple_GRPO#41 · Filter by author Tbuterin opened on Apr 27, 2025
  2

• data format

  lsdefine/simple_GRPO#38 · Filter by author Yan2266336 opened on Apr 13, 2025
  3

• waiting for batch....

  lsdefine/simple_GRPO#36 · Filter by author nelsuh opened on Apr 10, 2025
  2

• aiohttp.client_exceptions.ClientConnectorError: Cannot connect to host huggingface.co:443 ssl:default [None]

  lsdefine/simple_GRPO#34 · Filter by author xumanba opened on Apr 3, 2025

• 代码中好像没有更新 ref 模型的操作？

  lsdefine/simple_GRPO#32 · Filter by author LYCnight opened on Mar 24, 2025
  1

• 请问能不能有偿请教一下Up主这个GRPO代码,有很多不懂得地方

  lsdefine/simple_GRPO#31 · Filter by author xiaohua-drive opened on Mar 24, 2025

• loss 问题

  lsdefine/simple_GRPO#30 · Filter by author hongshaodong opened on Mar 19, 2025
  2

• What's the minimum CUDA version to run your project?

  lsdefine/simple_GRPO#29 · Filter by author LYCnight opened on Mar 18, 2025
  1

• Support for LoRA Fine-Tuning

  lsdefine/simple_GRPO#28 · Filter by author acctouhou opened on Mar 8, 2025

• waiting for batch

  lsdefine/simple_GRPO#26 · Filter by author mathieu0905 opened on Mar 5, 2025
  4

• 关于训练速度，请问训完gsm8k需要多久，inputs = random.sample(QAs, Q_batch_size)怎么保证所有训练数据能全部训到

  lsdefine/simple_GRPO#25 · Filter by author AILuckyStar opened on Mar 5, 2025

• 直接安装requirement后，运行deepspeed grpo_vllm_one.py出现错误

  lsdefine/simple_GRPO#24 · Filter by author AXy1527 opened on Mar 2, 2025
  7

• 下载deepspeed0.12.0版本，运行deepspeed grpo_ref_split.py遇到numpy的问题

  lsdefine/simple_GRPO#22 · Filter by author AXy1527 opened on Feb 26, 2025
  12

• OOM的问题

  lsdefine/simple_GRPO#21 · Filter by author swordqiqi opened on Feb 26, 2025
  2