Large Grad Norm #18
Description
When using coupled-GRPO, my grad_norm is often very large—usually in the tens and sometimes even dozens—and only occasionally drops below 1. Is this normal, or have I done something wrong?
{{ message }}
When using coupled-GRPO, my grad_norm is often very large—usually in the tens and sometimes even dozens—and only occasionally drops below 1. Is this normal, or have I done something wrong?