Yingru Li
Yingru Li
Research
Publications
Writing
CV
Contact
RL-Seminar
Light
Dark
Automatic
Chain-of-Thought
Part 3: Trust Region Optimization via Sequence Masking
Hard trust regions for long-horizon LLM-RL: sequence-level masked importance sampling (Seq-MIS) rejects out-of-distribution samples instead of clipping them, and geometric masking makes the trust region length-invariant.
Yingru Li
,
Jiacai Liu
Nov 4, 2025
19 min read
Research