Unlocking Stable On-Policy RL on TPU with Bitwise-Zero Train–Inference Mismatch
Google introduces Zero-TIM, a bitwise-identical train-inference alignment technique for stable on-policy RL on TPU that eliminates numerical discrepancies between sampler and trainer by using custom Pallas kernels and controlled reduction ordering.