CleanRL PPO Atari
Step-by-step breakdown of PPO-Clip formulas from CleanRL's Atari implementation