Celeste RL
Continual reinforcement learning research using Celeste: how much of one room an agent forgets when it learns the next.
I built a Python environment, with a small C# plugin, that runs the game at about 2,600 frames per second through its real controls. On it, I taught an agent Room 1, then Room 2, and measured what it lost along the way.
Under the standard PPO recipe, learning Room 2 cut Room 1 success by 37 to 56 points in every lineage. Two variants lost far less without doing worse on Room 2. The evidence is descriptive, from four lineages, and the technical report says exactly what it can’t show.


