ANSI code are free to change the color and that color will remain changed until it is reset or changed again.
Currently (at least in my setup), the color changes are reset with each line.
I am running neovim, loading a file with ansi escape codes and applying them by running :ColorHighlight