Oh? I would think that the input prompt to drive generation is not lost during generation iterations -- but I also don't know much about the architectural details.