Is the rice paper easily removable once it's been on a window over time?

Yes, it will still come off. There may be some glue left behind, but warm soapy water and a scraper or glass-safe scrub pad will take that off.