While scientists and philosophers the world over may argue this point, I have come up with a term for it: Retroactive Nostalgia. I think this term perfectly captures the essence of the paradox of wanting to go back to a time you never came from.
You can, of course, disagree with me.
