Good question, I think in essence your question is an “illusion” in that time isn’t “lost”. Rather the conventions that humans have used to “synchronise and order” time mean that people in certain locations adopt and adhere to the “time zones” in that geographical area.
Information relating to the “international date line” might also help to answer your question.
Comments