My great uncle got embarassed over this early on in his career. His boss invited him to dinner on Saturday and so he showed up with his wife around noon since that was the typical understanding in his home region. The boss thought he was crazy and told him off for arriving hours earlier than expected.

They still call the midday meal dinner and the later one supper, though I say lunch for the middle one and use the words dinner & supper interchangeably.