I was in a similar situation at my first job, except my boss didn’t have a wife and instead lived right across the street from the office. He would say things like “We don’t have a clock-in and clock-out attitude here”. Or one time he kicked off a project where he divided up groups of people and wanted them to start brainstorming ideas for an app we could implement with our product. Except he specifically said we couldn’t work on it during work hours. So guess what, nobody worked on it and Mr boss man was very disappointed in all of us. I’m so glad I don’t work there anymore.