Our hotel is in the midst of lots of high rise office buildings. We can see into a lot of the offices at night. Although you see some people in there until 8:00 who are obviously working at desks (and not cleaning), the vast majority are cleared out sometime between 5 and 6. Rush hour seems to happen about that same time as well, and in the mornings people ride the train and ferry into this area as well.
A 2 hour lunch doesn’t seem to be unusual, either. Lots of places offer what seems to be a very leisurely lunch, or people tend to exercise. There are lots of downtown joggers / walkers during the lunch period. They’re the ones eating a salad rather than wolfing down a super-sized something or other.