In June, Gorman told conference attendees that he would be “very disappointed” if his workers hadn’t returned to Morgan Stanley buildings by Labor Day.