Your work is about to suffer because of Labor Day . . . and your Labor Day is about to suffer because of work. According to one new survey, about HALF of Americans admit their productivity goes down right before a long weekend for a holiday. But another survey found work gets revenge . . . because the average person gets bummed out about going back to work by 4:00 P.M. on a holiday.