If you try and work out at 4:30 in the afternoon, how many people are going to chip away at that time? Your boss, your job, your work, your family, your other obligations that you might have. At 4:30 in the morning, all those people are asleep, so you can do whatever you want.