They're more likely to be active if you handle at night, but it won't harm them to handle during the day either.