Thanks for the replies everybody. I have tried using a covered litter box before and he seemed to like it but then stopped using that box and started using the uncovered one so I removed the cover and he started using it again.

Currently he is using the litter boxes to urinate in but not for pooping. I'll try some different kinds of litters and see if that changes things up at all. Do you think it is a good idea to change one box at a time to see if he prefers one thing over the other?