Two things for me:
1) I can't afford the maintenance. 20 snakes is a lot more that 5 to feed.
2) The moment it feels like work. I hate work. Feeding and maintaining a lot of animals singlehandedly takes its toll. What used to be a passion can turn into a pain.