Does he have a hide, in addition to the aspen? I agree that stress is probably the main issue. I would switch him to a tub for a month or two, and keep handling him without over-handling.