Getting a good breeder mouse from a local breeder may be cheaper than paying $3 at the pet store.

Also good move with removing him, the last thing you need is an abusive mouse ruining things.