I personally wouldn't do it. You don't know what diseases or bugs that mouse is carrying. I wouldn't want to risk spreading anything to my pets if I can avoid it.
In the end, it is your call. I would just rather get some live mice from a feeder breeder.