I usually put them into a cup of water and let them thaw overnight, then plop them into hot water (150F) for 15 or 20 minutes so they warm up.
I keep meaning to do that in a plastic bag, lol, but I feed my snake in a different container that doesn't have a substrate so I am not concerned about stuff sticking to the mouse. One of these days...