First off, is the mouse dead? If it is dead, then go ahead and remove it. You can freeze it if it is dead and save it for another time if it hasn't been dead for to long.