If you need to kill the mouse I think picking it up by its tail and lower it down to a wire mesh cage/draining board etc, till it grabs hold, then breaking its neck with your forceps (by pressing onto the neck whilst you pull it back (it grips)) is the kindest way to do so.