UPDATE:
Took him to the vet, his mouth is fine, nice and pink and clear. She said it was probably just substrate. She says he is skinny, but otherwise healthy and suggested offering a fuzzy vs the small mouse and see if he will take it, since he is small, only 75 grams