3 weeks is a bit young to wean, but he should survive.
Try small or ground up food items.
Millet , dry or cooked oatmeal, broken up lab blocks. I've noticed that rat pups that age will usually love cheerios as a treat, so that might get him eating solid foods. Scrambled egg is another thing to try, they love scrambled egg.