Yup, females have nipples, males do not.
The best way your going to learn is buy grabbing a couple, put them in the palm of your hand, lift their butts by the tails side by side and compare.
Males will have the anus farther away from the penis.
Females anus will be close to their urethra.
Check out this guide, it has pics to help you.
http://www.ratz.co.uk/sexingrats.html