Babies are certainly more delicate than adults. I think the trick is protecting them from predators for the first couple years, and then they're good to go. It's worth building them a pen with good burrows and chicken wire screen over the top to keep out cats and hawks.
A guy I know up in Oro Valley hibernated them in his garage, to give them a little extra protection from the hard freezes.
The Desert Museum has some good guidelines:
http://www.desertmuseum.org/programs/tap.php
I'd actually contact either them, or the Phoenix Herpetological Society for baby-specific tips.
Note that technically Pima county has a one-tortoise per homeowner rule. Very few people seem to follow it, but it may come up in conversation if you mention "babies".