Sorry, I was really panicing when I posted this.
I didn't hold him for very long, when I first got him I held him for about 20 minutes in tears but then I realized one night shouldn't be able to kill him (Right now our lows are somewhere around 40 degrees says the internet, but he was in the car which should've stayed somewhat warm-ish most of the night. Obviously cooling down over time)
I left him on my bed to get up to room temperature over about an hour maybe an hour and a half, then put him in the middle of his cage so he wasn't on the warm side. I didn't want to warm him up too fast so I didn't shock his body. (I think I touched base on most of this in the post, I can't remember but will post it again just because I'm already typing it)
He is wandering around his cage and stuff, but his head is shakey and he's moving weird.
He was also super active last night which was a little weird for him.
Right now he's still wandering around his cage, hasn't stopped in a few hours which is very weird because it's mid-day here right now, so he's usually sleeping.