just between your 4 and 5, the 5 has a 18% bigger screen and a 1% bigger battery, so just having the screen on you are sucking more juice. Keeping anything you don't need on and being in bad service area cause quite a bit of drain.
Everything else I would mention android in some way so I'll stop there, besides saying haha I get 2 days out of my s3