The initial vet visit is always a good idea to be within the first week, just to make sure (s)he is healthy. Depending on what his/her vaccine and health status is at that point, the vet can tell you where to go from there.
As far as food goes, my best recommendation is either Innova EVO or Wellness Core. If you don't want to go that route because of expense or whatever, all I can say is Please don't feed anything you buy at the grocery or convenience store. Those foods have too much fillers, carbs and sugar and are not the best for kitties.