I would say leave him alone for longer, he is probably still stressed out from the move. Let him be for the next week minus the feeding attempt.

Also, remember, especially at first, SLOW movements... things like your daughter sitting down quickly could scare him.

EDIT: ditto, xdeus... your doing fine, he is just young