Three weeks isn't that long so I would expect him to calm down and become slightly more relaxed around you in the coming months.