sounds like you got some females in heat somewhere? at 4weeks old they can go into heat
you might try movin him, to another area upwind of the colony
but it does sound unusual for them to be that aggressive even with females in heat around