Another reason for this is that males instinctively roam to find females during the breeding season--so they're used to finding a female in strange territory. The females might be more nervous about a change.