The other thing to remember is males often know what is going on with the female (follicly speaking). It is possible your male is just very discerning and is choosing to save his energy for when your female is in a better stage of development...
Usually I see males most active when the follicles are 1-1.5 cm.... then their interest dies off for a month or so... becoming more interested in breeding again when follicles get 3 cm+.
Don't despair!
Justin