There is nothing inherently wrong with breeding a normal male - I'm sure he'll appreciate the opportunity.Having said that, it does not make economical sense for breeders to do this. Males can be bred to multiple females during breeding season, so it makes more sense to spread a more diverse male's genes around to the less diverse females than the other way around (from a business perspective).
Also, yes, there is the piece of having 50% normals, but you'd end up with those odds in any single-gene x normal pairing regardless of which parent was the morph.
I say go for it. When/if you get a larger collection, then you can worry about genetically greater males vs females. Have fun!