sometimes with mice you will get a spinner or some that are just not right.
but it takes quite some time and i would say that unless your breeding alot of mice you more than likely will not see it.
inbreeding anything at a certain point will bring hidden genetic issues to the surface.
just remember most things are good in moderation.
personally i will bring in a new group every once in a great while.