From experience, I've found that mice, out of all small animals, are the hardest to tame. They need more attention then a rat, rabbit, guinea pig, gerbil..etc. They also need a lot more time and patience from the owner.

Its going to be really hard, but keep doing what your doing. They are nocturnal and are more active from dusk until dawn, so probably the best time to try and handle them, and not freak them out is closer to bed time.

Also try and feed them theyre own every day food with your hands. Even try some fruits and veggies,or some kind of food that will grab theyre attention so that they are more willing to come to you.

Other than that, you just gotta wait it out, see what happens. The worst possible outcome would probably be that they will never let you handle them, but will be curious about you and your hand when you put it in the cage.

Just try and interact with them every day (without trying to grab them because that would really freak them out) and put them in a darker place during the day so they wont get any psychological problems from sleeping in pure daylight

I hope the best for you! keep trying!