Bummer. Silky mice are so pretty.
Are there actual wounds at the testicle area? If so, this area usually gets infected in short order due to its proximity to the urinary and intestinal openings, so if in fact he has been chewed upon, your best course would be to feed him off. Not to mention the amount of pain he must be in.
If you can't see any wounds, is it cold in the room where they're kept? Male mice are like male humans, when it gets cold, the testicles withdraw up closer to the body to stay warm. And even if you pick them up, they can withdraw quite a bit, so much so I've actually mistaken them for females at times.
This can happen when you put new mice together, especially adult females with a new male. Usually when I start a new colony, I'll use an older male and younger females. They aren't 'testicle aggressive' like the older females can be, and the male can assume his dominance over them, rather than vice versa. Or if I have to use adults, the adult male has the intended cage for a couple of days to 'make it his own', and then I'll add a female every day. So he's not quickly outnumbered, and they're more interested in beating up on the new female.
Although I'm not too sure of what a 'fuzzy mouse' is other than a baby mouse, so maybe you could elaborate on that just a tad.