Yes, those would work if you rinsed them out.
I use a spray bottle with half white vinegar and half water.
Vinegar kills bacteria and destroys odors. It is also safe for your mice to eat. I use that on all my animals' cages.
Any dish soap is safe, but I would rinse because of stickiness.
To up the germ-killing properties of vinegar, you can put some thyme essential oil in it, but the vinegar alone is perfectly fine to kill the germs in a mouse cage.
I use the vinegar/thyme mixture as an alcohol free hand sanitizer.