Yes, definitely springtails. I had them in two of my tanks which were side by side.
Isolate those tanks that you know have them, quarantine them until the springtails are gone.
To get rid of them dump all the substrate and clean the viv. Add the new substrate and make a ring around the water dish so if any sloshes out it will not get the substrate wet. Maybe even just use papertowels. It will take about of month of daily (sometimes 2-3x a day) cleaning to get rid on them. Look at the waterbowl every few hours, and if you see anything dump and clean the bowl.
I personally like the white ramekins from Ikea or Target because you can see the bottom of the bowl and know if there are any in there. They will have their babies which will float around in a group on top and just clean them out! Make sure the outside and bottom of the bowl is completely dry before adding the water.
After a few weeks you will notice the numbers getting smaller, but just be sure to check as many times as you can!
Good luck, and let us know how it is going!