The one time I've done it, I used a 16 gauge. It was larger than I wanted, but was the smallest I had immediate access to. I imagine 22 gauge was probably too thin - that yolk inside the egg is quite thick and viscous so I imagine that's probably why it didn't work.
I have actually since ordered 18 guage needles and 10cc plastic syringes just to have on hand in case.