How long have you had him? Usually you want them to settle in for a week or two before you start handling so that you can be sure they're eating well. So if he's not eating I would stop handling until he is. Make sure his temperatures are okay (what are they? How are you supplying heat? How are you measuring the temperature? How are you controlling the temperature?), make sure he has lots of things to hide under, and leave a f/t pinky that you've heated up in very very hot water in his tank overnight. Feed him at night and then turn the lights off.