Your hands getting cold is generally a sign that your core is getting cold. I find that if I really wrap up warm when fishing there is little need for gloves even on the coldest most miserable days. Typically, long johns thick trackie bottoms, thermal vest, t-shirt, thin micro fleece, synthetic down jacket, wading jacket, buff and wooly bunnet. That should do the trick. My wading jacket also has neoprene cuffs which I can bring down over my hands but leaves my fingers exposed if I'm realy cold.