If it's going to be really wet, I'd prefer neoprene gloves (and maybe a wetsuit!).
For general caving, I like
these dyneema gloves. Not waterproof or warm, but dextrous and almost indestructible. Adding a thin liner glove or wristover makes them warmer, but only when dry. I might try a thin neoprene liner, if I can find one.
You also have the option of carrying a spare pair of thicker, warmer gloves.