I have used climbing harnesses for years for caving, without any problems. The only thing that might be an issue is that most racks are made for caving harnesses, although I think you can still get them (racks) with the eye rotated at a 90 degree angle.
Trogman