What I did when I first shown interest in caving I contacted My a local grotto. They told me about caving and how to cave responsibly. Also caving gear is quite costly, and it is best to try out caving before you go out and buy gear. Caving is allot more different than climbing. You are in a very delicate environment that even the most careful of cavers still impact the cave environment. Not to mention you are underground. Caving gear is slightly different than climbing gear. The best advice I can give you is contact a grotto in your area and attend a meeting, and go with them on a few trips never go caving alone and go with someone who knows the cave. It is easy to get disoriented underground. I hope this was helpful for you. You will get a lot of good replies on this board. It is the best for caving information.
Cave Softly