Welcome to the forum.
Your local chapter of the NSS is the Central Connecticut Grotto. Check out the website at
http://www.ctcavers.org They're a friendly bunch who go caving fairly regularly, and usually don't bite strangers. Some members are also active rock climbers, ice climbers, etc. There's a meeting every month, and anybody is welcome. All the details are on the website.