It's a nice place to visit, if a little (a lot) out of the way. Railway was washed out the last time I went there, and the bus takes forever...
You can go right to the cave too, it's not even blocked off, or paywalled or anything, it's down from the shrine, in a river valley, with a managed pathway to get there and back.
To OwaseGokasho BayTsurugi PassAma-no-iwatoIseshima SkylineIse Futami
Toba LineIse Grand ShrineOkageyokochouIsuzu ParkSangu LineIsuzu RiverIse CityKintetsu Toba Line