Do you have to spend money to explore caves?

Yes, and you can't just explore, there are guided tours.

Yes, these are tours led at specific times and, although there are other areas open beyond the basic tour, these are done for a fee and led by a guide.

Yes

Yes, there is an entrance fee.

Yes there is a $25 fee