Can we just drive in? Seems no one is available to answer the phone.

Yes you can drive in. It's open to the public.

Just drive up in the afternoon/evening, and if no one is at the office, go by in the AM to pay.

If the gate is open, closes around dark

There are staff there during the day for the RV park - just past the ice cream shop.