is swimming in the river allowed?

Yes

You can take your car for a dip on the way put too!

In most Pa rivers/streams swimming is actually illegal, but it can be dictated by the municipality. With in the preserve I believe it is allowed, there is no signage otherwise. Also myself and many others swim there, although it is not very deep, so dont expect diving :)

Yup

In some areas, yes!