Swimming is closed for the season at the state parks, but they'll still let you hang out on the beach as long as you don't go in the water.
You could always go to the west side in Fair Haven that is a state park with on lifeguarded swimming at your own risk
Officially, there is no swimming...if by chance the kids splash a little in the water, fairly confident you'll be fine
Thanks! Your answer is awaiting moderation.