I have never seen an alligator in the Atlantic Ocean. If you're looking for a nice Beach to go swimming I would go a little further south into Juno where the beach is more compatible for people. I find the Blowing Rock is a little rocky it has a cliff of rocks which is why the water blows.
I was curious myself as plan on visiting there again soon;) Short answer: Yes. Long answer: I found a bunch of TripAdvisor posts titled Blowing Rocks Preserve talking about how dangerous it is to swim and to be very cautious or didn't recommend, (you can keyword search in reviews: swimming) however nobody said you're not allowed in, one even said that it's a Florida right to swim.
Thanks! Your answer is awaiting moderation.