Yes you can and its very relaxing!
You can fish at Turning Point Park. There is a boardwalk with large concrete piles you can fish from. The water is generally murky but there are a lot of fish. A friend of mine caught a sturgen there recently. You don't need a permit but you do need a fishing license.
Yes, I see plenty of people cast off of the round old concrete boat tie offs.
Yes you can as long as you have a permit.
Thanks! Your answer is awaiting moderation.