There are a few walk-in ponds for fishing per the GA DNR page on Phinizy Swamp, but I do not know where they are located. If you call them and ask, they should know. Every time I have called, the lady I spoke with had answers.
No, regrettably this is not allowed.
Thanks! Your answer is awaiting moderation.