Use insulation.
Close flue when you are not using it.
They have something specifically designed for that in Lowe's weatherization section.
Start a fire in it. (Of course make sure flue is open partially when you do it.)
Closes your flue. Put insulation up there if you don't use it.
Thanks! Your answer is awaiting moderation.