What is the best time to go on a weekday (i.e. shorter line)?

Potluck, just depends on the day

Went late almost 5 no one in line. This is rare

Likely, but I've only been there on the weekend. That said, I feel the line does move pretty quickly even when it appears you'll be stuck in it for ages.

As early as practical. Be there within an hr of opening.