You may not be able to drive in because the gate may be closed and locked or you may be discouraged by the park police from entering outside opening hours.
Never done it but from my understanding you have to go through the gate so if no one is there I dont think people are allowed in. I could be wrong so I'd call the office they are super nice.
Thanks! Your answer is awaiting moderation.