Can you fly a drone there? If not can I get promise to fly a drone?

They have very elaborate air defenses against drones

No

You might want to check with the FAA and just call the garden. Also there is a great park to back of the garden that would be as better place to fly if it is legal. Good flying

Drones are not allowed in the gardens

No you cannot fly a drone in the gardens