I dare say you were somewhat unlucky
Last I checked there were about 10 direct flights before noon.
My experience has been that if one flight is delayed they all are.
And the delays mount in the afternoon/evening as the system gets backed up.
I've opined on the minimum I think comfortable, but, true, one could try to take a very early flight out of BJ, arriving mid-morning (if lucky), arranging to be met at XIY by driver in advance, go to warriors, and return for evening flight back to BJ. You would see nothing else in XIY and likely spend nearly 18 hours from hotel door to hotel door doing this.