I would usually accept an upgrade, if offered.
Exceptions would be:
1) On flights where I plan to sleep some and I already had an empty section, not that it happens much these days.
2) I'm already seated in the exit or bulkhead row and the middle seat remained empty.