You would now be unable to accomplish any work together on the flight if you had planned on doing so.

However if you had refused the upgrade, there is no telling if the gate agent might have gone over to your colleague who might have been next in line for the upgrade, he might have taken it, leaving you in the reverse and equally embarrassing position.

Travel tips:
http://members.aol.com/ajaynejr/travel.htm