Not easy to answer as so much is personal choice! Are you intending to wear it at the destination? How much luggage are you carrying/travelling with?
For example, I regularly travel in a suit with one bag for overnight stuff and my papers. I am not packing the suit as it would be crumpled in the bag and more to pack and carry.
If you are travelling light and intending to wear the blazer to work/meetings where a bomber jacket would not be appropriate, then that is your answer. If you need casual clothes for a few days and a casual top coat to wear, then the Bomber Jacket is coming anyway - whether worn or packed.
If it is an either/or choice, then it is your personal choice as to what you can use or mix-and-match or how much luggage you wish to carry.