I'm a habitual logo-ripper, I also remove pockets from new dress shirts (I don't use them).
You can use a blade, or buy a $2 seamripper from a fabric store or wal-mart to remove patches like that. It will take about 5-10 minutes and you will see no trace about a day later