You should breastfeed when the baby is hungry, but unfortunately we do have our share of ignorant people that get offended.
My wife was not able to breastfeed, so I'm can't offer any personal experiences, but it doesn't sound pretty, given how upset some people can get by the mere presence of a baby.