I have gone through every extreme (goatee, beard and clean shaven - some of my friends don't like me clean shaven saying I look scarey. Thus I keep some hair in my face.)

Your facial hair may change but other things should not: eye color, head size, lips, nose (for the last two unless you have surgery.)

I've never had a problem in any country no matter how I look. Actually I look heavier in my passport foto and one UA agent in EWR said "You lost weight."