My only issue with that Fujifilm camera is that apparently you got upsold out of your initial price range. There are better Micro 4/3 cameras than the market than the E-PM2 if your budget was increased by the $150 or so more that the Fuji likely set you back. Those would include both the Panasonic G6 and the Olympus E-PL5. I happen to own the E-PL5 and the G6's predecessor the G5 and both of those are more capable cameras than the E-PM2, but I don't necessarily believe you need those capabilities, NOR the added capabilities of the Fujifilm.

The fact is, given where you're coming from, pretty much any current generation MILC is going to have a much better sensor than prior point and shoots that you've used. Fujifilm is a perfectly fine system, but I expect you're going to find that the lenses you might want to expand to all cost quite a bit of money, whereas there are some excellent reasonably priced alternatives (from brands like Sigma and Tamron) if you went with either an Olympus E-PM2 or a Sony NEX (any model).