You need to decide what is the priority for you - and make your decision on that.

You don't really explain why you prize status so highly. For someone who only flies 2-4 times a year (or is there lots of shorthaul flying as well that hasn't been mentioned?), status is pretty meaningless - status is something that has value the more that you fly.

If lounge access is your thing - then perhaps getting a Priority Pass (etc) or just investigating the paid lounge options at each of the relevant airports may work out to make more sense (you'll be paying "extra" for lounge access - but you can decouple it from your FFP decision).

If it's other status "perks" such as additional baggage, these may indeed turn out to be much more expensive to replicate - but do you always need/use this extra allowance?

If the miles are your priority, then you do realise that by walking away from your existing FFP, you're potentially "orphaning" or abandoning those miles (perhaps you will be able to do something with the miles you already have, though). But check the rules of any other FFP carefully - as you know, Flying Blue earns only 25% on lots of economy fare classes on AF, DL and KL - but on some of the other SkyTeam airlines, the cheapest economy fares earn absolutely nothing on Flying Blue.

When comparing on the basis of miles, don't forget to factor in how easy it may be to actually spend them. Availability of awards and ease of redemption seems to vary wildly - so don't solely focus on the earning/burning rates (though these should be also carefully studied!).