There is absolutely nothing wrong with Bimini Boatyard for a family brunch. The food is good and the atmosphere is open with views out to the water. It is a quintessential Florida place and I think that you will enjoy it. I recommend it highly for your purpose.
I very much do like Yolo but it is more or less an adult type in-town place that one figures as a lunch destination for the office crowd.
Pier 66 is also a very nice open and bright restaurant with almost exactly the same views as the Bimini Boatyard. You would enjoy it but I see no point in doing a deluxe brunch at a place like that in place of the more casual and much less expensive BB.
I am unfamiliar with the 15th St. Fishery.