What time of year are you going? The waters can get choppy but it's really weather dependant. Nice days during the summer you can find the ocean to be just lapping peacefully. I see some tours are offered around the penisula areas of the Bras D'Or lakes so that area is probably be a bit more calm too.
I'm sure the tour companies would give you a general idea of the waters if you contacted then.