Can oyster/barnical growth sink a boat? How much growth would need to be on there?

Can oysters/ barnicals sink a a boat, namely a small catamaran, by growing on it? how much growth would there need to be for this to happen? and what would be the easiest way to remove them while in the water?