We met another family boat with two kids the same age as ours aboard Convivia while in Malaysia (they have just completed their circumnavigation). They had the best comeback to naysayers, I had to turn it into a comic.
If us cruisers didn't get over those stressful moments that cause all sorts of nasty words to fly out of our mouths... then, well, we wouldn't be still cruising would we? (Sundowners at the end of the day helps).