A family of three swam to the small island and sought refuge in a barn after the fire broke out in their boat off the Vineyard.