The beach at Bay of Fires was stunning to look at, but sadly the water was too chilly to jump in