According to new research, more than half of Brits feel like they can't justify the cost of last-minute holidays, even though we admit they often spark the best memories