A bathroom fan vent pipe must be properly insulated to prevent condensation.  Breakdowns like this can create moisture that will travel back into the living spaces and cause damage.