Yes. Failed or damaged flashing can allow water to enter where the chimney meets the roof.