This investigation proposes a novel all-optical phase noise averager to reduce residual phase noise in the differential phase-shift keying (DPSK) transmission system with phase-preserving amplitude regenerators. The proposed phase noise averager is based on a phase-sensitive amplifier but does not require an extra phase-locking optical pump beam. It can increase the correlation between the phase noises of neighboring bits and greatly reduce the differential phase noise in the transmission system. Independently of the cascaded spans, analytical analysis demonstrates that, in the DPSK system with repeated averagers, the total differential phase noise will be less than that before the first averager. Theoretical analysis and numerical simulation are carried out and confirm the significant improvement of DPSK signals using the proposed novel phase noise averagers.