Pulsed terahertz (THz) radiation, generated through optical rectification (OR) by exciting 〈110〉 ZnTe crystal with ultrafast optical pulses, typically consists of only a few-cycles of electromagnetic field oscillations with a duration about a couple of picoseconds. However, it is possible, under appropriate conditions, to generate a long damped oscillation tail (LDOT) following the main cycles. The LDOT can last tens of picoseconds and its Fourier transform shows a higher and narrower frequency peak than that of the main pulse. We have demonstrated that the generation of the LDOT depends on both the duration of the optical pulse and its central wavelength. Furthermore, we have also performed theoretical calculations based upon the OR effect coupled with the phonon-polariton mode of ZnTe and obtained theoretical THz waveforms in good agreement with our experimental observation.