In this letter, we propose a color image segmentation algorithm based on contrast information. Given a color image, we use contrast information, instead of the commonly used derivative information, to detect edges. To fit for human's visual perception, the CIE L*a*b* color space is used and the ΔEab color difference is adopted as the measure of color contrast. A subjective experiment is made to demonstrate the weak correlation between the perceived color contrast and the levels of (L*, a*, b*). This experiment implies the feasibility of using a single-threshold scheme to suppress perceptually faint boundaries. A complete segmentation scheme is proposed and the simulation results demonstrate the superiority of this approach in providing reasonable and reliable color image segmentation.