This paper presents a feature-based scheme for image compression. In the proposed method, the features in an image are recorded by three-dimensional verge points, which are defined as high curvature points on the image surface. The verge point representation can be further condensed using B-spline control point approximation. By encoding and transmitting these control points, the features in an image could be revealed at the decoder side. Furthermore, by selecting different coding modes, the proposed method can offer diversified scalabilities, including SNR scalability, spatial scalability, and shape scalability. In addition, this coding technique is suitable for region of interest selection and transmission. Experimental results are provided to present the scalability and interactivity of the proposed method.