In recent years, the IoT application and the biometric-based authorization become popular. This paper proposes a face recognition system with high accuracy rate based on extended Local Binary Pattern, and applies it as an access control system on an IoT device which is always low-cost, low-power and small-footprint. The proposed face recognition system includes three parts, face detection, feature extraction and face recognition. For the face detection, the Viola-Jones face detector is adopted to find out the face information. The extended Local Binary Pattern then extracts the local features of the face. Further transform these features to a low-dimension subspace by Principle Component Analysis method. Finally, use the classification based on the sparse representation of L2 norm minimization to identify and verify the face. From the experimental results, the proposed method can achieve a high recognition rate better than 95% in several face databases, even reach 99% for the Cohn-Kanade face database. The access control system implemented on Raspberry Pi 3 is able to complete the whole face recognition in a second, which makes it indeed a real-Time system.