Abstract: According to different contributions for different samples during training process, the incremental function was formed. The incremental fuzzy support vector machine for handwritten digit recognition was constructed by the threshold of incremental function. The handwritten digit recognition selected from Center for Machine Learning and Intelligent Systems was used to verify the superiority of the proposed algorithm. Compared with fuzzy support vector machine, the incremental fuzzy support vector machine speeded up the training process and improved the recognition accuracy.