Xu, Pengfei and Wang, Lei and Guan, Ziyu and Zheng, Xia and Chen, Xiaojiang and Tang, Zhanyong and Fang, Dingyi and Gong, Xiaoqing and Wang, Zheng (2018) Evaluating Brush Movements for Chinese Calligraphy : A Computer Vision Based Approach. In: 27th International Joint Conference on Artificial Intelligence, IJCAI 2018, 2018-07-13 - 2018-07-19.
Calligraphy_Evaluation.pdf - Accepted Version
Available under License Creative Commons Attribution-NonCommercial.
Download (2MB)
Abstract
Chinese calligraphy is a popular, highly esteemed art form in the Chinese cultural sphere and worldwide. Ink brushes are the traditional writing tool for Chinese calligraphy and the subtle nuances of brush movements have a great impact on the aesthetics of the written characters. However, mastering the brush movement is a challenging task for many calligraphy learners as it requires many years’ practice and expert supervision. This paper presents a novel approach to help Chinese calligraphy learners to quantify the quality of brush movements without expert involvement. Our approach extracts the brush trajectories from a video stream; it then compares them with example templates of reputed calligraphers to produce a score for the writing quality. We achieve this by first developing a novel neural network to extract the spatial and temporal movement features from the video stream. We then employ methods developed in the computer vision and signal processing domains to track the brush movement trajectory and calculate the score. We conducted extensive experiments and user studies to evaluate our approach. Experimental results show that our approach is highly accurate in identifying brush movements, yielding an average accuracy of 90%, and the generated score is within 3% of errors when compared to the one given by human experts.