Art Painting Image Style Transfer Based on Stroke and Contour Constraints

Expand
  • 1. School of Advanced Manufacturing Engineering, Hefei University, Hefei Anhui 230601; 2. School of Computer Science and Information Engineering, Bengbu University, Bengbu Anhui 233030

Received date: 2023-10-22

  Online published: 2024-05-28

Abstract

Image style transfer has an important application in the field of art painting, and the existing art painting style transfer algorithms cannot well transfer the unique strokes and the contour features of the objects in the image of a specific-style work. In order to achieve better style transfer effect, a style transfer method for art painting images based on stroke and contour constraints is proposed. A pre-trained edge detector is used to extract the stroke features of the style image and the content image, and a loss function is designed to emphasize the stroke consistency between the two; erosion and blurring techniques are used to simulate the diffusion effect of pigments in oil paintings, and contour constraints are imposed on the object contours in the content image. The multi-head attention mechanism is introduced into the generative network to focus on key stylistic features, and the loss function adopts Smooth L1 instead of L1 to improve the training stability. The algorithm is mainly compared with CycleGAN in the experiments on the Van Gogh painting image dataset. The evaluation metric FID is reduced by 9%; SSIM is improved by 11.8%; PSNR is improved by 3.9%; and the human subjective evaluation is also significantly higher. The experimental results show that the algorithm has better style transfer effect than CycleGAN.

Cite this article

SHI Xiao, HU Xue-you, HUANG Ying-hui, et al . Art Painting Image Style Transfer Based on Stroke and Contour Constraints[J]. Journal of Chaohu University, 2023 , 25(6) : 101 -110+128 . DOI: 10.12152/j.issn.1672-2868.2023.06.013

Outlines

/