Image Inpainting of Portraits Artwork Design and Implementation
In modern society, the restoration of artwork has become increasingly important. Generative models can provide reference images for the damaged or blurred core areas of these artworks. This paper simulates artificial damage to classic portrait paintings in the Art Portraits dataset by adding center...
Saved in:
| Main Author: | |
|---|---|
| Format: | Article |
| Language: | English |
| Published: |
EDP Sciences
2025-01-01
|
| Series: | ITM Web of Conferences |
| Online Access: | https://www.itm-conferences.org/articles/itmconf/pdf/2025/01/itmconf_dai2024_03026.pdf |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| Summary: | In modern society, the restoration of artwork has become increasingly important. Generative models can provide reference images for the damaged or blurred core areas of these artworks. This paper simulates artificial damage to classic portrait paintings in the Art Portraits dataset by adding center masks during data preprocessing and then implements the image inpainting task. During the training phase, the Denoising Diffusion Probabilistic Model (DDPM) is fine-tuned by progressively adding noise to the center-masked images in the noising stage, followed by denoising in the denoising stage to generate images. The generated images are compared with the original undamaged images through loss calculations to optimize the model. Additionally, a Generative Adversarial Network (GAN), which has shown promising results on other datasets, is used as a baseline for comparison. The damaged images are used as inputs, and the generated images are compared to the ground truth to evaluate the performance of both models. In the testing phase, two widely used metrics in image evaluation, Mean Squared Error (MSE) and Fréchet Inception Distance (FID), are introduced to assess the performance. The fine-tuned DDPM achieves an MSE of 0.2622 and an FID of 16.85, while the GAN scores 0.2835 and 22.78, respectively. Since lower values indicate higher fidelity in reproducing the original image, which is crucial for art restoration, the conclusion drawn from this paper is that the fine-tuned DDPM demonstrates higher accuracy and is more suitable for restoration projects related to Art Portraits. |
|---|---|
| ISSN: | 2271-2097 |