Hierarchical Encoding for Image Inpainting with StyleGAN Inversion

Ayşegül Dündar

Makale detayları

Hierarchical Encoding for Image Inpainting with StyleGAN Inversion

Yazarlar:

Ayşegül Dündar

Yayıncı:

Gazi University

Ana Başlıklar:

Elektrik Mühendisliği (Diğer)

Dergi:

Gazi Üniversitesi Fen Bilimleri Dergisi Part C: Tasarım ve Teknoloji Vol.12 Issue 4, pp.1091-1101

Belge Tipi:

Makale

Yayın Tarihi:

12/2024

Belge Dili:

İngilizce

Document ID (Org No.):

2001337758

pISSN:

2147-9526

Anahtar kelimeler:

Özet:

 Image inpainting, the process of removing unwanted pixels and seamlessly replacing them with new ones, poses significant challenges requiring algorithms to understand image context and generate realistic replacements. With applications ranging from content generation to image editing, image inpainting has garnered significant interest. Traditional approaches involve training deep neural network models from scratch using binary masks to identify regions for inpainting. Recent advancements have shown the feasibility of leveraging well-trained image generation models, such as StyleGANs, for inpainting tasks. However, effectively embedding images into StyleGANs latent space and addressing the challenges of diverse inpainting remain key obstacles. In this work, we propose a hierarchical encoder tailored to encode visible and missing features seamlessly. Additionally, we introduce a single-stage architecture capable of encoding both low-rate and high-rate latent features used by StyleGAN. While low-rate latent features offer a comprehensive understanding of images, high-rate latent features excel in transmitting intricate details to the generator. Through extensive experiments, we demonstrate significant improvements over state-of-the-art models for image inpainting, highlighting the efficacy of our approach.

 Image inpainting, the process of removing unwanted pixels and seamlessly replacing them with new ones, poses significant challenges requiring algorithms to understand image context and generate realistic replacements. With applications ranging from content generation to image editing, image inpainting has garnered significant interest. Traditional approaches involve training deep neural network models from scratch using binary masks to identify regions for inpainting. Recent advancements have shown the feasibility of leveraging well-trained image generation models, such as StyleGANs, for inpainting tasks. However, effectively embedding images into StyleGANs latent space and addressing the challenges of diverse inpainting remain key obstacles. In this work, we propose a hierarchical encoder tailored to encode visible and missing features seamlessly. Additionally, we introduce a single-stage architecture capable of encoding both low-rate and high-rate latent features used by StyleGAN. While low-rate latent features offer a comprehensive understanding of images, high-rate latent features excel in transmitting intricate details to the generator. Through extensive experiments, we demonstrate significant improvements over state-of-the-art models for image inpainting, highlighting the efficacy of our approach.

 Image inpainting, the process of removing unwanted pixels and seamlessly replacing them with new ones, poses significant challenges requiring algorithms to understand image context and generate realistic replacements. With applications ranging from content generation to image editing, image inpainting has garnered significant interest. Traditional approaches involve training deep neural network models from scratch using binary masks to identify regions for inpainting. Recent advancements have shown the feasibility of leveraging well-trained image generation models, such as StyleGANs, for inpainting tasks. However, effectively embedding images into StyleGANs latent space and addressing the challenges of diverse inpainting remain key obstacles. In this work, we propose a hierarchical encoder tailored to encode visible and missing features seamlessly. Additionally, we introduce a single-stage architecture capable of encoding both low-rate and high-rate latent features used by StyleGAN. While low-rate latent features offer a comprehensive understanding of images, high-rate latent features excel in transmitting intricate details to the generator. Through extensive experiments, we demonstrate significant improvements over state-of-the-art models for image inpainting, highlighting the efficacy of our approach.

 Image inpainting, the process of removing unwanted pixels and seamlessly replacing them with new ones, poses significant challenges requiring algorithms to understand image context and generate realistic replacements. With applications ranging from content generation to image editing, image inpainting has garnered significant interest. Traditional approaches involve training deep neural network models from scratch using binary masks to identify regions for inpainting. Recent advancements have shown the feasibility of leveraging well-trained image generation models, such as StyleGANs, for inpainting tasks. However, effectively embedding images into StyleGANs latent space and addressing the challenges of diverse inpainting remain key obstacles. In this work, we propose a hierarchical encoder tailored to encode visible and missing features seamlessly. Additionally, we introduce a single-stage architecture capable of encoding both low-rate and high-rate latent features used by StyleGAN. While low-rate latent features offer a comprehensive understanding of images, high-rate latent features excel in transmitting intricate details to the generator. Through extensive experiments, we demonstrate significant improvements over state-of-the-art models for image inpainting, highlighting the efficacy of our approach.

Makale detayları

Hierarchical Encoding for Image Inpainting with StyleGAN Inversion

Yazarlar:

Ayşegül Dündar

Yayıncı:

Gazi University

Ana Başlıklar:

Elektrik Mühendisliği (Diğer)

Dergi:

Gazi Üniversitesi Fen Bilimleri Dergisi Part C: Tasarım ve Teknoloji Vol.12 Issue 4, pp.1091-1101

Belge Tipi:

Makale

Yayın Tarihi:

12/2024

Belge Dili:

İngilizce

Document ID (Org No.):

2001337758

pISSN:

2147-9526

Image processing

Generative Adversarial Networks

Deep Learning

Sayı

Makale detayları

Hierarchical Encoding for Image Inpainting with StyleGAN Inversion

Yazarlar: Ayşegül Dündar

Yayıncı: Gazi University

Ana Başlıklar: Elektrik Mühendisliği (Diğer)

Dergi: Gazi Üniversitesi Fen Bilimleri Dergisi Part C: Tasarım ve Teknoloji Vol.12 Issue 4, pp.1091-1101

Belge Tipi: Makale

Yayın Tarihi: 12/2024

Belge Dili: İngilizce

Document ID (Org No.): 2001337758

pISSN: 2147-9526

Image processing

Generative Adversarial Networks

Deep Learning

Sayı

Yazarlar:

Ayşegül Dündar

Yayıncı:

Gazi University

Ana Başlıklar:

Elektrik Mühendisliği (Diğer)

Dergi:

Gazi Üniversitesi Fen Bilimleri Dergisi Part C: Tasarım ve Teknoloji Vol.12 Issue 4, pp.1091-1101

Belge Tipi:

Makale

Yayın Tarihi:

12/2024

Belge Dili:

İngilizce

Document ID (Org No.):

2001337758

pISSN:

2147-9526