Human-Centric Deep Generative Models: The Blessing and The Curse
| dc.contributor.advisor | Davis, Larry | en_US |
| dc.contributor.author | Yu, Ning | en_US |
| dc.contributor.department | Computer Science | en_US |
| dc.contributor.publisher | Digital Repository at the University of Maryland | en_US |
| dc.contributor.publisher | University of Maryland (College Park, Md.) | en_US |
| dc.date.accessioned | 2021-09-17T05:40:52Z | |
| dc.date.available | 2021-09-17T05:40:52Z | |
| dc.date.issued | 2021 | en_US |
| dc.description.abstract | Over the past years, deep neural networks have achieved significant progress in a wide range of real-world applications. In particular, my research puts a focused lens in deep generative models, a neural network solution that proves effective in visual (re)creation. But is generative modeling a niche topic that should be researched on its own? My answer is critically no. In the thesis, I present the two sides of deep generative models, their blessing and their curse to human beings. Regarding what can deep generative models do for us, I demonstrate the improvement in performance and steerability of visual (re)creation. Regarding what can we do for deep generative models, my answer is to mitigate the security concerns of DeepFakes and improve minority inclusion of deep generative models. For the performance of deep generative models, I probe on applying attention modules and dual contrastive loss to generative adversarial networks (GANs), which pushes photorealistic image generation to a new state of the art. For the steerability, I introduce Texture Mixer, a simple yet effective approach to achieve steerable texture synthesis and blending. For the security, my research spans over a series of GAN fingerprinting solutions that enable the detection and attribution of GAN-generated image misuse. For the inclusion, I investigate the biased misbehavior of generative models and present my solution in enhancing the minority inclusion of GAN models over underrepresented image attributes. All in all, I propose to project actionable insights to the applications of deep generative models, and finally contribute to human-generator interaction. | en_US |
| dc.identifier | https://doi.org/10.13016/piwu-o2rj | |
| dc.identifier.uri | http://hdl.handle.net/1903/27856 | |
| dc.language.iso | en | en_US |
| dc.subject.pqcontrolled | Artificial intelligence | en_US |
| dc.subject.pquncontrolled | Computer vision | en_US |
| dc.subject.pquncontrolled | Deep learning | en_US |
| dc.subject.pquncontrolled | Generative adversarial networks | en_US |
| dc.subject.pquncontrolled | Generative modeling | en_US |
| dc.subject.pquncontrolled | Visual security | en_US |
| dc.title | Human-Centric Deep Generative Models: The Blessing and The Curse | en_US |
| dc.type | Dissertation | en_US |
Files
Original bundle
1 - 1 of 1