Exploring Open Domain Image Super-Resolution through Text
Published in ICML 2023 Workshop on Artificial Intelligence & Human-Computer Interaction, 2023
Kanchana Vaishnavi Gandikota, Paramanand Chandramouli
Abstract
In this work, we propose for the first time a zero-shot approach for flexible open domain extreme super-resolution of images which allows users to interactively explore plausible solutions by using language prompts. Our approach exploits a recent diffusion based text-to-image (T2I) generative model. We modify the generative process of the T2I diffusion model to analytically enforce data consistency of the solution and explore diverse contents of null-space using text guidance. Our approach results in diverse solutions which are simultaneously consistent with input text and the low resolution images.
Resources
Bibtex
@misc{ gandikota2023exploring, title={Exploring Open Domain Image Super-Resolution through Text}, author={Kanchana Vaishnavi Gandikota and Paramanand Chandramouli}, booktitle={ICML 2023 Workshop on Artificial Intelligence & Human-Computer Interaction}, year={2023} }