Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

is DragDiffusion suitable for black-box image editing? #64

Open
audo23 opened this issue May 19, 2024 · 0 comments
Open

is DragDiffusion suitable for black-box image editing? #64

audo23 opened this issue May 19, 2024 · 0 comments

Comments

@audo23
Copy link

audo23 commented May 19, 2024

Dear Mr Shi:
Nice to meet you! I just read your code and am very interested. Now I have a question and need your help:
In my case, I have a target image and a black-box online image-generative service, which is also based on a diffusion model and takes both an image and a text prompt as input, then outputs the generated image.
Now, my goal is to find the optimal unknown input image and text prompt to make the generated output image most similar to my target image using cosine and SSIM similarity.
I wonder if DDIM inversion or null-text inversion is suitable for this black-box case or if they are just for white-box open-source cases. Could you please give me some advice on how to achieve this goal? (Besides a gradient descent method, which needs too many iterations.)
Thank you very much!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant