Abstract

Existing personalization generation methods, such as Textual Inversion, DreamBooth, and LoRA, have made significant progress in custom image creation. However, these works require expensive computational resources and time for fine-tuning, and require multiple reference images, which limits their application in the real world. InstantID addresses these limitations by leveraging a plug-and-play module, enabling it to adeptly handle image personalization in any style using only one face image while maintaining high fidelity. To preserve the face identity, we introduce a novel face encoder to retain the intricate details of the reference image. InstantID’s performance and efficiency in diverse scenarios show its potentiality in various real-world applications. Our work is compatible with common pretrained text-to-image diffusion models such as SD1.5 and SDXL as a plugin. Code and pre-trained checkpoints will be made public soon!

Paper: https://instantid.github.io/instantid.github.io

Code: https://github.com/InstantID/InstantID (coming soon)

Project Page: https://instantid.github.io/

Stylized Synthesis

Novel View Synthesis

Stacking Multiple References

Multi-ID Synthesis in Single Style

You are viewing a single thread.
View all comments
1 point
Deleted by creator
permalink
report
reply

Stable Diffusion

!stable_diffusion@lemmy.dbzer0.com

Create post

Discuss matters related to our favourite AI Art generation technology

Also see

Other communities

Community stats

  • 243

    Monthly active users

  • 823

    Posts

  • 1.7K

    Comments

Community moderators