IP-Adapter Identity-Lock

Properties

family

character-consistency

modality

image + text -> image

whyMultiModel

The base diffusion model has no notion of a specific identity; the adapter supplies a separate image-encoder pathway that the U-Net cannot reproduce from text alone.

steps

[object Object], [object Object], [object Object]

controls

Reference image and weight; prompt text and CFG; scale of the image-prompt contribution; compositional masks to keep layout text-driven.

exampleStack

SDXL + IP-Adapter (or FLUX + IP-Adapter) -> 4x upscale.

useCases

[Brand mascots and recurring characters][Portrait stylization][Product-on-model with locked identity]

pitfalls

Too-high adapter weight overfits the reference and kills prompt adherence; low-fidelity reference images degrade identity rather than stabilize it.

source

IP-Adapter: Text Compatible Image Prompt Adapter for Text-to-Image Diffusion Models (arXiv:2308.06721)