Inpaint Anything: Segment-Remove-Replace

Properties

family

generate-to-edit

modality

image + click -> mask -> removed or replaced region -> composited output

whyMultiModel

Segmentation and inpainting are different problem classes: SAM has no generative capability, LaMa cannot follow text prompts for novel content, and Stable Diffusion alone can't reliably target an arbitrary user-clicked region without an upstream mask.

steps

[object Object], [object Object], [object Object]

controls

click/point prompt, mask dilation, text prompt (replace path only), inpainting strength, seed

exampleStack

SAM -> LaMa (remove) or Stable Diffusion Inpainting (replace)

useCases

[one-click object removal from photos][background replacement via text prompt][e-commerce photo cleanup]

pitfalls

LaMa struggles with large masks needing coherent new structure (shadows, reflections); Stable Diffusion replace path can hallucinate seams without careful mask feathering and colour matching

source

Inpaint Anything: Segment Anything Meets Image Inpainting, arXiv:2304.06790