Can SAMed accept prompts to generate masks? If yes, how can it be done?

[Aimeeman]

Can SAMed accept prompts to generate masks? If yes, how can it be done?

[25benjaminli]

I don't see why it wouldn't be able to accept prompts. Simply modify the code in sam.py.

sparse_embeddings, dense_embeddings = self.prompt_encoder(
            points=None, boxes=None, masks=None
        )

You would probably have to retrain it, as the authors used default embeddings from the image during training I believe.

@hitachinsk lmk if this is correct.

[xingsanmed]

Quite interested in this issue, will the SAMed be used under a prompt-able scenario?

Thanks,