Say Anything: Prompt Segment Anything Model
Say Anything: Prompt Segment Anything Model is a Chrome extension developed by Brilliantly. It enables natural language prompting for the Segment Anything Model (SAM) using CLIP embeddings. With this extension, users can use natural language prompts to interact with Meta's Segment Anything Model.
Unlike Meta's demo, Brilliantly's extension is not the same as the encoding used by Meta. It is a layer built on top of it, utilizing OpenAI's CLIP and kevinzakka's implementation of Gradient-weighted Class Activation Mapping. The extension is designed for fun and the results may vary in terms of quality. Some failure modes are explainable, such as imprecise gradient mapping, while others may be completely off.